Jul 28 11:28:44.796928 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 11:28:44.796938 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 11:28:44.796947 ip-10-0-142-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 11:28:44.797248 ip-10-0-142-146 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 11:28:54.216521 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 28 11:28:54.216535 ip-10-0-142-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fac66d9679aa4489afae286ad84d78c7 --
Jul 28 11:30:36.703638 ip-10-0-142-146 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 11:30:37.079438 ip-10-0-142-146 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 11:30:37.079438 ip-10-0-142-146 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 11:30:37.079438 ip-10-0-142-146 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 11:30:37.079438 ip-10-0-142-146 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 11:30:37.079438 ip-10-0-142-146 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 11:30:37.080367 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.080284    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 11:30:37.084222 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084202    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.084222 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084218    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.084222 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084223    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.084222 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084229    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084234    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084238    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084248    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084252    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084256    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084260    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084265    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084269    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084273    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084277    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084281    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084284    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084288    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084292    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084296    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084300    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084304    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084307    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084312    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.084480 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084316    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084320    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084323    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084327    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084331    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084335    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084339    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084343    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084347    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084351    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084355    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084360    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084364    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084376    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084398    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084403    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084407    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084411    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084415    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084419    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.085275 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084423    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084427    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084431    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084435    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084439    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084443    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084447    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084452    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084456    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084460    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084465    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084469    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084473    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084477    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084481    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084485    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084489    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084493    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084497    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084502    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.086108 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084506    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084510    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084515    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084519    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084523    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084531    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084545    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084550    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084555    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084559    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084563    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084568    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084572    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084576    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084580    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084584    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084588    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084592    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084597    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.086937 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084601    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084605    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084609    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084613    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084619    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084624    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084629    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084633    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084640    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084645    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084650    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084654    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084660    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084666    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084671    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084675    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.084680    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085888    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085898    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.087648 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085903    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085909    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085913    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085918    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085922    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085927    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085931    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085935    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085940    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085945    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085949    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085954    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085961    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085966    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085970    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085974    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085979    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085983    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085987    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085991    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.088180 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085995    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.085999    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086003    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086008    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086012    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086016    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086020    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086027    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086032    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086037    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086042    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086047    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086051    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086055    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086062    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086066    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086070    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086074    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086078    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086083    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.088685 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086087    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086091    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086096    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086100    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086104    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086108    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086112    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086116    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086120    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086125    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086129    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086133    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086137    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086141    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086146    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086150    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086154    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086158    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086162    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086166    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.089428 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086170    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086174    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086178    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086183    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086187    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086191    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086195    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086200    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086204    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086208    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086212    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086216    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086220    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086224    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086229    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086234    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086238    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086243    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086247    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086251    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.090294 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086256    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086260    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086264    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086268    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086272    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086276    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086281    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086285    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086289    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086293    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086297    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086301    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086305    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086309    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086316    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086322    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086327    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086924    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086932    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.091137 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.086986    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.088887    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.088947    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089069    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089074    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089079    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089084    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089089    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089093    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089098    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089102    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089107    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089111    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089115    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089119    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089124    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089128    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089133    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089137    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089141    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.091666 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089145    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089149    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089153    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089157    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089162    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089166    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089170    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089174    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089179    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089183    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089187    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089191    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089196    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089201    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089205    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089215    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089219    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089223    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089230    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.092395 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089243    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089248    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089253    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089257    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089261    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089265    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089269    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089273    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089278    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089282    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089290    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089296    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089300    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089304    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089308    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089315    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089321    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089325    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089332    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.092897 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089337    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089342    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089346    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089351    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089356    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089360    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089365    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089369    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089373    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089393    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089398    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089402    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089407    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089412    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089416    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089420    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089424    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089427    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089432    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089436    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.093370 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089440    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089444    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089448    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089452    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089456    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089459    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089464    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089468    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089472    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089476    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089480    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089484    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089488    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089492    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089497    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089501    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089504    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089509    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.089512    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089606    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089616    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 11:30:37.093932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089627    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089634    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089640    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089645    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089651    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089657    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089662    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089666    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089672    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089677    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089682    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089687    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089691    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089696    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089701    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089705    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089712    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089716    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089721    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089726    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089732    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089738    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089742    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 11:30:37.094469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089747    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089752    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089757    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089762    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089766    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089771    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089776    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089783    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089787    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089792    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089796    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089801    2573 flags.go:64] FLAG: --enable-server="true"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089805    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089818    2573 flags.go:64] FLAG: --event-burst="100"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089823    2573 flags.go:64] FLAG: --event-qps="50"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089828    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089833    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089837    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089846    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089850    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089857    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089862    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089867    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089872    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089876    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 11:30:37.095002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089881    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089885    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089898    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089903    2573 flags.go:64] FLAG: --feature-gates=""
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089909    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089914    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089919    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089923    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089929    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089934    2573 flags.go:64] FLAG: --help="false"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089939    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089944    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089949    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089954    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089959    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089964    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089969    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089973    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089977    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089982    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089986    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089991    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.089996    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090000    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 11:30:37.095620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090005    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090009    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090013    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090020    2573 flags.go:64] FLAG: --lock-file=""
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090024    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090029    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090034    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090042    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090047    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090051    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090055    2573 flags.go:64] FLAG: --logging-format="text"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090068    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090073    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090078    2573 flags.go:64] FLAG: --manifest-url=""
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090083    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090090    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090096    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090103    2573 flags.go:64] FLAG: --max-pods="110"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090108    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090113    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090117    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090122    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090126    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090131    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090135    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 11:30:37.096229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090147    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090152    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090157    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090161    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090166    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090173    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090178    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090183    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090187    2573 flags.go:64] FLAG: --port="10250"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090192    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090199    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08acb39379f137c17"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090204    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090208    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090213    2573 flags.go:64] FLAG: --register-node="true"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090217    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090223    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090228    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090232    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090236    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090252    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090257    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090262    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090267    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090271    2573 flags.go:64] FLAG: --runonce="false"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090277    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 11:30:37.096842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090282    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090287    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090291    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090295    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090300    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090304    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090309    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090312    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090317    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090321    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090326    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090331    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090336    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090340    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090350    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090354    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090359    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090371    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090375    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090395    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090400    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090404    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090409    2573 flags.go:64] FLAG: --v="2"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090415    2573 flags.go:64] FLAG: --version="false"
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090421    2573 flags.go:64] FLAG: --vmodule=""
Jul 28 11:30:37.097488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090427    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.090432    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090609    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090616    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090620    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090625    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090632    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090636    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090641    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090645    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090649    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090653    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090659    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090664    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090669    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090673    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090677    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090681    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090686    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090690    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.098071 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090694    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090698    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090702    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090706    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090712    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090716    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090720    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090724    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090729    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090733    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090737    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090741    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090746    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090750    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090757    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090770    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090775    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090778    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090785    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.098587 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090790    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090794    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090799    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090803    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090807    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090812    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090816    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090820    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090824    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090829    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090833    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090839    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090844    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090849    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090853    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090858    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090862    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090868    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090872    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.099021 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090877    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090882    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090886    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090890    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090894    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090898    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090901    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090906    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090910    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090914    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090925    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090930    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090936    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090940    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090944    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090948    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090952    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090956    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090960    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090964    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.099483 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090968    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090972    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090976    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090980    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090984    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090988    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090992    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.090997    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091001    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091005    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091010    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091014    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091018    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091022    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091026    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091030    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091034    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091039    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091043    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091047    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.099938 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091051    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091055    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.091059    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.091075    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.097626    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.097642    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.097661    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.097666    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097716    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097721    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097724    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097727    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097731    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097733    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097736    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.100425 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097739    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097742    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097744    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097747    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097749    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097752    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097754    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097757    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097759    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097762    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097765    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097767    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097770    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097772    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097775    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097777    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097779    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097782    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097784    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097787    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.100792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097789    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097792    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097796    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097799    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097802    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097804    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097807    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097809    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097812    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097814    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097817    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097820    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097823    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097825    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097828    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097831    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097833    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097836    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097838    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097841    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.101274 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097843    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097846    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097848    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097851    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097853    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097856    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097858    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097861    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097863    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097866    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097868    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097871    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097873    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097876    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097879    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097882    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097885    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097887    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097890    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097892    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.101753 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097895    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097897    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097901    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097905    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097908    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097910    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097913    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097915    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097918    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097920    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097924    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097928    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097931    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097934    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097937    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097939    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097942    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097944    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097947    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.102206 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097949    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097952    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097954    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097957    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097959    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097961    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097964    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097967    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097969    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097973    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097977    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097980    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.097982    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.097987    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098108    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 11:30:37.102771 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098113    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098116    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098118    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098121    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098124    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098127    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098129    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098132    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098134    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098137    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098140    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098142    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098144    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098147    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098149    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098151    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098154    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098156    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098158    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 11:30:37.103163 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098161    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098163    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098166    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098168    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098171    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098174    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098176    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098179    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098182    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098184    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098187    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098189    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098191    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098194    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098196    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098198    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098201    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098204    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098206    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098209    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 11:30:37.103631 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098211    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098213    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098216    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098218    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098220    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098223    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098225    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098228    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098230    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098233    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098235    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098238    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098241    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098245    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098247    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098249    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098252    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098255    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098257    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098259    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 11:30:37.104109 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098262    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098265    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098267    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098270    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098272    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098276    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098280    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098283    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098286    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098289    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098292    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098294    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098297    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098299    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098302    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098304    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098307    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098309    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098312    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 11:30:37.104601 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098314    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098317    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098319    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098321    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098324    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098326    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098329    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098332    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098335    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098339    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098342    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098344    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098347    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098350    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098352    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098356    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098359    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098362    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098366    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 11:30:37.105036 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:37.098369    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.098373    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.098507    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.100396    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.101710    2573 server.go:1019] "Starting client certificate rotation"
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.101808    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.101843    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 11:30:37.105512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.103829    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 11:30:37.106358 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.106340    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 11:30:37.118936 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.118900    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 28 11:30:37.121065 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.121049    2573 log.go:25] "Validated CRI v1 image API"
Jul 28 11:30:37.121906 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.121888    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 11:30:37.126113 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.126095    2573 fs.go:135] Filesystem UUIDs: map[28a58740-b755-4785-9bc9-e75c4a3f699e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f807fc6e-7520-4072-8d5c-257a98985052:/dev/nvme0n1p4]
Jul 28 11:30:37.126176 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.126113    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 11:30:37.131981 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.131883    2573 manager.go:216] Machine: {Timestamp:2026-07-28 11:30:37.130599169 +0000 UTC m=+0.319200175 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199960 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2372da103928a60f5250ef5ffda194 SystemUUID:ec2372da-1039-28a6-0f52-50ef5ffda194 BootID:fac66d96-79aa-4489-afae-286ad84d78c7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:5f:76:7e:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:5f:76:7e:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:54:d1:22:54:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 11:30:37.131981 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.131979    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 11:30:37.132086 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.132052    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 11:30:37.134605 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.134586    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 11:30:37.134727 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.134607    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 11:30:37.135291 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.135281    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 11:30:37.135321 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.135293    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 11:30:37.135321 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.135300    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 11:30:37.135914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.135903    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 11:30:37.137002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.136993    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 11:30:37.138592 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.138581    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 11:30:37.138709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.138700    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 11:30:37.139457 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139446    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 11:30:37.139488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139464    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 11:30:37.139488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139487    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 11:30:37.139545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139499    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 28 11:30:37.139545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139512    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 11:30:37.139898 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139887    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 11:30:37.139932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.139905    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 11:30:37.143939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.143920    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 11:30:37.145726 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.145713    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 11:30:37.145782 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.145750    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 11:30:37.146948 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146937    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146952    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146958    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146964    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146972    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146977    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 11:30:37.146988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146985    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 11:30:37.147135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.146993    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 11:30:37.147135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147001    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 11:30:37.147135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147006    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 11:30:37.147135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147014    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 11:30:37.147135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147020    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 11:30:37.147696 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147688    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 11:30:37.147730 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.147696    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 11:30:37.150586 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.150569    2573 server.go:1268] "Started kubelet"
Jul 28 11:30:37.150741 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.150628    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 11:30:37.150851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.150729    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 11:30:37.150943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.150931    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 11:30:37.151328 ip-10-0-142-146 systemd[1]: Started Kubernetes Kubelet.
Jul 28 11:30:37.153996 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.153964    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 11:30:37.154079 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.154062    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 11:30:37.154198 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.154183    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 11:30:37.154356 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.154329    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 11:30:37.155484 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.155467    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 11:30:37.156078 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.155987    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 11:30:37.158807 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.158790    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 11:30:37.161860 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.161843    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 11:30:37.161939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.161910    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 11:30:37.161990 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.161951    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.162391 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.162352    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 11:30:37.162589 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.162567    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 11:30:37.162589 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.162589    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 11:30:37.162723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.162704    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 11:30:37.162723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.162712    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 11:30:37.163126 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163109    2573 factory.go:153] Registering CRI-O factory
Jul 28 11:30:37.163126 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163125    2573 factory.go:223] Registration of the crio container factory successfully
Jul 28 11:30:37.163243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163165    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 11:30:37.163243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163173    2573 factory.go:55] Registering systemd factory
Jul 28 11:30:37.163243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163178    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 28 11:30:37.163243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163193    2573 factory.go:103] Registering Raw factory
Jul 28 11:30:37.163243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163206    2573 manager.go:1196] Started watching for new ooms in manager
Jul 28 11:30:37.163789 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.163627    2573 manager.go:349] Starting recovery of all containers
Jul 28 11:30:37.171242 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.171219    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 11:30:37.171612 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.171589    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 11:30:37.174268 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.172183    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18c670b7d4cd85b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-07-28 11:30:37.150545332 +0000 UTC m=+0.339146319,LastTimestamp:2026-07-28 11:30:37.150545332 +0000 UTC m=+0.339146319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}"
Jul 28 11:30:37.174268 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.173220    2573 manager.go:354] Recovery completed
Jul 28 11:30:37.174510 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.174332    2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 11:30:37.177159 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.177147    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.179572 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.179546    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.179633 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.179584    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.179633 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.179595    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.180093 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180079    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 11:30:37.180093 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180093    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 11:30:37.180193 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180109    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 11:30:37.180193 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180126    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.180781 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180767    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.180846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180804    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.180846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.180818    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.181672 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.181657    2573 policy_none.go:49] "None policy: Start"
Jul 28 11:30:37.181722 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.181684    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 11:30:37.181722 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.181698    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 11:30:37.182736 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.182724    2573 policy_none.go:47] "Start"
Jul 28 11:30:37.191800 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.191741    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18c670b7d6886b8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-07-28 11:30:37.179571085 +0000 UTC m=+0.368172071,LastTimestamp:2026-07-28 11:30:37.179571085 +0000 UTC m=+0.368172071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}"
Jul 28 11:30:37.193931 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.193917    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45mks"
Jul 28 11:30:37.204195 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.204034    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18c670b7d688b330  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-146.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-07-28 11:30:37.179589424 +0000 UTC m=+0.368190411,LastTimestamp:2026-07-28 11:30:37.179589424 +0000 UTC m=+0.368190411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}"
Jul 28 11:30:37.206988 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.206971    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45mks"
Jul 28 11:30:37.218956 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.218942    2573 manager.go:337] "Starting Device Plugin manager"
Jul 28 11:30:37.219042 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.218971    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 11:30:37.219042 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.218980    2573 server.go:87] "Starting device plugin registration server"
Jul 28 11:30:37.219163 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.219145    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 11:30:37.219251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.219164    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 11:30:37.219251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.219244    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 11:30:37.219345 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.219320    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 11:30:37.219345 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.219331    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 11:30:37.219791 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.219771    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 11:30:37.219863 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.219815    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.259345 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.259326    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 11:30:37.267135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.260457    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 11:30:37.267135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.260504    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 11:30:37.267135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.260522    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 11:30:37.267135 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.260572    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 11:30:37.267135 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.262831    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:37.319431 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.319411    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.320216 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.320200    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.320300 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.320232    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.320300 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.320248    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.320300 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.320276    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.333217 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.333169    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.333217 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.333191    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-146.ec2.internal\": node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.360635 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.360612    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"]
Jul 28 11:30:37.360707 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.360690    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.362203 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.362182    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.362275 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.362215    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.362275 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.362229    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.364256 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364242    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.364372 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.364449 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364404    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.364696 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.364679    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.364923 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364901    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.364993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364937    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.364993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364951    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.364993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.364911    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.365121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.365008    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.365121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.365020    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.366965 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.366950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.367049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.366971    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 11:30:37.367566 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.367552    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 11:30:37.367638 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.367579    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 11:30:37.367638 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.367592    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID"
Jul 28 11:30:37.397934 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.397920    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-146.ec2.internal\" not found" node="ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.402152 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.402138    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-146.ec2.internal\" not found" node="ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.462935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.462917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.462989 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.462939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.464974 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.464958    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.563234 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.563216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.563284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.563239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.563284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.563259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93041afa6a72f232924f93ead32451d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"93041afa6a72f232924f93ead32451d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.563342 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.563315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.563375 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.563365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/791774579aef4f48d02db8bb466956ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"791774579aef4f48d02db8bb466956ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.565345 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.565332    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.664196 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.664167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93041afa6a72f232924f93ead32451d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"93041afa6a72f232924f93ead32451d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.664308 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.664224    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93041afa6a72f232924f93ead32451d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"93041afa6a72f232924f93ead32451d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.666468 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.666450    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.702331 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.702301    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.705728 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:37.705707    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:37.767592 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.767565    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.869608 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.869538    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:37.970600 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:37.970574    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:38.071663 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:38.071640    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:38.081282 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.081265    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:38.101288 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.101269    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 11:30:38.101418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.101384    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 11:30:38.101460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.101435    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 11:30:38.172547 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:38.172528    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found"
Jul 28 11:30:38.210784 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.210734    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 11:25:37 +0000 UTC" deadline="2028-01-22 10:04:30.843726585 +0000 UTC"
Jul 28 11:30:38.210784 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.210778    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13030h33m52.632952008s"
Jul 28 11:30:38.230363 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.230343    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:38.247900 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.247872    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:38.262235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.262215    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:38.280111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.280090    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 11:30:38.281140 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.281121    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"
Jul 28 11:30:38.296303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.296268    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 11:30:38.299074 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:38.299047    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93041afa6a72f232924f93ead32451d3.slice/crio-9eb789aef2d2f60bda3efcc1e9f0143e7f0d96be4272374f2bd74196a5806088 WatchSource:0}: Error finding container 9eb789aef2d2f60bda3efcc1e9f0143e7f0d96be4272374f2bd74196a5806088: Status 404 returned error can't find the container with id 9eb789aef2d2f60bda3efcc1e9f0143e7f0d96be4272374f2bd74196a5806088
Jul 28 11:30:38.299632 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:38.299610    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791774579aef4f48d02db8bb466956ee.slice/crio-ff44fb17d6c4bcd8523b129b7efd41937aeb021c488b712d73b871d2ae7218f1 WatchSource:0}: Error finding container ff44fb17d6c4bcd8523b129b7efd41937aeb021c488b712d73b871d2ae7218f1: Status 404 returned error can't find the container with id ff44fb17d6c4bcd8523b129b7efd41937aeb021c488b712d73b871d2ae7218f1
Jul 28 11:30:38.304773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.304756    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 11:30:38.920737 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:38.920707    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:39.140804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.140763    2573 apiserver.go:52] "Watching apiserver"
Jul 28 11:30:39.150138 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.150073    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 11:30:39.150589 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.150560    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal","openshift-multus/multus-sqkrb","openshift-network-operator/iptables-alerter-q2zsh","openshift-ovn-kubernetes/ovnkube-node-vn7gk","kube-system/global-pull-secret-syncer-bbhww","kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q","openshift-cluster-node-tuning-operator/tuned-2dcch","openshift-image-registry/node-ca-gs5rx","openshift-multus/multus-additional-cni-plugins-vv2gc","openshift-multus/network-metrics-daemon-n48jw","openshift-network-diagnostics/network-check-target-rx5cz","kube-system/konnectivity-agent-mdn6s","openshift-dns/node-resolver-v9vx9"]
Jul 28 11:30:39.153683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.153485    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.155976 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.155792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.156909 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.156675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.156909 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.156711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.156909 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.156731    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xtd8s\""
Jul 28 11:30:39.158202 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.158180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:39.158312 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.158257    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:39.158455 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.158414    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgqgc\""
Jul 28 11:30:39.158542 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.158438    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.158599 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.158540    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.161086 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.161065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.163494 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.163474    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 11:30:39.164473 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.164447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.165837 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.165817    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.165837 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.165834    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 11:30:39.165990 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.165866    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.165990 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.165872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pr5s8\""
Jul 28 11:30:39.166899 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.166859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.168914 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.167344    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:39.168914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.168174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-psl4d\""
Jul 28 11:30:39.168914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.168424    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 11:30:39.168914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.168677    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.168914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.168781    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.171249 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.171188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.173855 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.173834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.173951 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.173856    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6tms9\""
Jul 28 11:30:39.173951 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.173885    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 11:30:39.174618 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.174589    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 11:30:39.174618 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.174615    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.174771 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.174639    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.174891 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.174872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 11:30:39.175734 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.175706    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 11:30:39.176715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.176696    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.176852 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.176768    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:39.177128 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.177107    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 11:30:39.177499 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.177453    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kc8vp\""
Jul 28 11:30:39.177655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.177636    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.177865 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.177847    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 11:30:39.178495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178475    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.178585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-kubernetes\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.178585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-run\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.178690 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmlhs\" (UniqueName: \"kubernetes.io/projected/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-kube-api-access-mmlhs\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.178690 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.178690 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-var-lib-kubelet\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-serviceca\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk4r4\" (UniqueName: \"kubernetes.io/projected/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-kube-api-access-dk4r4\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-registration-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-device-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.178836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-sys\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-host\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac18fcef-78da-49a3-82cb-fa297e53794b-tmp-dir\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-conf\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-lib-modules\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-tmp\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac18fcef-78da-49a3-82cb-fa297e53794b-hosts-file\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.178961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbv65\" (UniqueName: \"kubernetes.io/projected/ac18fcef-78da-49a3-82cb-fa297e53794b-kube-api-access-zbv65\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-socket-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-sys-fs\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-modprobe-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.179127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-systemd\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-host\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pl4\" (UniqueName: \"kubernetes.io/projected/4614aa7f-d41d-463e-a81e-d059a84a72cd-kube-api-access-k5pl4\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysconfig\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-tuned\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.179757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.179670    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 11:30:39.181588 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.181568    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.183157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.182985    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 11:30:39.183157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.183007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l2gf5\""
Jul 28 11:30:39.183157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.183060    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:30:39.183157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.183120    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 11:30:39.184224 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.184193    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jtfnw\""
Jul 28 11:30:39.184360 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.184309    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 11:30:39.184857 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.184831    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 11:30:39.185052 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.185020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.189897 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.189876    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 11:30:39.190169 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.190154    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tj8n2\""
Jul 28 11:30:39.195848 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.195824    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 11:30:39.232708 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.232683    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc4vr"
Jul 28 11:30:39.246418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.246393    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc4vr"
Jul 28 11:30:39.263966 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.263944    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 11:30:39.266084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.266029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" event={"ID":"93041afa6a72f232924f93ead32451d3","Type":"ContainerStarted","Data":"9eb789aef2d2f60bda3efcc1e9f0143e7f0d96be4272374f2bd74196a5806088"}
Jul 28 11:30:39.267319 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.267294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"791774579aef4f48d02db8bb466956ee","Type":"ContainerStarted","Data":"ff44fb17d6c4bcd8523b129b7efd41937aeb021c488b712d73b871d2ae7218f1"}
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-system-cni-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cnibin\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-cnibin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-conf-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-multus-certs\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-log-socket\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-config\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-agent-certs\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-netd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnrr\" (UniqueName: \"kubernetes.io/projected/3a85e93a-b43b-4dc5-96e0-af89980e7385-kube-api-access-9fnrr\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-dbus\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279902    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-system-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-kubelet\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.280238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbv65\" (UniqueName: \"kubernetes.io/projected/ac18fcef-78da-49a3-82cb-fa297e53794b-kube-api-access-zbv65\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.279989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-socket-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-sys-fs\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bsqj\" (UniqueName: \"kubernetes.io/projected/08e3b195-fbd7-49f3-a648-6c2613949d66-kube-api-access-8bsqj\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a85e93a-b43b-4dc5-96e0-af89980e7385-host-slash\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-host\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pl4\" (UniqueName: \"kubernetes.io/projected/4614aa7f-d41d-463e-a81e-d059a84a72cd-kube-api-access-k5pl4\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysconfig\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-konnectivity-ca\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-k8s-cni-cncf-io\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-netns\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-multus\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-kubernetes\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlhs\" (UniqueName: \"kubernetes.io/projected/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-kube-api-access-mmlhs\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-env-overrides\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.281041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-etc-kubernetes\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-script-lib\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4snk\" (UniqueName: \"kubernetes.io/projected/43df24c6-6e6e-48f5-b00a-25e44f7b866f-kube-api-access-h4snk\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26j7l\" (UniqueName: \"kubernetes.io/projected/c234aa72-1dc6-4af1-b70a-7f778abf2435-kube-api-access-26j7l\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-os-release\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-registration-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-device-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-sys\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-host\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.280869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281336    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-host\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-kubernetes\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac18fcef-78da-49a3-82cb-fa297e53794b-tmp-dir\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.281846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-host\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac18fcef-78da-49a3-82cb-fa297e53794b-tmp-dir\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-sys-fs\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-socket-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-conf\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.281818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-sys\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-registration-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-device-dir\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysconfig\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-lib-modules\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-kubelet\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-etc-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-ovn\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.282624 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282629    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-sysctl-conf\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-tmp\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-systemd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-node-log\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-multus-daemon-config\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac18fcef-78da-49a3-82cb-fa297e53794b-hosts-file\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282776    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-lib-modules\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.282958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac18fcef-78da-49a3-82cb-fa297e53794b-hosts-file\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5bt\" (UniqueName: \"kubernetes.io/projected/9243f6bb-364d-45ed-811b-f3401054311e-kube-api-access-8f5bt\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283053    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-modprobe-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-systemd\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a85e93a-b43b-4dc5-96e0-af89980e7385-iptables-alerter-script\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.283276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-kubelet-config\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-modprobe-d\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-hostroot\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-systemd\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-tuned\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-systemd-units\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-netns\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-var-lib-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-bin\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-os-release\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-run\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-slash\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08e3b195-fbd7-49f3-a648-6c2613949d66-ovn-node-metrics-cert\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-run\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-socket-dir-parent\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.284032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-var-lib-kubelet\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-cni-binary-copy\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-bin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-serviceca\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4614aa7f-d41d-463e-a81e-d059a84a72cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk4r4\" (UniqueName: \"kubernetes.io/projected/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-kube-api-access-dk4r4\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.283957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-var-lib-kubelet\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.284755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.284456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-serviceca\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.287152 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.287131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-tmp\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.287252 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.287187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-etc-tuned\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.292838 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.292817    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:39.292941 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.292850    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:39.292941 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.292862    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:39.292941 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.292926    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:30:39.792903517 +0000 UTC m=+2.981504494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:39.295268 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.295214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmlhs\" (UniqueName: \"kubernetes.io/projected/c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a-kube-api-access-mmlhs\") pod \"tuned-2dcch\" (UID: \"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a\") " pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.297915 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.297682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbv65\" (UniqueName: \"kubernetes.io/projected/ac18fcef-78da-49a3-82cb-fa297e53794b-kube-api-access-zbv65\") pod \"node-resolver-v9vx9\" (UID: \"ac18fcef-78da-49a3-82cb-fa297e53794b\") " pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.298498 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.298432    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk4r4\" (UniqueName: \"kubernetes.io/projected/32a4e0a5-c9f1-4ed8-b32f-43fc47e96164-kube-api-access-dk4r4\") pod \"node-ca-gs5rx\" (UID: \"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164\") " pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.299071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.299050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pl4\" (UniqueName: \"kubernetes.io/projected/4614aa7f-d41d-463e-a81e-d059a84a72cd-kube-api-access-k5pl4\") pod \"aws-ebs-csi-driver-node-hhk6q\" (UID: \"4614aa7f-d41d-463e-a81e-d059a84a72cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.385164 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08e3b195-fbd7-49f3-a648-6c2613949d66-ovn-node-metrics-cert\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.385164 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-socket-dir-parent\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-cni-binary-copy\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-bin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-system-cni-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-socket-dir-parent\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-bin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cnibin\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-system-cni-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-cnibin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385350    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cnibin\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-conf-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-multus-certs\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-log-socket\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-config\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-cnibin\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-agent-certs\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-multus-certs\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-conf-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.385396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-netd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-log-socket\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385772    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-netd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnrr\" (UniqueName: \"kubernetes.io/projected/3a85e93a-b43b-4dc5-96e0-af89980e7385-kube-api-access-9fnrr\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-dbus\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.385962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-cni-binary-copy\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-dbus\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-system-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-config\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-kubelet\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bsqj\" (UniqueName: \"kubernetes.io/projected/08e3b195-fbd7-49f3-a648-6c2613949d66-kube-api-access-8bsqj\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-system-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a85e93a-b43b-4dc5-96e0-af89980e7385-host-slash\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-kubelet\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a85e93a-b43b-4dc5-96e0-af89980e7385-host-slash\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-konnectivity-ca\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386364    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-k8s-cni-cncf-io\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-netns\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-multus\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-env-overrides\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-netns\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-run-k8s-cni-cncf-io\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-etc-kubernetes\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-etc-kubernetes\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-host-var-lib-cni-multus\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-script-lib\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4snk\" (UniqueName: \"kubernetes.io/projected/43df24c6-6e6e-48f5-b00a-25e44f7b866f-kube-api-access-h4snk\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26j7l\" (UniqueName: \"kubernetes.io/projected/c234aa72-1dc6-4af1-b70a-7f778abf2435-kube-api-access-26j7l\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-os-release\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.387883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-kubelet\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-etc-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-ovn\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-systemd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-node-log\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.386966    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-multus-daemon-config\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-kubelet\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-os-release\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.387038    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:39.887020521 +0000 UTC m=+3.075621500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.387091    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:39.388723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-etc-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-ovn\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.387236    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:39.88721921 +0000 UTC m=+3.075820186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-run-systemd\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5bt\" (UniqueName: \"kubernetes.io/projected/9243f6bb-364d-45ed-811b-f3401054311e-kube-api-access-8f5bt\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-multus-cni-dir\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a85e93a-b43b-4dc5-96e0-af89980e7385-iptables-alerter-script\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-kubelet-config\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-hostroot\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-systemd-units\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-netns\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387425    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-ovnkube-script-lib\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-konnectivity-ca\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.386896    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08e3b195-fbd7-49f3-a648-6c2613949d66-env-overrides\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-var-lib-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.389355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-node-log\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-bin\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387519    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-var-lib-openvswitch\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-os-release\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-slash\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387634    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-cni-bin\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-os-release\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9243f6bb-364d-45ed-811b-f3401054311e-multus-daemon-config\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9243f6bb-364d-45ed-811b-f3401054311e-hostroot\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/212221fa-9df5-464c-84c9-63794ff84767-kubelet-config\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-slash\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-systemd-units\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08e3b195-fbd7-49f3-a648-6c2613949d66-host-run-netns\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.387999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43df24c6-6e6e-48f5-b00a-25e44f7b866f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.388172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43df24c6-6e6e-48f5-b00a-25e44f7b866f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.390098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.388204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a85e93a-b43b-4dc5-96e0-af89980e7385-iptables-alerter-script\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.390773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.388494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08e3b195-fbd7-49f3-a648-6c2613949d66-ovn-node-metrics-cert\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.390773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.388627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f47aed4-fbad-49c5-8c28-4fac69d6ff28-agent-certs\") pod \"konnectivity-agent-mdn6s\" (UID: \"8f47aed4-fbad-49c5-8c28-4fac69d6ff28\") " pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.398555 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.398531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5bt\" (UniqueName: \"kubernetes.io/projected/9243f6bb-364d-45ed-811b-f3401054311e-kube-api-access-8f5bt\") pod \"multus-sqkrb\" (UID: \"9243f6bb-364d-45ed-811b-f3401054311e\") " pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.398687 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.398663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26j7l\" (UniqueName: \"kubernetes.io/projected/c234aa72-1dc6-4af1-b70a-7f778abf2435-kube-api-access-26j7l\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.399006 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.398962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bsqj\" (UniqueName: \"kubernetes.io/projected/08e3b195-fbd7-49f3-a648-6c2613949d66-kube-api-access-8bsqj\") pod \"ovnkube-node-vn7gk\" (UID: \"08e3b195-fbd7-49f3-a648-6c2613949d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.399006 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.399001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnrr\" (UniqueName: \"kubernetes.io/projected/3a85e93a-b43b-4dc5-96e0-af89980e7385-kube-api-access-9fnrr\") pod \"iptables-alerter-q2zsh\" (UID: \"3a85e93a-b43b-4dc5-96e0-af89980e7385\") " pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.399156 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.399098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4snk\" (UniqueName: \"kubernetes.io/projected/43df24c6-6e6e-48f5-b00a-25e44f7b866f-kube-api-access-h4snk\") pod \"multus-additional-cni-plugins-vv2gc\" (UID: \"43df24c6-6e6e-48f5-b00a-25e44f7b866f\") " pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.465641 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.465579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2dcch"
Jul 28 11:30:39.475956 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.475936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9vx9"
Jul 28 11:30:39.486214 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.486180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs5rx"
Jul 28 11:30:39.492958 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.492934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q"
Jul 28 11:30:39.498957 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.498939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:30:39.507695 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.507676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vv2gc"
Jul 28 11:30:39.515581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.515564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2zsh"
Jul 28 11:30:39.523517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.523500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:30:39.530452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.530432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqkrb"
Jul 28 11:30:39.891894 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.891865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:39.892049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.891909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:39.892049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:39.891945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:39.892049 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892041    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:39.892196 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892049    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:39.892196 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892052    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:39.892196 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892120    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:39.892196 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892130    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:39.892196 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892100    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:40.892085312 +0000 UTC m=+4.080686305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:39.895015 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892174    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:40.892158312 +0000 UTC m=+4.080759289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:39.895015 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:39.892612    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:30:40.892584877 +0000 UTC m=+4.081185870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:40.174699 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.174674    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4614aa7f_d41d_463e_a81e_d059a84a72cd.slice/crio-7a29579a5e88b0212e5bf02fa8a4c7733d15e6ee0d39d751719c01518b4652c4 WatchSource:0}: Error finding container 7a29579a5e88b0212e5bf02fa8a4c7733d15e6ee0d39d751719c01518b4652c4: Status 404 returned error can't find the container with id 7a29579a5e88b0212e5bf02fa8a4c7733d15e6ee0d39d751719c01518b4652c4
Jul 28 11:30:40.175792 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.175767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23bbbaf_26db_4e9f_bf2a_fcf1e92c0e3a.slice/crio-ee2178426815f60b2606fcbb0cc11d68fbd0ec998031ea12f616b77eae3ab491 WatchSource:0}: Error finding container ee2178426815f60b2606fcbb0cc11d68fbd0ec998031ea12f616b77eae3ab491: Status 404 returned error can't find the container with id ee2178426815f60b2606fcbb0cc11d68fbd0ec998031ea12f616b77eae3ab491
Jul 28 11:30:40.199894 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.199867    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac18fcef_78da_49a3_82cb_fa297e53794b.slice/crio-faf71241412eba63233000bcaa1b4053a6cc117057c33190e839762f1142d1c9 WatchSource:0}: Error finding container faf71241412eba63233000bcaa1b4053a6cc117057c33190e839762f1142d1c9: Status 404 returned error can't find the container with id faf71241412eba63233000bcaa1b4053a6cc117057c33190e839762f1142d1c9
Jul 28 11:30:40.201037 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.200989    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a4e0a5_c9f1_4ed8_b32f_43fc47e96164.slice/crio-a5f0f226017191d9ec1ac2c493cae90932b6106a4b4e1b5001f75e306cffb36c WatchSource:0}: Error finding container a5f0f226017191d9ec1ac2c493cae90932b6106a4b4e1b5001f75e306cffb36c: Status 404 returned error can't find the container with id a5f0f226017191d9ec1ac2c493cae90932b6106a4b4e1b5001f75e306cffb36c
Jul 28 11:30:40.205164 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.205141    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9243f6bb_364d_45ed_811b_f3401054311e.slice/crio-88f2551b1f48ed3240384b4a6f68f0c94a8998a5d7fc51c85c3f0920ebf12efc WatchSource:0}: Error finding container 88f2551b1f48ed3240384b4a6f68f0c94a8998a5d7fc51c85c3f0920ebf12efc: Status 404 returned error can't find the container with id 88f2551b1f48ed3240384b4a6f68f0c94a8998a5d7fc51c85c3f0920ebf12efc
Jul 28 11:30:40.206122 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.206094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f47aed4_fbad_49c5_8c28_4fac69d6ff28.slice/crio-bc8d6a046f506de048ab997a6a2d38d2d11481ccbbfdd2ef2c3f77304cbe27e3 WatchSource:0}: Error finding container bc8d6a046f506de048ab997a6a2d38d2d11481ccbbfdd2ef2c3f77304cbe27e3: Status 404 returned error can't find the container with id bc8d6a046f506de048ab997a6a2d38d2d11481ccbbfdd2ef2c3f77304cbe27e3
Jul 28 11:30:40.207179 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.206933    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e3b195_fbd7_49f3_a648_6c2613949d66.slice/crio-921d91e2d7e620c2b4907a205198217b3b25b84abdca5a354d8ac2e5884c45f5 WatchSource:0}: Error finding container 921d91e2d7e620c2b4907a205198217b3b25b84abdca5a354d8ac2e5884c45f5: Status 404 returned error can't find the container with id 921d91e2d7e620c2b4907a205198217b3b25b84abdca5a354d8ac2e5884c45f5
Jul 28 11:30:40.208215 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.208191    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43df24c6_6e6e_48f5_b00a_25e44f7b866f.slice/crio-ec037ca7c7f27d0633cb695a06466fe5c7db1ec58bdbc159980075a393a32b70 WatchSource:0}: Error finding container ec037ca7c7f27d0633cb695a06466fe5c7db1ec58bdbc159980075a393a32b70: Status 404 returned error can't find the container with id ec037ca7c7f27d0633cb695a06466fe5c7db1ec58bdbc159980075a393a32b70
Jul 28 11:30:40.209079 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:30:40.209054    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a85e93a_b43b_4dc5_96e0_af89980e7385.slice/crio-890a7771246020c596a4edf7b6d693f440edf3b972fcdbcf32aa9f0989cecfa5 WatchSource:0}: Error finding container 890a7771246020c596a4edf7b6d693f440edf3b972fcdbcf32aa9f0989cecfa5: Status 404 returned error can't find the container with id 890a7771246020c596a4edf7b6d693f440edf3b972fcdbcf32aa9f0989cecfa5
Jul 28 11:30:40.250428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.250370    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 11:25:39 +0000 UTC" deadline="2028-04-30 05:56:45.57583896 +0000 UTC"
Jul 28 11:30:40.250428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.250427    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15402h26m5.325414645s"
Jul 28 11:30:40.269982 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.269913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2zsh" event={"ID":"3a85e93a-b43b-4dc5-96e0-af89980e7385","Type":"ContainerStarted","Data":"890a7771246020c596a4edf7b6d693f440edf3b972fcdbcf32aa9f0989cecfa5"}
Jul 28 11:30:40.271055 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.271028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs5rx" event={"ID":"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164","Type":"ContainerStarted","Data":"a5f0f226017191d9ec1ac2c493cae90932b6106a4b4e1b5001f75e306cffb36c"}
Jul 28 11:30:40.272066 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.272043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q" event={"ID":"4614aa7f-d41d-463e-a81e-d059a84a72cd","Type":"ContainerStarted","Data":"7a29579a5e88b0212e5bf02fa8a4c7733d15e6ee0d39d751719c01518b4652c4"}
Jul 28 11:30:40.273291 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.273263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerStarted","Data":"ec037ca7c7f27d0633cb695a06466fe5c7db1ec58bdbc159980075a393a32b70"}
Jul 28 11:30:40.274775 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.274751    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"921d91e2d7e620c2b4907a205198217b3b25b84abdca5a354d8ac2e5884c45f5"}
Jul 28 11:30:40.275819 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.275798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mdn6s" event={"ID":"8f47aed4-fbad-49c5-8c28-4fac69d6ff28","Type":"ContainerStarted","Data":"bc8d6a046f506de048ab997a6a2d38d2d11481ccbbfdd2ef2c3f77304cbe27e3"}
Jul 28 11:30:40.277344 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.277318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqkrb" event={"ID":"9243f6bb-364d-45ed-811b-f3401054311e","Type":"ContainerStarted","Data":"88f2551b1f48ed3240384b4a6f68f0c94a8998a5d7fc51c85c3f0920ebf12efc"}
Jul 28 11:30:40.279342 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.279322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9vx9" event={"ID":"ac18fcef-78da-49a3-82cb-fa297e53794b","Type":"ContainerStarted","Data":"faf71241412eba63233000bcaa1b4053a6cc117057c33190e839762f1142d1c9"}
Jul 28 11:30:40.283381 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.283360    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2dcch" event={"ID":"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a","Type":"ContainerStarted","Data":"ee2178426815f60b2606fcbb0cc11d68fbd0ec998031ea12f616b77eae3ab491"}
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.901138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901462    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.901481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:40.901544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901491    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901593    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901659    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:30:42.901638081 +0000 UTC m=+6.090239059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901723    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901779    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:42.901763442 +0000 UTC m=+6.090364425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901569    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:40.902014 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:40.901818    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:42.901808602 +0000 UTC m=+6.090409583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:41.251514 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.251372    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 11:25:39 +0000 UTC" deadline="2028-02-17 20:51:16.11111595 +0000 UTC"
Jul 28 11:30:41.251514 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.251426    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13665h20m34.859696497s"
Jul 28 11:30:41.264154 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.264126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:41.264334 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:41.264309    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:41.264767 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.264747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:41.264858 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:41.264841    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:41.264931 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.264910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:41.265007 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:41.264988    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:41.293671 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.293646    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 11:30:41.304810 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.304779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" event={"ID":"93041afa6a72f232924f93ead32451d3","Type":"ContainerStarted","Data":"9315a38c2b50e15c7738b7a8a7d85bcde7b28ead9dd50bcfb1df1d79091160b3"}
Jul 28 11:30:41.325104 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.325077    2573 generic.go:356] "Generic (PLEG): container finished" podID="791774579aef4f48d02db8bb466956ee" containerID="04ac9124dc069144e16c436ebafd2acb9c4a4829568debacfd92a794e17d202b" exitCode=0
Jul 28 11:30:41.325215 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.325128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"791774579aef4f48d02db8bb466956ee","Type":"ContainerDied","Data":"04ac9124dc069144e16c436ebafd2acb9c4a4829568debacfd92a794e17d202b"}
Jul 28 11:30:41.346189 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:41.346138    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" podStartSLOduration=3.346120184 podStartE2EDuration="3.346120184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:41.32590363 +0000 UTC m=+4.514504656" watchObservedRunningTime="2026-07-28 11:30:41.346120184 +0000 UTC m=+4.534721184"
Jul 28 11:30:42.339564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:42.339525    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"791774579aef4f48d02db8bb466956ee","Type":"ContainerStarted","Data":"7d02da19f82bd8da3d2b45d2d2ed7034a10c640ddb4723afc4047007399c330d"}
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:42.921786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:42.921854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:42.921901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922047    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922066    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922081    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922142    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:30:46.92212395 +0000 UTC m=+10.110724930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922571    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922621    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:46.922605716 +0000 UTC m=+10.111206697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922676    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:42.922935 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:42.922713    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:46.922701259 +0000 UTC m=+10.111302240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:43.262304 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:43.262224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:43.262304 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:43.262224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:43.262550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:43.262358    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:43.262550 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:43.262375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:43.262550 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:43.262486    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:43.262707 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:43.262546    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:45.262144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:45.261740    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:45.262144 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:45.261859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:45.262702 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:45.262223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:45.262702 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:45.262327    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:45.262702 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:45.262386    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:45.262702 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:45.262485    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:46.954903 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:46.954859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:46.954934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:46.954981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955034    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955047    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955065    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955076    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955078    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955105    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:54.955087069 +0000 UTC m=+18.143688056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955126    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:30:54.955114826 +0000 UTC m=+18.143715810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:46.955358 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:46.955142    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:30:54.955134039 +0000 UTC m=+18.143735016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:47.263949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:47.263990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:47.264052    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:47.264071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:47.264173    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:47.264421 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:47.264272    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:49.261890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:49.261342    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:49.261890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:49.261432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:49.261890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:49.261452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:49.261890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:49.261554    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:49.262760 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:49.262099    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:49.262760 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:49.262184    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:51.260763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:51.260784    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:51.260773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:51.260897    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:51.260973    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:51.261251 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:51.261033    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:53.261437 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:53.261409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:53.261939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:53.261419    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:53.261939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:53.261529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:53.261939 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:53.261535    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:53.261939 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:53.261635    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:53.261939 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:53.261744    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:55.012652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.012622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.012663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.012690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012792    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012802    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012854    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:11.012835752 +0000 UTC m=+34.201436726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012859    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012871    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:11.012862003 +0000 UTC m=+34.201462982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012875    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012888    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:55.013067 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.012921    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:31:11.012911914 +0000 UTC m=+34.201512897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:30:55.261303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.261273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:55.261303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.261290    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:55.261552 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:55.261289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:55.261552 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.261416    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:55.261630 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.261552    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:55.261674 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:55.261651    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:57.261941 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:57.261901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:57.262441 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:57.262019    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:57.262441 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:57.262065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:57.262441 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:57.262124    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:57.262441 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:57.262162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:57.262441 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:57.262220    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:59.265501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.265008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:30:59.266517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.265067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:30:59.266517 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:59.265627    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:30:59.266517 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:59.265679    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:30:59.266517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.265067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:30:59.266517 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:30:59.265788    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:30:59.377170 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.377129    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="55b859b9f86f69053a3719f6070c6611fe56941a00cdd1b7b1992c5ed185778b" exitCode=0
Jul 28 11:30:59.377342 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.377226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"55b859b9f86f69053a3719f6070c6611fe56941a00cdd1b7b1992c5ed185778b"}
Jul 28 11:30:59.380331 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"9a041eefbc4f445d4c32c123c8e4176ac81510b9e25737399b7d5e287726e1a6"}
Jul 28 11:30:59.380463 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"bc1d45c0418837ed6aeeb18632582e22cc35a99a55a6c2d4d50685731e6c9d34"}
Jul 28 11:30:59.380463 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"0496f18e57561c24405fe5f9131f35962264472d89d3b53f6c2c941e27aa26a5"}
Jul 28 11:30:59.380561 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"acae7f2aac9cf2d95dcdf27a9941506e6114ffdc049957ef89f185282707fb36"}
Jul 28 11:30:59.380561 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"a78ff01b4f04eb128cf5293206e9f0a2c3cc2526ca055325348284278b61a2e2"}
Jul 28 11:30:59.380632 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.380595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"8258c6fe0482e4419b2e2f4f7511ac7d134f1ec88084a3b7a0de77960b2560f0"}
Jul 28 11:30:59.381828 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.381800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mdn6s" event={"ID":"8f47aed4-fbad-49c5-8c28-4fac69d6ff28","Type":"ContainerStarted","Data":"0609629b9e92c65520f97b77c87d425fd27bbb4e2746ca7b127ab4514b121f18"}
Jul 28 11:30:59.383145 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.383125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqkrb" event={"ID":"9243f6bb-364d-45ed-811b-f3401054311e","Type":"ContainerStarted","Data":"e17452a4f6fb3908b09ba448c64d11e78753dc51abf2f517285075c6565dcfdc"}
Jul 28 11:30:59.384421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.384401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9vx9" event={"ID":"ac18fcef-78da-49a3-82cb-fa297e53794b","Type":"ContainerStarted","Data":"bf2816a6141812457fa9be9dfd203e35b55cffdfd3821c8cd3892c6a6ab6b64b"}
Jul 28 11:30:59.388559 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.388533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2dcch" event={"ID":"c23bbbaf-26db-4e9f-bf2a-fcf1e92c0e3a","Type":"ContainerStarted","Data":"c2ecd2c544475603800bbaf488cc2901036a53f9b0308b7c73de012dfbbf74ea"}
Jul 28 11:30:59.390039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.390018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs5rx" event={"ID":"32a4e0a5-c9f1-4ed8-b32f-43fc47e96164","Type":"ContainerStarted","Data":"2901cd581ea9d8d1dd05059c3faae6a5e06eb73c2de0654a1295a99e14aeefb1"}
Jul 28 11:30:59.391359 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.391341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q" event={"ID":"4614aa7f-d41d-463e-a81e-d059a84a72cd","Type":"ContainerStarted","Data":"27a256e29e35ffcea2382ff5af4c9fdd853b5db31e989c6639d6cf493ccb15b1"}
Jul 28 11:30:59.405121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.405086    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" podStartSLOduration=21.405075724 podStartE2EDuration="21.405075724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:42.364810308 +0000 UTC m=+5.553411308" watchObservedRunningTime="2026-07-28 11:30:59.405075724 +0000 UTC m=+22.593676721"
Jul 28 11:30:59.430419 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.430366    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sqkrb" podStartSLOduration=3.059182347 podStartE2EDuration="21.430352512s" totalImagesPullingTime="18.371170165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:59.430189196 +0000 UTC m=+22.618790193" watchObservedRunningTime="2026-07-28 11:30:59.430352512 +0000 UTC m=+22.618953508"
Jul 28 11:30:59.450877 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.450836    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2dcch" podStartSLOduration=4.067841895 podStartE2EDuration="22.450822623s" totalImagesPullingTime="18.382980728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:59.450370699 +0000 UTC m=+22.638971698" watchObservedRunningTime="2026-07-28 11:30:59.450822623 +0000 UTC m=+22.639423621"
Jul 28 11:30:59.471606 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.471561    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v9vx9" podStartSLOduration=4.095643629 podStartE2EDuration="22.471544218s" totalImagesPullingTime="18.375900589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:59.470906787 +0000 UTC m=+22.659507788" watchObservedRunningTime="2026-07-28 11:30:59.471544218 +0000 UTC m=+22.660145212"
Jul 28 11:30:59.504501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.504463    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gs5rx" podStartSLOduration=4.131047535 podStartE2EDuration="22.504450467s" totalImagesPullingTime="18.373402932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:59.488631826 +0000 UTC m=+22.677232841" watchObservedRunningTime="2026-07-28 11:30:59.504450467 +0000 UTC m=+22.693051465"
Jul 28 11:30:59.504700 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.504678    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mdn6s" podStartSLOduration=7.5419624039999995 podStartE2EDuration="21.504671344s" totalImagesPullingTime="13.96270894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:30:59.504425327 +0000 UTC m=+22.693026344" watchObservedRunningTime="2026-07-28 11:30:59.504671344 +0000 UTC m=+22.693272340"
Jul 28 11:30:59.974402 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:30:59.974287    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 11:31:00.232581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.232440    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T11:30:59.974305452Z","UUID":"bbc70237-9a32-4881-8bf0-46f362e8a737","Handler":null,"Name":"","Endpoint":""}
Jul 28 11:31:00.234075 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.234046    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 11:31:00.234204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.234086    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 11:31:00.307565 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.307530    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:31:00.308268 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.308249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:31:00.396871 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.396673    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q" event={"ID":"4614aa7f-d41d-463e-a81e-d059a84a72cd","Type":"ContainerStarted","Data":"ba29786b84c626114ef24c0f8ddf91a26bff98e13dbc118b5ccc6bce784872ee"}
Jul 28 11:31:00.398395 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.398349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2zsh" event={"ID":"3a85e93a-b43b-4dc5-96e0-af89980e7385","Type":"ContainerStarted","Data":"2e4f28f670ca11d2a16e885e52bafa97a92a7d0699d77afb90d0c7a2ab2a7342"}
Jul 28 11:31:00.399191 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.399171    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:31:00.399919 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.399892    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mdn6s"
Jul 28 11:31:00.415477 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:00.415430    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q2zsh" podStartSLOduration=4.081949864 podStartE2EDuration="22.415411487s" totalImagesPullingTime="18.333461623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:00.415326741 +0000 UTC m=+23.603927741" watchObservedRunningTime="2026-07-28 11:31:00.415411487 +0000 UTC m=+23.604012485"
Jul 28 11:31:01.265034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:01.265011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:01.265174 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:01.265129    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:01.265242 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:01.265224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:01.265402 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:01.265362    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:01.265494 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:01.265417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:01.265552 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:01.265497    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:01.405290 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:01.405246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"3463ca5736e398e44f389445d88f4f09634bd714eecac818f9af43d7a7920e7e"}
Jul 28 11:31:01.408639 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:01.408609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q" event={"ID":"4614aa7f-d41d-463e-a81e-d059a84a72cd","Type":"ContainerStarted","Data":"54be4e73479981368c7c2d2f2c7af44aad0453ce75572b4bef450bb5ae71580f"}
Jul 28 11:31:03.261932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:03.261704    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:03.262412 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:03.261736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:03.262412 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:03.262023    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:03.262412 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:03.262120    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:03.262412 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:03.261760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:03.262412 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:03.262240    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:04.417202 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.417170    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="f9c20e24380e62155622ea798b6c095da576574f28cc6ccc671f66cb16324807" exitCode=0
Jul 28 11:31:04.420568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.417254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"f9c20e24380e62155622ea798b6c095da576574f28cc6ccc671f66cb16324807"}
Jul 28 11:31:04.424116 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.423886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" event={"ID":"08e3b195-fbd7-49f3-a648-6c2613949d66","Type":"ContainerStarted","Data":"73957c0e68a68e8349c50fef33293e2eecc5a62b20d55b9e2d4b6b373adc16b2"}
Jul 28 11:31:04.424229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.424212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:04.438944 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.438928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:04.447551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:04.447515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhk6q" podStartSLOduration=5.955915135 podStartE2EDuration="26.447502796s" totalImagesPullingTime="20.491587661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:01.428775657 +0000 UTC m=+24.617376653" watchObservedRunningTime="2026-07-28 11:31:04.447502796 +0000 UTC m=+27.636103792"
Jul 28 11:31:05.261305 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.261273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:05.261516 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.261273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:05.261516 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.261404    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:05.261516 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.261278    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:05.261516 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.261494    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:05.261664 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.261601    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:05.426294 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.426269    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 11:31:05.426952 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.426924    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:05.440853 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.440837    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:05.509112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.509074    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" podStartSLOduration=9.06317477 podStartE2EDuration="27.509058865s" totalImagesPullingTime="18.445884095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:04.496465825 +0000 UTC m=+27.685066828" watchObservedRunningTime="2026-07-28 11:31:05.509058865 +0000 UTC m=+28.697659862"
Jul 28 11:31:05.880716 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.880687    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbhww"]
Jul 28 11:31:05.880861 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.880784    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:05.880902 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.880859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:05.893544 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.893521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n48jw"]
Jul 28 11:31:05.893665 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.893602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:05.893711 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.893686    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:05.895977 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.895956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx5cz"]
Jul 28 11:31:05.896073 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:05.896028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:05.896111 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:05.896094    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:06.430399 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:06.430350    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="77744570bd5db60ed340244396df2c16077f3af93121287f1c9a7bd203579e10" exitCode=0
Jul 28 11:31:06.430794 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:06.430416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"77744570bd5db60ed340244396df2c16077f3af93121287f1c9a7bd203579e10"}
Jul 28 11:31:06.430794 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:06.430506    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 11:31:06.765067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:06.765000    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:07.262099 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:07.262067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:07.262250 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:07.262180    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:08.261048 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:08.260824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:08.261540 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:08.260876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:08.261540 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:08.261078    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:08.261540 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:08.261165    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:08.437952 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:08.437917    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="3c6bf16e3957cc54b2e12a519db8950f01d78ef48903e03f8210f958eff141b0" exitCode=0
Jul 28 11:31:08.438144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:08.437998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"3c6bf16e3957cc54b2e12a519db8950f01d78ef48903e03f8210f958eff141b0"}
Jul 28 11:31:08.455238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:08.455202    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk" podUID="08e3b195-fbd7-49f3-a648-6c2613949d66" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 28 11:31:09.260853 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:09.260820    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:09.261032 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:09.260950    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5cz" podUID="d775eae0-8574-4ff3-9b1c-25d7ea631f3b"
Jul 28 11:31:10.260887 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:10.260815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:10.261281 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:10.260824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:10.261281 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:10.260922    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbhww" podUID="212221fa-9df5-464c-84c9-63794ff84767"
Jul 28 11:31:10.261281 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:10.261007    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:31:11.035681 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.035648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:11.035877 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.035705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:11.035877 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.035742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:11.035877 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035837    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035909    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret podName:212221fa-9df5-464c-84c9-63794ff84767 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:43.035891214 +0000 UTC m=+66.224492195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret") pod "global-pull-secret-syncer-bbhww" (UID: "212221fa-9df5-464c-84c9-63794ff84767") : object "kube-system"/"original-pull-secret" not registered
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035840    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035946    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035959    2573 projected.go:196] Error preparing data for projected volume kube-api-access-pcwp4 for pod openshift-network-diagnostics/network-check-target-rx5cz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035838    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:31:11.036044 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.035994    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4 podName:d775eae0-8574-4ff3-9b1c-25d7ea631f3b nodeName:}" failed. No retries permitted until 2026-07-28 11:31:43.035983199 +0000 UTC m=+66.224584189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcwp4" (UniqueName: "kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4") pod "network-check-target-rx5cz" (UID: "d775eae0-8574-4ff3-9b1c-25d7ea631f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 11:31:11.036267 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.036051    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:43.036021755 +0000 UTC m=+66.224622744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 11:31:11.055263 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.055230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:11.191567 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.191540    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeReady"
Jul 28 11:31:11.191754 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.191675    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 11:31:11.261061 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.261029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:11.265364 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.265341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 11:31:11.265491 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.265348    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 11:31:11.265491 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.265427    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tk4rs\""
Jul 28 11:31:11.290295 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.290223    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:31:11.295050 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.295030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.304288 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.304268    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 11:31:11.304423 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.304326    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cxmgd\""
Jul 28 11:31:11.304423 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.304376    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 11:31:11.304581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.304568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 11:31:11.312591 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.312559    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 11:31:11.325208 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.325185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:31:11.350915 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.350879    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5gt9s"]
Jul 28 11:31:11.354252 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.354235    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-25n7w"]
Jul 28 11:31:11.354393 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.354365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.357614 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.357587    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.359853 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.359833    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 11:31:11.365365 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.365331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:11.368945 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.368926    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5ffw\""
Jul 28 11:31:11.372544 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.372525    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 11:31:11.373361 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.373343    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zjgd5\""
Jul 28 11:31:11.373472 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.373407    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 11:31:11.373472 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.373421    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 11:31:11.376997 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.376981    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 11:31:11.389573 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.389550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25n7w"]
Jul 28 11:31:11.394196 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.394177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gt9s"]
Jul 28 11:31:11.438707 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.438825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwfdb\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.438825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-tmp-dir\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.438825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq29m\" (UniqueName: \"kubernetes.io/projected/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-kube-api-access-cq29m\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.438993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-config-volume\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.438993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438895    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.438993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.438993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.439167 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.438994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.439167 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.439089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.439167 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.439126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.439167 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.439152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.512097 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.512058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:11.540027 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.539987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.540173 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.540140    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:11.540173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540408 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540468 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.540145    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:11.540468 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.540465    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:11.540564 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.540196    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:12.040179008 +0000 UTC m=+35.228779996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:11.540564 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:11.540539    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:12.04052238 +0000 UTC m=+35.229123368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:11.540564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwfdb\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-tmp-dir\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdk2p\" (UniqueName: \"kubernetes.io/projected/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-kube-api-access-pdk2p\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq29m\" (UniqueName: \"kubernetes.io/projected/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-kube-api-access-cq29m\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-config-volume\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.540773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.541112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.541112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-cert\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.541112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.540836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.541269 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.541180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.541414 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.541372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-config-volume\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.541590 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.541569    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-tmp-dir\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.541671 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.541586    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.545718 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.545699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.545807 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.545730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.560127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.560105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.562256 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.562235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwfdb\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:11.567825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.567809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq29m\" (UniqueName: \"kubernetes.io/projected/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-kube-api-access-cq29m\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:11.641267 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.641232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-cert\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.641445 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.641344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdk2p\" (UniqueName: \"kubernetes.io/projected/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-kube-api-access-pdk2p\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.644057 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.644033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-cert\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.654698 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.654669    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdk2p\" (UniqueName: \"kubernetes.io/projected/b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e-kube-api-access-pdk2p\") pod \"ingress-canary-25n7w\" (UID: \"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e\") " pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.659650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.659626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:11.671670 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.671648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25n7w"
Jul 28 11:31:11.927693 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:11.927609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:12.044151 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.044115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:12.044340 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.044169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:12.044340 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:12.044290    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:12.044340 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:12.044312    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:12.044340 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:12.044313    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:12.044554 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:12.044397    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:13.04436169 +0000 UTC m=+36.232962667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:12.044554 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:12.044437    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:13.044424981 +0000 UTC m=+36.233025958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:12.129514 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.129472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:12.261530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.261467    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:12.261530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.261492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:12.265714 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.265693    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 11:31:12.266094 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.266080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mvc2\""
Jul 28 11:31:12.266144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.266120    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 11:31:12.415889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.415693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25n7w"]
Jul 28 11:31:12.420234 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:31:12.420215    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c45d7d_8dfa_4c18_a6a6_ccaf46eceb6e.slice/crio-dcab71339cd84ab2f3e4609d73ba7abe482e0863d7f9b5fb51f9df5a5ac6eea0 WatchSource:0}: Error finding container dcab71339cd84ab2f3e4609d73ba7abe482e0863d7f9b5fb51f9df5a5ac6eea0: Status 404 returned error can't find the container with id dcab71339cd84ab2f3e4609d73ba7abe482e0863d7f9b5fb51f9df5a5ac6eea0
Jul 28 11:31:12.451020 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.450990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerStarted","Data":"e2eedb2bbbdd8552b08124f718fdf9425ecc9c0a47f2d0ee04dd6d7c9e1d5564"}
Jul 28 11:31:12.452203 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.452181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25n7w" event={"ID":"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e","Type":"ContainerStarted","Data":"dcab71339cd84ab2f3e4609d73ba7abe482e0863d7f9b5fb51f9df5a5ac6eea0"}
Jul 28 11:31:12.869757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:12.869675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:13.052392 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:13.052344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:13.052548 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:13.052415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:13.052548 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:13.052513    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:13.052548 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:13.052545    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:13.052695 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:13.052597    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:15.05258193 +0000 UTC m=+38.241182906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:13.052695 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:13.052521    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:13.052695 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:13.052671    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:15.052654025 +0000 UTC m=+38.241255003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:13.458786 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:13.458718    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="e2eedb2bbbdd8552b08124f718fdf9425ecc9c0a47f2d0ee04dd6d7c9e1d5564" exitCode=0
Jul 28 11:31:13.458786 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:13.458780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"e2eedb2bbbdd8552b08124f718fdf9425ecc9c0a47f2d0ee04dd6d7c9e1d5564"}
Jul 28 11:31:14.465320 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:14.465282    2573 generic.go:356] "Generic (PLEG): container finished" podID="43df24c6-6e6e-48f5-b00a-25e44f7b866f" containerID="4e79dc4398d0d84bf903b34b00de03fd911adf2b4c88131dedf30b259403d38a" exitCode=0
Jul 28 11:31:14.465778 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:14.465359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerDied","Data":"4e79dc4398d0d84bf903b34b00de03fd911adf2b4c88131dedf30b259403d38a"}
Jul 28 11:31:15.067616 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.067586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:15.067781 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.067629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:15.067781 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:15.067723    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:15.067781 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:15.067733    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:15.067781 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:15.067751    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:15.067781 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:15.067774    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:19.067760009 +0000 UTC m=+42.256360984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:15.067955 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:15.067793    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:19.06778143 +0000 UTC m=+42.256382423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:15.126445 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.126411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:15.258460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.258271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:15.468902 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.468821    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25n7w" event={"ID":"b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e","Type":"ContainerStarted","Data":"38a6d8c727197f8f97a849109d217a2781bf43616cc2cc5a0f9daa50708ded7d"}
Jul 28 11:31:15.472048 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.472024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" event={"ID":"43df24c6-6e6e-48f5-b00a-25e44f7b866f","Type":"ContainerStarted","Data":"6b0257b7b483bb8a14854bcf36d7347cc63c17b72d48cd6fdd87a2769273c485"}
Jul 28 11:31:15.500068 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.500020    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-25n7w" podStartSLOduration=1.7926307860000001 podStartE2EDuration="4.50000614s" totalImagesPullingTime="2.707375354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:15.499097616 +0000 UTC m=+38.687698612" watchObservedRunningTime="2026-07-28 11:31:15.50000614 +0000 UTC m=+38.688607114"
Jul 28 11:31:15.541550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.541500    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vv2gc" podStartSLOduration=9.182256565 podStartE2EDuration="37.541483557s" totalImagesPullingTime="28.359226992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:15.539966141 +0000 UTC m=+38.728567138" watchObservedRunningTime="2026-07-28 11:31:15.541483557 +0000 UTC m=+38.730084556"
Jul 28 11:31:15.810550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.810477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:15.963556 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:15.963521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:16.210438 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:16.210403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:16.389842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:16.389811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:17.664586 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:17.664554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:17.877632 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:17.877595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:19.097154 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:19.097101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:19.097154 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:19.097156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:19.097618 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:19.097282    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:19.097618 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:19.097302    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:19.097618 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:19.097333    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:19.097618 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:19.097362    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:27.097345691 +0000 UTC m=+50.285946667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:19.097618 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:19.097406    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:27.097376667 +0000 UTC m=+50.285977646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:19.445110 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:19.445072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:19.588240 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:19.588174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:22.820422 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:22.820378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:22.923345 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:22.923284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:25.953958 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:25.953910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:26.178155 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:26.178119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:27.156511 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:27.156450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:27.156539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:27.156596    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:27.156616    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:27.156642    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:27.156673    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:31:43.156657832 +0000 UTC m=+66.345258807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:27.156890 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:27.156686    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:31:43.156681001 +0000 UTC m=+66.345281975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:27.617506 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:27.617421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:27.686543 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:27.686509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:36.511484 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:36.511453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:36.606867 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:36.606837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:36.678996 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:36.678966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:38.447734 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:38.447706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn7gk"
Jul 28 11:31:38.638125 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:38.638081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:38.730101 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:38.730028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:43.069911 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.069858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:43.069911 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.069918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:31:43.070404 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.069956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:43.073119 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.073101    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 11:31:43.073505 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.073492    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 11:31:43.073555 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.073519    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 11:31:43.080637 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.080615    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 11:31:43.080747 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.080676    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:32:47.08065997 +0000 UTC m=+130.269260948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : secret "metrics-daemon-secret" not found
Jul 28 11:31:43.083017 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.083000    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 11:31:43.084482 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.084461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/212221fa-9df5-464c-84c9-63794ff84767-original-pull-secret\") pod \"global-pull-secret-syncer-bbhww\" (UID: \"212221fa-9df5-464c-84c9-63794ff84767\") " pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:43.092740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.092718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwp4\" (UniqueName: \"kubernetes.io/projected/d775eae0-8574-4ff3-9b1c-25d7ea631f3b-kube-api-access-pcwp4\") pod \"network-check-target-rx5cz\" (UID: \"d775eae0-8574-4ff3-9b1c-25d7ea631f3b\") " pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:43.170366 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.170335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:31:43.170366 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.170371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:31:43.170556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.170481    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:31:43.170556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.170488    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:31:43.170556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.170504    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:31:43.170556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.170545    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:32:15.170528805 +0000 UTC m=+98.359129785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:31:43.170556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:31:43.170558    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:32:15.170552021 +0000 UTC m=+98.359152995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:31:43.176435 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.176418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbhww"
Jul 28 11:31:43.302623 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.302594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbhww"]
Jul 28 11:31:43.305450 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:31:43.305425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212221fa_9df5_464c_84c9_63794ff84767.slice/crio-3a46f974cb4b524801f12546fe17ede84bf06f4bcf4cbadd302f25b24d5b3783 WatchSource:0}: Error finding container 3a46f974cb4b524801f12546fe17ede84bf06f4bcf4cbadd302f25b24d5b3783: Status 404 returned error can't find the container with id 3a46f974cb4b524801f12546fe17ede84bf06f4bcf4cbadd302f25b24d5b3783
Jul 28 11:31:43.376339 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.376309    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tk4rs\""
Jul 28 11:31:43.383572 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.383550    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:43.499432 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.499369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx5cz"]
Jul 28 11:31:43.502295 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:31:43.502266    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd775eae0_8574_4ff3_9b1c_25d7ea631f3b.slice/crio-d0b250502d8d324e4a500d3daeaef91e9da9cfb2db1b9791ece279a2d976a177 WatchSource:0}: Error finding container d0b250502d8d324e4a500d3daeaef91e9da9cfb2db1b9791ece279a2d976a177: Status 404 returned error can't find the container with id d0b250502d8d324e4a500d3daeaef91e9da9cfb2db1b9791ece279a2d976a177
Jul 28 11:31:43.535218 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.535175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx5cz" event={"ID":"d775eae0-8574-4ff3-9b1c-25d7ea631f3b","Type":"ContainerStarted","Data":"d0b250502d8d324e4a500d3daeaef91e9da9cfb2db1b9791ece279a2d976a177"}
Jul 28 11:31:43.536222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:43.536201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbhww" event={"ID":"212221fa-9df5-464c-84c9-63794ff84767","Type":"ContainerStarted","Data":"3a46f974cb4b524801f12546fe17ede84bf06f4bcf4cbadd302f25b24d5b3783"}
Jul 28 11:31:47.844002 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:47.843958    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:47.911649 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:47.911604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:31:48.551313 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:48.551275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx5cz" event={"ID":"d775eae0-8574-4ff3-9b1c-25d7ea631f3b","Type":"ContainerStarted","Data":"1df5a908bf9f836858fd52978c2e012f2860fe15ad0c5801c22ceaa339ff9db3"}
Jul 28 11:31:48.551615 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:48.551419    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:31:48.552745 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:48.552720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbhww" event={"ID":"212221fa-9df5-464c-84c9-63794ff84767","Type":"ContainerStarted","Data":"8b44db63aaf308e62c30aa88ccfea6f22ec0060c12e9dcfbc7ed112e63cd10f0"}
Jul 28 11:31:48.568739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:48.568699    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rx5cz" podStartSLOduration=67.137269895 podStartE2EDuration="1m11.568686858s" totalImagesPullingTime="4.431416963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:48.568321918 +0000 UTC m=+71.756922934" watchObservedRunningTime="2026-07-28 11:31:48.568686858 +0000 UTC m=+71.757287833"
Jul 28 11:31:48.584519 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:31:48.584479    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bbhww" podStartSLOduration=65.952819812 podStartE2EDuration="1m10.584466662s" totalImagesPullingTime="4.63164685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:31:48.584412181 +0000 UTC m=+71.773013196" watchObservedRunningTime="2026-07-28 11:31:48.584466662 +0000 UTC m=+71.773067641"
Jul 28 11:32:15.196833 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:15.196686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:32:15.196833 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:15.196783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:32:15.197283 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:15.196831    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:32:15.197283 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:15.196880    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:32:15.197283 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:15.196894    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:32:15.197283 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:15.196901    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:33:19.196885026 +0000 UTC m=+162.385486004 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:32:15.197283 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:15.196957    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:33:19.196939018 +0000 UTC m=+162.385539994 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:32:19.557207 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:19.557175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rx5cz"
Jul 28 11:32:28.390010 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:28.389975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:32:28.493785 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:28.493755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:32:47.123981 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:32:47.123943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:32:47.124425 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:47.124079    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 11:32:47.124425 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:32:47.124153    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:34:49.124137521 +0000 UTC m=+252.312738496 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : secret "metrics-daemon-secret" not found
Jul 28 11:33:14.304601 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:14.304548    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271"
Jul 28 11:33:14.365312 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:14.365274    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5gt9s" podUID="a0c8fa60-4714-4402-b58d-bf7e0cf980ec"
Jul 28 11:33:14.751604 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:33:14.751572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:33:14.751787 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:33:14.751572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:33:15.271932 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:15.271891    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:33:19.238655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:33:19.238600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:33:19.238655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:33:19.238653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:33:19.239092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:19.238763    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 11:33:19.239092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:19.238778    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 11:33:19.239092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:19.238798    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69b54dcccd-z875d: secret "image-registry-tls" not found
Jul 28 11:33:19.239092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:19.238815    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls podName:a0c8fa60-4714-4402-b58d-bf7e0cf980ec nodeName:}" failed. No retries permitted until 2026-07-28 11:35:21.238802374 +0000 UTC m=+284.427403349 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls") pod "dns-default-5gt9s" (UID: "a0c8fa60-4714-4402-b58d-bf7e0cf980ec") : secret "dns-default-metrics-tls" not found
Jul 28 11:33:19.239092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:33:19.238850    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls podName:b8e05beb-7a5c-42a8-a0a2-6b33ce969271 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:21.238838305 +0000 UTC m=+284.427439284 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls") pod "image-registry-69b54dcccd-z875d" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271") : secret "image-registry-tls" not found
Jul 28 11:33:30.260930 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:33:30.260828    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:34:20.798801 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:20.798771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:26.753738 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:26.753706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:49.162427 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:49.162361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:34:49.162803 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:49.162514    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 11:34:49.162803 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:49.162580    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs podName:c234aa72-1dc6-4af1-b70a-7f778abf2435 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:51.162562436 +0000 UTC m=+374.351163414 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs") pod "network-metrics-daemon-n48jw" (UID: "c234aa72-1dc6-4af1-b70a-7f778abf2435") : secret "metrics-daemon-secret" not found
Jul 28 11:34:52.931060 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.931024    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"]
Jul 28 11:34:52.932788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.932770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:52.935460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.935438    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 11:34:52.935564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.935443    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 11:34:52.936441 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.936415    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:34:52.936529 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.936445    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5pcrc\""
Jul 28 11:34:52.936529 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.936479    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 11:34:52.940601 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.940582    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-57f6s"]
Jul 28 11:34:52.942495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.942476    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"]
Jul 28 11:34:52.942618 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.942600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:52.944547 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.944530    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6794959d8f-8pwds"]
Jul 28 11:34:52.944663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.944648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:52.946275 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.946254    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5f8lp"]
Jul 28 11:34:52.946499 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.946481    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.948101 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.948078    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"]
Jul 28 11:34:52.948190 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.948155    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.949424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.949406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ts7rk\""
Jul 28 11:34:52.949632 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.949616    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kq2z8\""
Jul 28 11:34:52.950079 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.949924    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 11:34:52.950605 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.950587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 11:34:52.950712 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.950646    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 11:34:52.950712 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.950648    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 11:34:52.952130 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952112    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 11:34:52.952336 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 11:34:52.952608 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952578    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 11:34:52.952705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952617    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:34:52.952851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952833    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 11:34:52.953062 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.952845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 11:34:52.953154 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.953074    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 11:34:52.953215 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.953191    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-57f6s"]
Jul 28 11:34:52.953558 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.953540    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 11:34:52.953651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.953563    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 11:34:52.953651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.953566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fctwn\""
Jul 28 11:34:52.954071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.954055    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 11:34:52.954071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.954064    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 11:34:52.954377 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.954360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fl6p7\""
Jul 28 11:34:52.961701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.961682    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 11:34:52.961975 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.961956    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 11:34:52.962165 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.962150    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 11:34:52.981595 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.981577    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"]
Jul 28 11:34:52.982303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.982290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6794959d8f-8pwds"]
Jul 28 11:34:52.983614 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.983599    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5f8lp"]
Jul 28 11:34:52.987521 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-tmp\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.987568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-snapshots\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.987568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-service-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.987652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.987652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-stats-auth\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.987652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f459f38-81c2-43ef-997f-48407db4bddd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:52.987652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbvb\" (UniqueName: \"kubernetes.io/projected/e11755dd-608c-44e0-82aa-6cebfc824d79-kube-api-access-2sbvb\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:52.987652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-default-certificate\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e11755dd-608c-44e0-82aa-6cebfc824d79-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d56b9553-c0ad-4572-926a-f9ce45d9aa83-serving-cert\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-config\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsts\" (UniqueName: \"kubernetes.io/projected/8f459f38-81c2-43ef-997f-48407db4bddd-kube-api-access-svsts\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:52.987820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f459f38-81c2-43ef-997f-48407db4bddd-config\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxb9k\" (UniqueName: \"kubernetes.io/projected/d56b9553-c0ad-4572-926a-f9ce45d9aa83-kube-api-access-vxb9k\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gskcb\" (UniqueName: \"kubernetes.io/projected/ff4e6854-9326-451e-b4a3-3f836fe513cc-kube-api-access-gskcb\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-serving-cert\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:52.988003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.987989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-trusted-ca\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:52.988209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.988020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfj49\" (UniqueName: \"kubernetes.io/projected/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-kube-api-access-qfj49\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:52.998247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.998221    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 11:34:52.998620 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:52.998603    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 11:34:53.050651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.050624    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"]
Jul 28 11:34:53.052496 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.052478    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"]
Jul 28 11:34:53.052608 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.052592    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.054160 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.054143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"
Jul 28 11:34:53.058642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.058622    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:34:53.058754 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.058646    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 11:34:53.058754 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.058658    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7l6m8\""
Jul 28 11:34:53.059197 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.059181    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 11:34:53.059433 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.059416    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:34:53.059527 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.059503    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5b2vq\""
Jul 28 11:34:53.062458 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.062438    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 11:34:53.074839 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.074816    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"]
Jul 28 11:34:53.075569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.075550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"]
Jul 28 11:34:53.089074 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfj49\" (UniqueName: \"kubernetes.io/projected/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-kube-api-access-qfj49\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.089175 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-tmp\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.089304 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhbd\" (UniqueName: \"kubernetes.io/projected/519df90f-62e8-4274-ba19-47dbdc2285a1-kube-api-access-plhbd\") pod \"volume-data-source-validator-549c6d54cf-sxc2h\" (UID: \"519df90f-62e8-4274-ba19-47dbdc2285a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"
Jul 28 11:34:53.089351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-snapshots\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.089351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-service-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.089447 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.089483 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-tmp\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.089524 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-stats-auth\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.089524 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f459f38-81c2-43ef-997f-48407db4bddd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.089600 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.089527    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:53.589505728 +0000 UTC m=+256.778106704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:34:53.089600 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbvb\" (UniqueName: \"kubernetes.io/projected/e11755dd-608c-44e0-82aa-6cebfc824d79-kube-api-access-2sbvb\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.089706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-default-certificate\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.089706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e11755dd-608c-44e0-82aa-6cebfc824d79-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.089706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d56b9553-c0ad-4572-926a-f9ce45d9aa83-serving-cert\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.089706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-config\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsts\" (UniqueName: \"kubernetes.io/projected/8f459f38-81c2-43ef-997f-48407db4bddd-kube-api-access-svsts\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47nd\" (UniqueName: \"kubernetes.io/projected/0837e0cf-73d1-457c-8a0a-10a29771450f-kube-api-access-q47nd\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f459f38-81c2-43ef-997f-48407db4bddd-config\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.089892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxb9k\" (UniqueName: \"kubernetes.io/projected/d56b9553-c0ad-4572-926a-f9ce45d9aa83-kube-api-access-vxb9k\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-service-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gskcb\" (UniqueName: \"kubernetes.io/projected/ff4e6854-9326-451e-b4a3-3f836fe513cc-kube-api-access-gskcb\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-serving-cert\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.089983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-trusted-ca\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.090195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d56b9553-c0ad-4572-926a-f9ce45d9aa83-snapshots\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.090635 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.090263    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:53.090635 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.090321    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:34:53.590305956 +0000 UTC m=+256.778906950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:53.090635 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.090410    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 11:34:53.090635 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.090452    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:53.59043709 +0000 UTC m=+256.779038070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : secret "router-metrics-certs-default" not found
Jul 28 11:34:53.090910 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e11755dd-608c-44e0-82aa-6cebfc824d79-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.090910 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-config\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.090910 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.090843    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-trusted-ca\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.091061 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.091022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f459f38-81c2-43ef-997f-48407db4bddd-config\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.091210 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.091182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d56b9553-c0ad-4572-926a-f9ce45d9aa83-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.092518 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.092492    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-default-certificate\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.092634 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.092575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-stats-auth\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.093181 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.093161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d56b9553-c0ad-4572-926a-f9ce45d9aa83-serving-cert\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.093256 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.093242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-serving-cert\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.093489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.093473    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f459f38-81c2-43ef-997f-48407db4bddd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.097984 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.097966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfj49\" (UniqueName: \"kubernetes.io/projected/b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5-kube-api-access-qfj49\") pod \"console-operator-584dcb6b54-57f6s\" (UID: \"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.098745 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.098685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsts\" (UniqueName: \"kubernetes.io/projected/8f459f38-81c2-43ef-997f-48407db4bddd-kube-api-access-svsts\") pod \"service-ca-operator-5d6c75f84f-sgg9b\" (UID: \"8f459f38-81c2-43ef-997f-48407db4bddd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.100708 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.100685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxb9k\" (UniqueName: \"kubernetes.io/projected/d56b9553-c0ad-4572-926a-f9ce45d9aa83-kube-api-access-vxb9k\") pod \"insights-operator-5885fdb759-5f8lp\" (UID: \"d56b9553-c0ad-4572-926a-f9ce45d9aa83\") " pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.101331 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.101313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gskcb\" (UniqueName: \"kubernetes.io/projected/ff4e6854-9326-451e-b4a3-3f836fe513cc-kube-api-access-gskcb\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.101434 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.101364    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbvb\" (UniqueName: \"kubernetes.io/projected/e11755dd-608c-44e0-82aa-6cebfc824d79-kube-api-access-2sbvb\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.183058 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.182993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:53.191249 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.191226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.191316 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.191280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhbd\" (UniqueName: \"kubernetes.io/projected/519df90f-62e8-4274-ba19-47dbdc2285a1-kube-api-access-plhbd\") pod \"volume-data-source-validator-549c6d54cf-sxc2h\" (UID: \"519df90f-62e8-4274-ba19-47dbdc2285a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"
Jul 28 11:34:53.191350 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.191332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q47nd\" (UniqueName: \"kubernetes.io/projected/0837e0cf-73d1-457c-8a0a-10a29771450f-kube-api-access-q47nd\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.191405 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.191360    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 11:34:53.191441 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.191435    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls podName:0837e0cf-73d1-457c-8a0a-10a29771450f nodeName:}" failed. No retries permitted until 2026-07-28 11:34:53.691422468 +0000 UTC m=+256.880023443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls") pod "cluster-samples-operator-6748489656-2mdlw" (UID: "0837e0cf-73d1-457c-8a0a-10a29771450f") : secret "samples-operator-tls" not found
Jul 28 11:34:53.201364 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.201339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhbd\" (UniqueName: \"kubernetes.io/projected/519df90f-62e8-4274-ba19-47dbdc2285a1-kube-api-access-plhbd\") pod \"volume-data-source-validator-549c6d54cf-sxc2h\" (UID: \"519df90f-62e8-4274-ba19-47dbdc2285a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"
Jul 28 11:34:53.201469 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.201339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47nd\" (UniqueName: \"kubernetes.io/projected/0837e0cf-73d1-457c-8a0a-10a29771450f-kube-api-access-q47nd\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.241994 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.241955    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"
Jul 28 11:34:53.253792 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.253772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:34:53.271174 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.271150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-5f8lp"
Jul 28 11:34:53.280119 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.280092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:53.366608 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.366578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"
Jul 28 11:34:53.382801 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.382766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b"]
Jul 28 11:34:53.387229 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:34:53.387202    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f459f38_81c2_43ef_997f_48407db4bddd.slice/crio-2fba8653bc328cfc3d04a51679329be0c1fa45a9a1fa51745e1fcde64b12a41a WatchSource:0}: Error finding container 2fba8653bc328cfc3d04a51679329be0c1fa45a9a1fa51745e1fcde64b12a41a: Status 404 returned error can't find the container with id 2fba8653bc328cfc3d04a51679329be0c1fa45a9a1fa51745e1fcde64b12a41a
Jul 28 11:34:53.394306 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.394281    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-57f6s"]
Jul 28 11:34:53.397462 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:34:53.397438    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fcf5f3_38d3_4ea7_822f_53bbdf1d1ed5.slice/crio-53d472ceb4c89ad4ffb518bb3bcb2229d7e0c7c12cb07bdaa3072b0c941f9db2 WatchSource:0}: Error finding container 53d472ceb4c89ad4ffb518bb3bcb2229d7e0c7c12cb07bdaa3072b0c941f9db2: Status 404 returned error can't find the container with id 53d472ceb4c89ad4ffb518bb3bcb2229d7e0c7c12cb07bdaa3072b0c941f9db2
Jul 28 11:34:53.415399 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.415322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5f8lp"]
Jul 28 11:34:53.419445 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:34:53.419416    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56b9553_c0ad_4572_926a_f9ce45d9aa83.slice/crio-3519f5c24d0cdeeffd18c0ab677087e807cf4e367699b00e03980ce8dad7383e WatchSource:0}: Error finding container 3519f5c24d0cdeeffd18c0ab677087e807cf4e367699b00e03980ce8dad7383e: Status 404 returned error can't find the container with id 3519f5c24d0cdeeffd18c0ab677087e807cf4e367699b00e03980ce8dad7383e
Jul 28 11:34:53.492522 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.492466    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h"]
Jul 28 11:34:53.494935 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:34:53.494914    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519df90f_62e8_4274_ba19_47dbdc2285a1.slice/crio-49bf62e66b02201ff7bae38cfc4199185ca2e3ebcaf064c407eac86dd87f9e56 WatchSource:0}: Error finding container 49bf62e66b02201ff7bae38cfc4199185ca2e3ebcaf064c407eac86dd87f9e56: Status 404 returned error can't find the container with id 49bf62e66b02201ff7bae38cfc4199185ca2e3ebcaf064c407eac86dd87f9e56
Jul 28 11:34:53.594994 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.594970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.595107 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.595017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:53.595107 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.595039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:53.595221 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.595124    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:54.595108561 +0000 UTC m=+257.783709536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:34:53.595221 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.595125    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 11:34:53.595221 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.595147    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:53.595221 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.595161    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:54.595154267 +0000 UTC m=+257.783755241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : secret "router-metrics-certs-default" not found
Jul 28 11:34:53.595221 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.595212    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:34:54.59519492 +0000 UTC m=+257.783795897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:53.696039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.696008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:53.696148 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.696111    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 11:34:53.696189 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:53.696157    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls podName:0837e0cf-73d1-457c-8a0a-10a29771450f nodeName:}" failed. No retries permitted until 2026-07-28 11:34:54.69614304 +0000 UTC m=+257.884744017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls") pod "cluster-samples-operator-6748489656-2mdlw" (UID: "0837e0cf-73d1-457c-8a0a-10a29771450f") : secret "samples-operator-tls" not found
Jul 28 11:34:53.981363 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.981324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" event={"ID":"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5","Type":"ContainerStarted","Data":"53d472ceb4c89ad4ffb518bb3bcb2229d7e0c7c12cb07bdaa3072b0c941f9db2"}
Jul 28 11:34:53.982417 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.982373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5f8lp" event={"ID":"d56b9553-c0ad-4572-926a-f9ce45d9aa83","Type":"ContainerStarted","Data":"3519f5c24d0cdeeffd18c0ab677087e807cf4e367699b00e03980ce8dad7383e"}
Jul 28 11:34:53.983367 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.983343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b" event={"ID":"8f459f38-81c2-43ef-997f-48407db4bddd","Type":"ContainerStarted","Data":"2fba8653bc328cfc3d04a51679329be0c1fa45a9a1fa51745e1fcde64b12a41a"}
Jul 28 11:34:53.984344 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:53.984327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h" event={"ID":"519df90f-62e8-4274-ba19-47dbdc2285a1","Type":"ContainerStarted","Data":"49bf62e66b02201ff7bae38cfc4199185ca2e3ebcaf064c407eac86dd87f9e56"}
Jul 28 11:34:54.604558 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:54.604522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:54.604741 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:54.604656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:54.604741 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:54.604713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:54.604901 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.604848    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:54.604972 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.604911    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:34:56.604893097 +0000 UTC m=+259.793494075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:54.605329 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.605312    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 11:34:54.605423 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.605364    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:56.605348797 +0000 UTC m=+259.793949775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : secret "router-metrics-certs-default" not found
Jul 28 11:34:54.605494 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.605445    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:34:56.60543459 +0000 UTC m=+259.794035566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:34:54.705179 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:54.705139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:54.705497 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.705461    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 11:34:54.705585 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:54.705529    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls podName:0837e0cf-73d1-457c-8a0a-10a29771450f nodeName:}" failed. No retries permitted until 2026-07-28 11:34:56.705510184 +0000 UTC m=+259.894111161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls") pod "cluster-samples-operator-6748489656-2mdlw" (UID: "0837e0cf-73d1-457c-8a0a-10a29771450f") : secret "samples-operator-tls" not found
Jul 28 11:34:54.990063 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:54.990019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h" event={"ID":"519df90f-62e8-4274-ba19-47dbdc2285a1","Type":"ContainerStarted","Data":"1c2fc687c2c367c9ea4295a451dd655d7dfee1d9a51d9daec0d6cca8e6bfb4cc"}
Jul 28 11:34:55.008943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:55.008878    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sxc2h" podStartSLOduration=0.734662766 podStartE2EDuration="2.008858355s" totalImagesPullingTime="1.274195589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:34:55.008223043 +0000 UTC m=+258.196824040" watchObservedRunningTime="2026-07-28 11:34:55.008858355 +0000 UTC m=+258.197459351"
Jul 28 11:34:55.104062 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:55.103964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:55.162642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:55.162594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:56.592678 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.592651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:56.622643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.622620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:56.622725 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.622668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:34:56.622725 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.622701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:34:56.622819 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.622766    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:35:00.62274858 +0000 UTC m=+263.811349568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:34:56.622881 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.622818    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 11:34:56.622881 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.622839    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:56.622963 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.622852    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:35:00.622843752 +0000 UTC m=+263.811444727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : secret "router-metrics-certs-default" not found
Jul 28 11:34:56.622963 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.622918    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:00.62289973 +0000 UTC m=+263.811500711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:34:56.688001 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.687980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:56.723127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.723091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:34:56.723288 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.723242    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 11:34:56.723374 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:56.723308    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls podName:0837e0cf-73d1-457c-8a0a-10a29771450f nodeName:}" failed. No retries permitted until 2026-07-28 11:35:00.723289769 +0000 UTC m=+263.911890760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls") pod "cluster-samples-operator-6748489656-2mdlw" (UID: "0837e0cf-73d1-457c-8a0a-10a29771450f") : secret "samples-operator-tls" not found
Jul 28 11:34:56.787054 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.787025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:56.997736 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.997697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5f8lp" event={"ID":"d56b9553-c0ad-4572-926a-f9ce45d9aa83","Type":"ContainerStarted","Data":"b729f766629164a22d2d90f390602b34da8678035d344b068065195c808ae13a"}
Jul 28 11:34:56.999244 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:56.999216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b" event={"ID":"8f459f38-81c2-43ef-997f-48407db4bddd","Type":"ContainerStarted","Data":"490c0b22e87d096aba7c9037ca94343fc019d729e59c4fed42eb1d183bd091c0"}
Jul 28 11:34:57.000718 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.000698    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/0.log"
Jul 28 11:34:57.000822 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.000733    2573 generic.go:356] "Generic (PLEG): container finished" podID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5" containerID="d66239e70fbde817de4a12d9879a9c728725278125fa2f14573f53bf263ccc99" exitCode=255
Jul 28 11:34:57.000822 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.000777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" event={"ID":"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5","Type":"ContainerDied","Data":"d66239e70fbde817de4a12d9879a9c728725278125fa2f14573f53bf263ccc99"}
Jul 28 11:34:57.000980 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.000966    2573 scope.go:117] "RemoveContainer" containerID="d66239e70fbde817de4a12d9879a9c728725278125fa2f14573f53bf263ccc99"
Jul 28 11:34:57.014144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.014104    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-5f8lp" podStartSLOduration=1.8234574970000001 podStartE2EDuration="5.014091523s" totalImagesPullingTime="3.190634026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:34:57.013881707 +0000 UTC m=+260.202482708" watchObservedRunningTime="2026-07-28 11:34:57.014091523 +0000 UTC m=+260.202692550"
Jul 28 11:34:57.034796 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.034566    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b" podStartSLOduration=1.8114501509999998 podStartE2EDuration="5.034547371s" totalImagesPullingTime="3.22309722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:34:57.033400463 +0000 UTC m=+260.222001483" watchObservedRunningTime="2026-07-28 11:34:57.034547371 +0000 UTC m=+260.223148369"
Jul 28 11:34:57.883797 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.883722    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6pcm5"]
Jul 28 11:34:57.886950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.886929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.889349 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.889330    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 11:34:57.889550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.889528    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2vtn\""
Jul 28 11:34:57.890284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.890269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 11:34:57.903628 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.903601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6pcm5"]
Jul 28 11:34:57.924433 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.924406    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:57.934584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.934557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.934697 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.934618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.934697 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.934690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xszg6\" (UniqueName: \"kubernetes.io/projected/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-api-access-xszg6\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.934766 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.934743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49f7bad9-b06e-4fb1-9938-88e3babe32ef-crio-socket\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.934800 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.934784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f7bad9-b06e-4fb1-9938-88e3babe32ef-data-volume\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:57.987435 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:57.987400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.005303    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/1.log"
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.005894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/0.log"
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.005933    2573 generic.go:356] "Generic (PLEG): container finished" podID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff" exitCode=255
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.006757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" event={"ID":"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5","Type":"ContainerDied","Data":"222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"}
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.006855    2573 scope.go:117] "RemoveContainer" containerID="d66239e70fbde817de4a12d9879a9c728725278125fa2f14573f53bf263ccc99"
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.007076    2573 scope.go:117] "RemoveContainer" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"
Jul 28 11:34:58.007830 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.007291    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-57f6s_openshift-console-operator(b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podUID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5"
Jul 28 11:34:58.035212 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xszg6\" (UniqueName: \"kubernetes.io/projected/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-api-access-xszg6\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035311 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49f7bad9-b06e-4fb1-9938-88e3babe32ef-crio-socket\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035378 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035336    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49f7bad9-b06e-4fb1-9938-88e3babe32ef-crio-socket\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035459 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f7bad9-b06e-4fb1-9938-88e3babe32ef-data-volume\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035565 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035666 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.035646    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 11:34:58.035739 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.035719    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:34:58.535699691 +0000 UTC m=+261.724300666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : configmap "kube-rbac-proxy" not found
Jul 28 11:34:58.035826 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.035916 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.035896    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49f7bad9-b06e-4fb1-9938-88e3babe32ef-data-volume\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.036016 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.035925    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:34:58.036016 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.035986    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:34:58.535968487 +0000 UTC m=+261.724569464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:34:58.046289 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.046262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xszg6\" (UniqueName: \"kubernetes.io/projected/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-api-access-xszg6\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.413399 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.413362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:58.513786 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.513755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:58.541045 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.541009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.541173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.541093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:58.541173 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.541116    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 11:34:58.541261 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.541183    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:34:59.541164779 +0000 UTC m=+262.729765764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : configmap "kube-rbac-proxy" not found
Jul 28 11:34:58.541261 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.541222    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:34:58.541346 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:58.541279    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:34:59.541265696 +0000 UTC m=+262.729866670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:34:58.690518 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.690414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:58.791405 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:58.791350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:59.009905 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.009826    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/1.log"
Jul 28 11:34:59.010253 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.010148    2573 scope.go:117] "RemoveContainer" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"
Jul 28 11:34:59.010319 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:59.010298    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-57f6s_openshift-console-operator(b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podUID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5"
Jul 28 11:34:59.081854 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.081781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:59.164359 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.164334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:34:59.551239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.551209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:59.551432 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:34:59.551271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:34:59.551432 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:59.551332    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 11:34:59.551432 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:59.551362    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:34:59.551432 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:59.551417    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:01.551401167 +0000 UTC m=+264.740002146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : configmap "kube-rbac-proxy" not found
Jul 28 11:34:59.551432 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:34:59.551432    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:01.551425612 +0000 UTC m=+264.740026587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:00.318905 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.318875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:00.661056 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.661021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.661076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.661101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.661176    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:35:08.661157448 +0000 UTC m=+271.849758426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.661202    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.661208    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:35:00.661235 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.661239    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:35:08.661229139 +0000 UTC m=+271.849830114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : secret "router-metrics-certs-default" not found
Jul 28 11:35:00.661462 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.661253    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:08.661246006 +0000 UTC m=+271.849846981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:35:00.762169 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.762135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:35:00.762303 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.762269    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 11:35:00.762337 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:00.762327    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls podName:0837e0cf-73d1-457c-8a0a-10a29771450f nodeName:}" failed. No retries permitted until 2026-07-28 11:35:08.762311975 +0000 UTC m=+271.950912963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls") pod "cluster-samples-operator-6748489656-2mdlw" (UID: "0837e0cf-73d1-457c-8a0a-10a29771450f") : secret "samples-operator-tls" not found
Jul 28 11:35:00.863328 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:00.863302    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9vx9_ac18fcef-78da-49a3-82cb-fa297e53794b/dns-node-resolver/0.log"
Jul 28 11:35:01.466523 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:01.466497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs5rx_32a4e0a5-c9f1-4ed8-b32f-43fc47e96164/node-ca/0.log"
Jul 28 11:35:01.568268 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:01.568237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:01.568439 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:01.568294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:01.568439 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:01.568362    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 11:35:01.568575 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:01.568460    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:05.568438363 +0000 UTC m=+268.757039342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : configmap "kube-rbac-proxy" not found
Jul 28 11:35:01.568575 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:01.568468    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:01.568575 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:01.568543    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:05.568527287 +0000 UTC m=+268.757128278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:01.850934 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:01.850854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:02.266173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:02.266137    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-25n7w_b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e/serve-healthcheck-canary/0.log"
Jul 28 11:35:03.254542 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:03.254510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:03.254914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:03.254555    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:03.254914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:03.254828    2573 scope.go:117] "RemoveContainer" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"
Jul 28 11:35:03.254979 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:03.254959    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-57f6s_openshift-console-operator(b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podUID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5"
Jul 28 11:35:04.000910 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.000877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:04.164085 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.164046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:04.262705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.262631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:04.364265 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.364236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:04.551951 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.551849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:04.896828 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:04.896801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:05.103004 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:05.102964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:05.599017 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:05.598984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:05.599474 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:05.599041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:05.599474 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:05.599119    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 11:35:05.599474 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:05.599144    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:05.599474 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:05.599211    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:13.599192861 +0000 UTC m=+276.787793850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:05.599474 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:05.599228    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:13.599219643 +0000 UTC m=+276.787820618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : configmap "kube-rbac-proxy" not found
Jul 28 11:35:06.292783 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:06.292747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:06.487889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:06.487856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:06.694576 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:06.694537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:06.894129 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:06.894099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:07.091282 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:07.091195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:07.884498 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:07.884467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:07.959420 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:07.959370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.062601 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.062570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.302351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.302265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.494710 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.494667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.693568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.693531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.726233 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.726212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:08.726315 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.726258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:35:08.726315 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.726288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:08.726413 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:08.726354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle podName:ff4e6854-9326-451e-b4a3-3f836fe513cc nodeName:}" failed. No retries permitted until 2026-07-28 11:35:24.726338796 +0000 UTC m=+287.914939771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle") pod "router-default-6794959d8f-8pwds" (UID: "ff4e6854-9326-451e-b4a3-3f836fe513cc") : configmap references non-existent config key: service-ca.crt
Jul 28 11:35:08.726413 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:08.726365    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 11:35:08.726499 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:08.726445    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls podName:e11755dd-608c-44e0-82aa-6cebfc824d79 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:24.726427434 +0000 UTC m=+287.915028426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drc29" (UID: "e11755dd-608c-44e0-82aa-6cebfc824d79") : secret "cluster-monitoring-operator-tls" not found
Jul 28 11:35:08.728483 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.728465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4e6854-9326-451e-b4a3-3f836fe513cc-metrics-certs\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:08.826856 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.826831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:35:08.829112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.829089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0837e0cf-73d1-457c-8a0a-10a29771450f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2mdlw\" (UID: \"0837e0cf-73d1-457c-8a0a-10a29771450f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:35:08.900429 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.900405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:08.962489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:08.962439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"
Jul 28 11:35:09.084033 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:09.084003    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw"]
Jul 28 11:35:09.102847 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:09.102817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:09.820397 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:09.820360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:10.049442 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.049402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw" event={"ID":"0837e0cf-73d1-457c-8a0a-10a29771450f","Type":"ContainerStarted","Data":"ecad0ab87d3dd4693a2136f4dca806a0f98583eaa573abbc1b051af7ec708a55"}
Jul 28 11:35:10.117253 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.117175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:10.479075 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.479040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:10.579301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.579269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:10.698022 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.697989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:10.890804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:10.890775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:11.054372 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:11.054343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw" event={"ID":"0837e0cf-73d1-457c-8a0a-10a29771450f","Type":"ContainerStarted","Data":"3fbcd5bfd92eb517912215878976e1ef3ec90c052890a354912804f253998f05"}
Jul 28 11:35:11.054759 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:11.054440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw" event={"ID":"0837e0cf-73d1-457c-8a0a-10a29771450f","Type":"ContainerStarted","Data":"86d3e95862966473751851ef63d4f15368e89302979ef9996cc0854575fde109"}
Jul 28 11:35:11.070979 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:11.070936    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2mdlw" podStartSLOduration=16.318550418 podStartE2EDuration="18.070921838s" totalImagesPullingTime="1.75237142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:11.069222653 +0000 UTC m=+274.257823649" watchObservedRunningTime="2026-07-28 11:35:11.070921838 +0000 UTC m=+274.259522835"
Jul 28 11:35:11.289683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:11.289613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:11.907324 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:11.907292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:12.294239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:12.294169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:12.488817 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:12.488781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:12.901962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:12.901927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:13.668113 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:13.668079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:13.668551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:13.668179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:13.668551 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:13.668220    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:13.668551 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:13.668280    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls podName:49f7bad9-b06e-4fb1-9938-88e3babe32ef nodeName:}" failed. No retries permitted until 2026-07-28 11:35:29.668264833 +0000 UTC m=+292.856865808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6pcm5" (UID: "49f7bad9-b06e-4fb1-9938-88e3babe32ef") : secret "insights-runtime-extractor-tls" not found
Jul 28 11:35:13.668705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:13.668685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49f7bad9-b06e-4fb1-9938-88e3babe32ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:13.697168 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:13.697148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:14.095189 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:14.095105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:14.261492 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:14.261459    2573 scope.go:117] "RemoveContainer" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"
Jul 28 11:35:14.289970 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:14.289937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:14.491157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:14.491113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:14.688768 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:14.688734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:15.068705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.068638    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:35:15.069058 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.069040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/1.log"
Jul 28 11:35:15.069158 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.069076    2573 generic.go:356] "Generic (PLEG): container finished" podID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5" containerID="a266ebb22ea7c019a85ac5f4d8b1450f15584901310f414787131ecc9a2773b8" exitCode=255
Jul 28 11:35:15.069158 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.069125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" event={"ID":"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5","Type":"ContainerDied","Data":"a266ebb22ea7c019a85ac5f4d8b1450f15584901310f414787131ecc9a2773b8"}
Jul 28 11:35:15.069256 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.069182    2573 scope.go:117] "RemoveContainer" containerID="222bceffc6ba501c751869d4bb13a23c397764380a282fbbeb0dc7ed6df423ff"
Jul 28 11:35:15.069561 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:15.069545    2573 scope.go:117] "RemoveContainer" containerID="a266ebb22ea7c019a85ac5f4d8b1450f15584901310f414787131ecc9a2773b8"
Jul 28 11:35:15.069708 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:15.069685    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-57f6s_openshift-console-operator(b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podUID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5"
Jul 28 11:35:16.073083 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:16.073051    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:35:17.752343 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:17.752304    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5gt9s" podUID="a0c8fa60-4714-4402-b58d-bf7e0cf980ec"
Jul 28 11:35:17.752343 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:17.752308    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271"
Jul 28 11:35:18.079027 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:18.078954    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:18.079163 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:18.078958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:19.386874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:19.386843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:19.487625 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:19.487592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:21.326182 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.326146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:21.326182 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.326184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:21.329429 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.329374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0c8fa60-4714-4402-b58d-bf7e0cf980ec-metrics-tls\") pod \"dns-default-5gt9s\" (UID: \"a0c8fa60-4714-4402-b58d-bf7e0cf980ec\") " pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:21.332419 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.332375    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"image-registry-69b54dcccd-z875d\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") " pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:21.383278 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.383256    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cxmgd\""
Jul 28 11:35:21.383407 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.383263    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5ffw\""
Jul 28 11:35:21.390247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.390231    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:21.390329 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.390317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:21.520215 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.520188    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gt9s"]
Jul 28 11:35:21.523101 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:21.523080    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c8fa60_4714_4402_b58d_bf7e0cf980ec.slice/crio-8b561b49930abdf4b55a1b7dfa44335f53895cc2ba34a6e3b9c8d9eeb1d71e71 WatchSource:0}: Error finding container 8b561b49930abdf4b55a1b7dfa44335f53895cc2ba34a6e3b9c8d9eeb1d71e71: Status 404 returned error can't find the container with id 8b561b49930abdf4b55a1b7dfa44335f53895cc2ba34a6e3b9c8d9eeb1d71e71
Jul 28 11:35:21.538055 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:21.538033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:35:21.540417 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:21.540377    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e05beb_7a5c_42a8_a0a2_6b33ce969271.slice/crio-37b10423ab4dea7ac50065935e01a43b0fad650021b27ca79957759fad35155c WatchSource:0}: Error finding container 37b10423ab4dea7ac50065935e01a43b0fad650021b27ca79957759fad35155c: Status 404 returned error can't find the container with id 37b10423ab4dea7ac50065935e01a43b0fad650021b27ca79957759fad35155c
Jul 28 11:35:22.094871 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.094829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" event={"ID":"b8e05beb-7a5c-42a8-a0a2-6b33ce969271","Type":"ContainerStarted","Data":"32181ce715e3da90d9e4dc1a2a40f53025cf5e39c5a9c0dcfa61d223927b1091"}
Jul 28 11:35:22.095053 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.094886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" event={"ID":"b8e05beb-7a5c-42a8-a0a2-6b33ce969271","Type":"ContainerStarted","Data":"37b10423ab4dea7ac50065935e01a43b0fad650021b27ca79957759fad35155c"}
Jul 28 11:35:22.095053 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.094939    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:22.096171 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.096146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gt9s" event={"ID":"a0c8fa60-4714-4402-b58d-bf7e0cf980ec","Type":"ContainerStarted","Data":"8b561b49930abdf4b55a1b7dfa44335f53895cc2ba34a6e3b9c8d9eeb1d71e71"}
Jul 28 11:35:22.560964 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.560914    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" podStartSLOduration=280.56089828 podStartE2EDuration="4m40.56089828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:22.115457509 +0000 UTC m=+285.304058535" watchObservedRunningTime="2026-07-28 11:35:22.56089828 +0000 UTC m=+285.749499313"
Jul 28 11:35:22.561757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.561738    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:35:22.718581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.718543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:22.806531 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:22.806499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:23.101530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:23.101439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gt9s" event={"ID":"a0c8fa60-4714-4402-b58d-bf7e0cf980ec","Type":"ContainerStarted","Data":"2517c0b0a7d7e417f39a4208747f1eeebb191850105ceafddcd6a8980008958a"}
Jul 28 11:35:23.254273 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:23.254194    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:23.254273 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:23.254257    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:23.254552 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:23.254540    2573 scope.go:117] "RemoveContainer" containerID="a266ebb22ea7c019a85ac5f4d8b1450f15584901310f414787131ecc9a2773b8"
Jul 28 11:35:23.254687 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:23.254671    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-57f6s_openshift-console-operator(b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podUID="b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5"
Jul 28 11:35:24.105535 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.105500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gt9s" event={"ID":"a0c8fa60-4714-4402-b58d-bf7e0cf980ec","Type":"ContainerStarted","Data":"bc99d1ff3fc7639d39221e4e5d979bdc9cb22fc308bebcefa56e2d1904d88935"}
Jul 28 11:35:24.106066 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.105707    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:24.150585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.150532    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5gt9s" podStartSLOduration=251.685439398 podStartE2EDuration="4m13.150515006s" totalImagesPullingTime="1.465075608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:24.150051129 +0000 UTC m=+287.338652125" watchObservedRunningTime="2026-07-28 11:35:24.150515006 +0000 UTC m=+287.339116013"
Jul 28 11:35:24.210044 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.210014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:24.286652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.286626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:24.755572 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.755534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:35:24.755740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.755597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:24.756168 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.756136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4e6854-9326-451e-b4a3-3f836fe513cc-service-ca-bundle\") pod \"router-default-6794959d8f-8pwds\" (UID: \"ff4e6854-9326-451e-b4a3-3f836fe513cc\") " pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:24.757890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.757868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e11755dd-608c-44e0-82aa-6cebfc824d79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drc29\" (UID: \"e11755dd-608c-44e0-82aa-6cebfc824d79\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:35:24.760738 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.760717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"
Jul 28 11:35:24.766727 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.766711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:24.926851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.926816    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29"]
Jul 28 11:35:24.930542 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:24.930503    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11755dd_608c_44e0_82aa_6cebfc824d79.slice/crio-45f8b63fa7c1ff6ff2657701738a18b246d40a7e83399a23748d4d0f78dc2fbc WatchSource:0}: Error finding container 45f8b63fa7c1ff6ff2657701738a18b246d40a7e83399a23748d4d0f78dc2fbc: Status 404 returned error can't find the container with id 45f8b63fa7c1ff6ff2657701738a18b246d40a7e83399a23748d4d0f78dc2fbc
Jul 28 11:35:24.949407 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:24.949370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6794959d8f-8pwds"]
Jul 28 11:35:24.952027 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:24.952003    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4e6854_9326_451e_b4a3_3f836fe513cc.slice/crio-4b9e6c72ac2f4111a0601c082bac55101e98f3caa2a07b190b30ffb0adb4b5c6 WatchSource:0}: Error finding container 4b9e6c72ac2f4111a0601c082bac55101e98f3caa2a07b190b30ffb0adb4b5c6: Status 404 returned error can't find the container with id 4b9e6c72ac2f4111a0601c082bac55101e98f3caa2a07b190b30ffb0adb4b5c6
Jul 28 11:35:25.109917 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.109879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6794959d8f-8pwds" event={"ID":"ff4e6854-9326-451e-b4a3-3f836fe513cc","Type":"ContainerStarted","Data":"f2b09243dd5cf3019d716db8095785d535f4a5cd88e5ee73e5d35174517fc719"}
Jul 28 11:35:25.110313 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.109930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6794959d8f-8pwds" event={"ID":"ff4e6854-9326-451e-b4a3-3f836fe513cc","Type":"ContainerStarted","Data":"4b9e6c72ac2f4111a0601c082bac55101e98f3caa2a07b190b30ffb0adb4b5c6"}
Jul 28 11:35:25.111028 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.111001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29" event={"ID":"e11755dd-608c-44e0-82aa-6cebfc824d79","Type":"ContainerStarted","Data":"45f8b63fa7c1ff6ff2657701738a18b246d40a7e83399a23748d4d0f78dc2fbc"}
Jul 28 11:35:25.148197 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.148152    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6794959d8f-8pwds" podStartSLOduration=33.148138631 podStartE2EDuration="33.148138631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:25.148043929 +0000 UTC m=+288.336644927" watchObservedRunningTime="2026-07-28 11:35:25.148138631 +0000 UTC m=+288.336739627"
Jul 28 11:35:25.767917 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.767884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:25.770690 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:25.770666    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:26.114962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:26.114882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:26.116179 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:26.116162    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6794959d8f-8pwds"
Jul 28 11:35:27.636226 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:27.636180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:27.737397 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:27.737358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:27.837334 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:27.837304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:28.124197 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:28.124165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29" event={"ID":"e11755dd-608c-44e0-82aa-6cebfc824d79","Type":"ContainerStarted","Data":"1d85bba1abe4c043e6d471106e520a80737bbd975c5ab895854054052e2a80da"}
Jul 28 11:35:28.147859 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:28.147815    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drc29" podStartSLOduration=33.788161045 podStartE2EDuration="36.147799311s" totalImagesPullingTime="2.359638266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:28.146065784 +0000 UTC m=+291.334666782" watchObservedRunningTime="2026-07-28 11:35:28.147799311 +0000 UTC m=+291.336400333"
Jul 28 11:35:28.166191 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:28.166160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:29.691975 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:29.691936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:29.694266 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:29.694241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49f7bad9-b06e-4fb1-9938-88e3babe32ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6pcm5\" (UID: \"49f7bad9-b06e-4fb1-9938-88e3babe32ef\") " pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:29.696140 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:29.696124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6pcm5"
Jul 28 11:35:29.843275 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:29.843248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6pcm5"]
Jul 28 11:35:29.846196 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:29.846160    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f7bad9_b06e_4fb1_9938_88e3babe32ef.slice/crio-1a88aa8cf4c1888a3e85234e656aa6bb6935923a6b2f0e3bf5ed21fe412365ac WatchSource:0}: Error finding container 1a88aa8cf4c1888a3e85234e656aa6bb6935923a6b2f0e3bf5ed21fe412365ac: Status 404 returned error can't find the container with id 1a88aa8cf4c1888a3e85234e656aa6bb6935923a6b2f0e3bf5ed21fe412365ac
Jul 28 11:35:30.133584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.133552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6pcm5" event={"ID":"49f7bad9-b06e-4fb1-9938-88e3babe32ef","Type":"ContainerStarted","Data":"1a88aa8cf4c1888a3e85234e656aa6bb6935923a6b2f0e3bf5ed21fe412365ac"}
Jul 28 11:35:30.834879 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.834834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:30.882961 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.882929    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vsp64"]
Jul 28 11:35:30.886028 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.886008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:30.889713 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.889568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 11:35:30.889713 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.889581    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5h426\""
Jul 28 11:35:30.889713 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.889585    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 11:35:30.889713 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.889641    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 11:35:30.896159 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.896135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vsp64"]
Jul 28 11:35:30.919095 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:30.919066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:31.003956 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.003926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.004105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.003991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.004105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.004040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxn5t\" (UniqueName: \"kubernetes.io/projected/379bc22e-2534-4d7d-bf2f-07f34701be1c-kube-api-access-sxn5t\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.004105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.004065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/379bc22e-2534-4d7d-bf2f-07f34701be1c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.105020 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.104932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.105166 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.105027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.105166 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.105054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxn5t\" (UniqueName: \"kubernetes.io/projected/379bc22e-2534-4d7d-bf2f-07f34701be1c-kube-api-access-sxn5t\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.105166 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.105082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/379bc22e-2534-4d7d-bf2f-07f34701be1c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.105166 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:31.105104    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 28 11:35:31.105412 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:31.105175    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls podName:379bc22e-2534-4d7d-bf2f-07f34701be1c nodeName:}" failed. No retries permitted until 2026-07-28 11:35:31.605156693 +0000 UTC m=+294.793757674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-vsp64" (UID: "379bc22e-2534-4d7d-bf2f-07f34701be1c") : secret "prometheus-operator-tls" not found
Jul 28 11:35:31.105874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.105850    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/379bc22e-2534-4d7d-bf2f-07f34701be1c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.107749 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.107725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.114267 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.114225    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxn5t\" (UniqueName: \"kubernetes.io/projected/379bc22e-2534-4d7d-bf2f-07f34701be1c-kube-api-access-sxn5t\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.283321 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.283284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:31.609180 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.609141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.612009 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.611980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/379bc22e-2534-4d7d-bf2f-07f34701be1c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vsp64\" (UID: \"379bc22e-2534-4d7d-bf2f-07f34701be1c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.797730 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.797693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64"
Jul 28 11:35:31.940421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:31.940378    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vsp64"]
Jul 28 11:35:31.942921 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:31.942889    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379bc22e_2534_4d7d_bf2f_07f34701be1c.slice/crio-80a3896d8e36f65bf009df80becb3e7a7a9927e31a7c55692373fd614b7bb771 WatchSource:0}: Error finding container 80a3896d8e36f65bf009df80becb3e7a7a9927e31a7c55692373fd614b7bb771: Status 404 returned error can't find the container with id 80a3896d8e36f65bf009df80becb3e7a7a9927e31a7c55692373fd614b7bb771
Jul 28 11:35:32.142840 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:32.142764    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64" event={"ID":"379bc22e-2534-4d7d-bf2f-07f34701be1c","Type":"ContainerStarted","Data":"80a3896d8e36f65bf009df80becb3e7a7a9927e31a7c55692373fd614b7bb771"}
Jul 28 11:35:33.261616 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:35:33.261574    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n48jw" podUID="c234aa72-1dc6-4af1-b70a-7f778abf2435"
Jul 28 11:35:34.113239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:34.113198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5gt9s"
Jul 28 11:35:35.157158 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:35.157125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6pcm5" event={"ID":"49f7bad9-b06e-4fb1-9938-88e3babe32ef","Type":"ContainerStarted","Data":"1addfe0fc07b8f97fcdd66840b3393a7d0e2f13ad25b2bad786cd70e600fee6c"}
Jul 28 11:35:35.159093 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:35.159028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64" event={"ID":"379bc22e-2534-4d7d-bf2f-07f34701be1c","Type":"ContainerStarted","Data":"5112758b89d7e1d785cd7418594487be45ad843dd84a3e3f2c18ed90c6690057"}
Jul 28 11:35:35.351473 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:35.351378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:36.169162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:36.169118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64" event={"ID":"379bc22e-2534-4d7d-bf2f-07f34701be1c","Type":"ContainerStarted","Data":"f4452980c755440c12072500c573417a3363429d347a93936df606982d46e731"}
Jul 28 11:35:36.188249 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:36.188188    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-vsp64" podStartSLOduration=3.068071085 podStartE2EDuration="6.188167911s" totalImagesPullingTime="3.120096826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:36.186762331 +0000 UTC m=+299.375363329" watchObservedRunningTime="2026-07-28 11:35:36.188167911 +0000 UTC m=+299.376768903"
Jul 28 11:35:36.440574 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:36.440498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:37.999911 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:37.999863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.204117 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.204079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.234804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.234775    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"]
Jul 28 11:35:38.241435 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.241412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.247585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.247563    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d5gww\""
Jul 28 11:35:38.248116 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.247861    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 11:35:38.248116 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.247863    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 11:35:38.252424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.252349    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"]
Jul 28 11:35:38.255914 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.255895    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"]
Jul 28 11:35:38.256013 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.255996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.258935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.258916    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 11:35:38.259428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.259407    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9tzmb\""
Jul 28 11:35:38.260406 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.259765    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 11:35:38.264405 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.260608    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 11:35:38.264405 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.261975    2573 scope.go:117] "RemoveContainer" containerID="a266ebb22ea7c019a85ac5f4d8b1450f15584901310f414787131ecc9a2773b8"
Jul 28 11:35:38.267879 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.267856    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"]
Jul 28 11:35:38.286075 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.285900    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lss9j"]
Jul 28 11:35:38.289429 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.289407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.293551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.293491    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gnbvz\""
Jul 28 11:35:38.293683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.293564    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 11:35:38.294442 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.294416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 11:35:38.294554 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.294505    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 11:35:38.325653 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.325616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.359122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.359099    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:35:38.359217 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.359154    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:35:38.369490 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.369473    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 11:35:38.370850 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.370830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c151e9c-2a30-4c90-86c1-04ab97991023-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.371054 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.371133 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq2nn\" (UniqueName: \"kubernetes.io/projected/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-api-access-gq2nn\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.371189 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.371230 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef83e59-87e2-4e28-9038-f4a4ab07767d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.371326 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.371410 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.371475 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mdv\" (UniqueName: \"kubernetes.io/projected/eef83e59-87e2-4e28-9038-f4a4ab07767d-kube-api-access-p7mdv\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.371529 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.371580 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.371535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.421584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.421556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.472267 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef83e59-87e2-4e28-9038-f4a4ab07767d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.472403 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-textfile\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472403 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.472403 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.472568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mdv\" (UniqueName: \"kubernetes.io/projected/eef83e59-87e2-4e28-9038-f4a4ab07767d-kube-api-access-p7mdv\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.472568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-root\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-metrics-client-ca\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dwcr\" (UniqueName: \"kubernetes.io/projected/0a852c30-e878-427a-9638-2a2341f1436d-kube-api-access-5dwcr\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c151e9c-2a30-4c90-86c1-04ab97991023-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-wtmp\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq2nn\" (UniqueName: \"kubernetes.io/projected/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-api-access-gq2nn\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.472954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-tls\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.473301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.472967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-sys\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.473301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.473021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef83e59-87e2-4e28-9038-f4a4ab07767d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.473301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.473201    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c151e9c-2a30-4c90-86c1-04ab97991023-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.474433 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.474411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.474822 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.474800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.475177 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.475126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.476298 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.475876    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 11:35:38.476298 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.476231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.476490 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.476436    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eef83e59-87e2-4e28-9038-f4a4ab07767d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.476490 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.476469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.481447 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.481428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq2nn\" (UniqueName: \"kubernetes.io/projected/0c151e9c-2a30-4c90-86c1-04ab97991023-kube-api-access-gq2nn\") pod \"kube-state-metrics-56d9f944b4-8xvp4\" (UID: \"0c151e9c-2a30-4c90-86c1-04ab97991023\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.481543 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.481441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mdv\" (UniqueName: \"kubernetes.io/projected/eef83e59-87e2-4e28-9038-f4a4ab07767d-kube-api-access-p7mdv\") pod \"openshift-state-metrics-b8f49f5c6-487pb\" (UID: \"eef83e59-87e2-4e28-9038-f4a4ab07767d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.520957 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.520894    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.550894 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.550864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"
Jul 28 11:35:38.570872 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.570850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"
Jul 28 11:35:38.573859 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.573837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-textfile\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.573966 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.573884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-root\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.573966 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.573913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.573966 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.573945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-metrics-client-ca\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.573978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dwcr\" (UniqueName: \"kubernetes.io/projected/0a852c30-e878-427a-9638-2a2341f1436d-kube-api-access-5dwcr\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-wtmp\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-tls\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-sys\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-textfile\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574238 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-sys\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-wtmp\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574850 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a852c30-e878-427a-9638-2a2341f1436d-root\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.574978 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.574958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a852c30-e878-427a-9638-2a2341f1436d-metrics-client-ca\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.576707 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.576685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.576838 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.576817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a852c30-e878-427a-9638-2a2341f1436d-node-exporter-tls\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.582787 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.582764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dwcr\" (UniqueName: \"kubernetes.io/projected/0a852c30-e878-427a-9638-2a2341f1436d-kube-api-access-5dwcr\") pod \"node-exporter-lss9j\" (UID: \"0a852c30-e878-427a-9638-2a2341f1436d\") " pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.600653 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.600611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lss9j"
Jul 28 11:35:38.615102 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:38.615065    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a852c30_e878_427a_9638_2a2341f1436d.slice/crio-8affdfc527932062018ae08db8e030cb1d39d96bc4fbc7b104470d43b98786fc WatchSource:0}: Error finding container 8affdfc527932062018ae08db8e030cb1d39d96bc4fbc7b104470d43b98786fc: Status 404 returned error can't find the container with id 8affdfc527932062018ae08db8e030cb1d39d96bc4fbc7b104470d43b98786fc
Jul 28 11:35:38.622270 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.622036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:38.692862 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.692841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb"]
Jul 28 11:35:38.694979 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:38.694948    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef83e59_87e2_4e28_9038_f4a4ab07767d.slice/crio-ce24e3d4d4f19fac46a607775506141bac3aff5a2337c5f4792df089a407fa83 WatchSource:0}: Error finding container ce24e3d4d4f19fac46a607775506141bac3aff5a2337c5f4792df089a407fa83: Status 404 returned error can't find the container with id ce24e3d4d4f19fac46a607775506141bac3aff5a2337c5f4792df089a407fa83
Jul 28 11:35:38.717655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:38.717631    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4"]
Jul 28 11:35:38.723494 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:38.723469    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c151e9c_2a30_4c90_86c1_04ab97991023.slice/crio-725c34208b22c66a9fa1dc1caee69f89e437ff40ab58e0f1b10c72c0e87bb88e WatchSource:0}: Error finding container 725c34208b22c66a9fa1dc1caee69f89e437ff40ab58e0f1b10c72c0e87bb88e: Status 404 returned error can't find the container with id 725c34208b22c66a9fa1dc1caee69f89e437ff40ab58e0f1b10c72c0e87bb88e
Jul 28 11:35:39.171711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.171675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.183668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.183639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:35:39.183821 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.183766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" event={"ID":"b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5","Type":"ContainerStarted","Data":"c48699915b1e4da601ca8a8bfc669d263efdbaa78bced11875d3388c29f57fe2"}
Jul 28 11:35:39.184929 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.184068    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:39.187067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.186798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6pcm5" event={"ID":"49f7bad9-b06e-4fb1-9938-88e3babe32ef","Type":"ContainerStarted","Data":"2673a0bdc66bac49cc7eb7a7a1c8f7252273bf72abb77d29e88ee50223476a82"}
Jul 28 11:35:39.189204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.189179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lss9j" event={"ID":"0a852c30-e878-427a-9638-2a2341f1436d","Type":"ContainerStarted","Data":"8affdfc527932062018ae08db8e030cb1d39d96bc4fbc7b104470d43b98786fc"}
Jul 28 11:35:39.191105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.190994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4" event={"ID":"0c151e9c-2a30-4c90-86c1-04ab97991023","Type":"ContainerStarted","Data":"725c34208b22c66a9fa1dc1caee69f89e437ff40ab58e0f1b10c72c0e87bb88e"}
Jul 28 11:35:39.194652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.194615    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s"
Jul 28 11:35:39.194739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.194656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb" event={"ID":"eef83e59-87e2-4e28-9038-f4a4ab07767d","Type":"ContainerStarted","Data":"ec702c786249ad81150c715bce445547fb25555abcd4e2bce4f97fe4613a0074"}
Jul 28 11:35:39.194739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.194691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb" event={"ID":"eef83e59-87e2-4e28-9038-f4a4ab07767d","Type":"ContainerStarted","Data":"870963fe1e0ff9b37218cb8508ab47fca5694a335da980bd96b44e59b8f3f5a7"}
Jul 28 11:35:39.194739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.194718    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb" event={"ID":"eef83e59-87e2-4e28-9038-f4a4ab07767d","Type":"ContainerStarted","Data":"ce24e3d4d4f19fac46a607775506141bac3aff5a2337c5f4792df089a407fa83"}
Jul 28 11:35:39.205493 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.205320    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-57f6s" podStartSLOduration=43.998193065 podStartE2EDuration="47.205301083s" totalImagesPullingTime="3.207108018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:39.203072834 +0000 UTC m=+302.391673924" watchObservedRunningTime="2026-07-28 11:35:39.205301083 +0000 UTC m=+302.393902082"
Jul 28 11:35:39.270584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.270550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.366211 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.366176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.399527 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.399241    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-prhh2"]
Jul 28 11:35:39.414208 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.414181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:35:39.417470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.417444    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 11:35:39.419400 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.417739    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g42k7\""
Jul 28 11:35:39.419400 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.417938    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 11:35:39.419400 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.418629    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-prhh2"]
Jul 28 11:35:39.443090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.443061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.484182 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.484126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddkxr\" (UniqueName: \"kubernetes.io/projected/c714a46e-2233-4287-acbe-c73bc7fbf23a-kube-api-access-ddkxr\") pod \"downloads-7c97dc4555-prhh2\" (UID: \"c714a46e-2233-4287-acbe-c73bc7fbf23a\") " pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:35:39.509216 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.509133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.585689 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.585654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddkxr\" (UniqueName: \"kubernetes.io/projected/c714a46e-2233-4287-acbe-c73bc7fbf23a-kube-api-access-ddkxr\") pod \"downloads-7c97dc4555-prhh2\" (UID: \"c714a46e-2233-4287-acbe-c73bc7fbf23a\") " pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:35:39.596800 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.596748    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddkxr\" (UniqueName: \"kubernetes.io/projected/c714a46e-2233-4287-acbe-c73bc7fbf23a-kube-api-access-ddkxr\") pod \"downloads-7c97dc4555-prhh2\" (UID: \"c714a46e-2233-4287-acbe-c73bc7fbf23a\") " pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:35:39.703087 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.697003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.733524 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.733300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:35:39.862961 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.862917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:39.957516 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:39.957412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-prhh2"]
Jul 28 11:35:40.070668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.070394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.143164 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.143129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.203357 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.203246    2573 generic.go:356] "Generic (PLEG): container finished" podID="0a852c30-e878-427a-9638-2a2341f1436d" containerID="c4ffb2eee263406bca84da77c8bed55f8b99fd4e0f2c9058ddafaca7e517ff1e" exitCode=0
Jul 28 11:35:40.203928 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.203358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lss9j" event={"ID":"0a852c30-e878-427a-9638-2a2341f1436d","Type":"ContainerDied","Data":"c4ffb2eee263406bca84da77c8bed55f8b99fd4e0f2c9058ddafaca7e517ff1e"}
Jul 28 11:35:40.454185 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.454148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.540647 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:35:40.540609    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc714a46e_2233_4287_acbe_c73bc7fbf23a.slice/crio-fb720808a9dcc40b0c203f4a24faa2cc4f3a292e6f6dd99d8d14f466174f3251 WatchSource:0}: Error finding container fb720808a9dcc40b0c203f4a24faa2cc4f3a292e6f6dd99d8d14f466174f3251: Status 404 returned error can't find the container with id fb720808a9dcc40b0c203f4a24faa2cc4f3a292e6f6dd99d8d14f466174f3251
Jul 28 11:35:40.554481 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.554450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.693438 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.693356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.794314 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.794180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:40.894692 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:40.894661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.099682 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.099558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.210398 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.210334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.211772 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.211734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4" event={"ID":"0c151e9c-2a30-4c90-86c1-04ab97991023","Type":"ContainerStarted","Data":"0a3b4c7b4cc6a0676a5c109ade50a5f0a02d58fbb3b08c623ad660fd93227289"}
Jul 28 11:35:41.211904 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.211815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4" event={"ID":"0c151e9c-2a30-4c90-86c1-04ab97991023","Type":"ContainerStarted","Data":"6cb3eab0e35bb968139747890ad7e3d66c80eaacb44d06ef94134f26c0188f70"}
Jul 28 11:35:41.211904 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.211848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4" event={"ID":"0c151e9c-2a30-4c90-86c1-04ab97991023","Type":"ContainerStarted","Data":"4318d8ac4da2a33766f35c128876304f02cf25a5d9a7e0c39afa231cd111a5bd"}
Jul 28 11:35:41.213211 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.213187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-prhh2" event={"ID":"c714a46e-2233-4287-acbe-c73bc7fbf23a","Type":"ContainerStarted","Data":"fb720808a9dcc40b0c203f4a24faa2cc4f3a292e6f6dd99d8d14f466174f3251"}
Jul 28 11:35:41.216222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.216164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb" event={"ID":"eef83e59-87e2-4e28-9038-f4a4ab07767d","Type":"ContainerStarted","Data":"af618848359192ef682d464e707eef507f1daf93b3d389e434cab394645346ba"}
Jul 28 11:35:41.218768 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.218742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lss9j" event={"ID":"0a852c30-e878-427a-9638-2a2341f1436d","Type":"ContainerStarted","Data":"0c1128da73d214d8a394405ce7ffae03664a8421f29376d53b2c5803f302ba58"}
Jul 28 11:35:41.218869 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.218787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lss9j" event={"ID":"0a852c30-e878-427a-9638-2a2341f1436d","Type":"ContainerStarted","Data":"c508b2ccc6598457176f250525c352ee905785552358c6f092e80285f8ab72d9"}
Jul 28 11:35:41.230404 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.230336    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8xvp4" podStartSLOduration=1.3560823850000001 podStartE2EDuration="3.230324277s" totalImagesPullingTime="1.874241892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:41.22964924 +0000 UTC m=+304.418250254" watchObservedRunningTime="2026-07-28 11:35:41.230324277 +0000 UTC m=+304.418925274"
Jul 28 11:35:41.251020 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.250971    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-487pb" podStartSLOduration=1.455544479 podStartE2EDuration="3.250952662s" totalImagesPullingTime="1.795408183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:41.249210511 +0000 UTC m=+304.437811526" watchObservedRunningTime="2026-07-28 11:35:41.250952662 +0000 UTC m=+304.439553661"
Jul 28 11:35:41.278497 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.278396    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lss9j" podStartSLOduration=2.011837402 podStartE2EDuration="3.27836236s" totalImagesPullingTime="1.174529452s" totalInitContainerRuntime="91.995506ms" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:41.276650805 +0000 UTC m=+304.465251829" watchObservedRunningTime="2026-07-28 11:35:41.27836236 +0000 UTC m=+304.466963359"
Jul 28 11:35:41.299049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.299001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.368754 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.368642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.452126 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.452083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.551522 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.551487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:41.773235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:41.773202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:42.703821 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:42.703784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:42.802441 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:42.802412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.009856 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.009787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.100801 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.100760    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.211619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.211583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.230723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.230692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6pcm5" event={"ID":"49f7bad9-b06e-4fb1-9938-88e3babe32ef","Type":"ContainerStarted","Data":"27754cfb87fbfa0742b3da36b600c4af85a88b9885bfd2bfa5eb2016c6ee8752"}
Jul 28 11:35:43.250107 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.250049    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6pcm5" podStartSLOduration=33.403235998 podStartE2EDuration="46.250028349s" totalImagesPullingTime="12.846792351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:34:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:43.248799421 +0000 UTC m=+306.437400419" watchObservedRunningTime="2026-07-28 11:35:43.250028349 +0000 UTC m=+306.438629346"
Jul 28 11:35:43.353132 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.353049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.418795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.418766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:43.519351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:43.519312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:44.112014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:44.111988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:44.529003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:44.528656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:44.600258 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:44.600224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:46.261494 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:46.261461    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:35:49.123515 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.123465    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" containerName="registry" containerID="cri-o://32181ce715e3da90d9e4dc1a2a40f53025cf5e39c5a9c0dcfa61d223927b1091" gracePeriod=30
Jul 28 11:35:49.258300 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.258263    2573 generic.go:356] "Generic (PLEG): container finished" podID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" containerID="32181ce715e3da90d9e4dc1a2a40f53025cf5e39c5a9c0dcfa61d223927b1091" exitCode=0
Jul 28 11:35:49.258455 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.258339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" event={"ID":"b8e05beb-7a5c-42a8-a0a2-6b33ce969271","Type":"ContainerDied","Data":"32181ce715e3da90d9e4dc1a2a40f53025cf5e39c5a9c0dcfa61d223927b1091"}
Jul 28 11:35:49.396866 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.396840    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:49.486374 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486342    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486374 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486394    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwfdb\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486512    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486552    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486577    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.486642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.486604    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted\") pod \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\" (UID: \"b8e05beb-7a5c-42a8-a0a2-6b33ce969271\") "
Jul 28 11:35:49.487280 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.487221    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:35:49.488983 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.487327    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:35:49.490228 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.490186    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:35:49.490510 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.490447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:35:49.490717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.490684    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:35:49.490717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.490705    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb" (OuterVolumeSpecName: "kube-api-access-jwfdb") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "kube-api-access-jwfdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:35:49.491698 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.491669    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:35:49.501492 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.501463    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b8e05beb-7a5c-42a8-a0a2-6b33ce969271" (UID: "b8e05beb-7a5c-42a8-a0a2-6b33ce969271"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:35:49.588222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588186    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-bound-sa-token\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588217    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588226    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwfdb\" (UniqueName: \"kubernetes.io/projected/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-kube-api-access-jwfdb\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588237    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-image-registry-private-configuration\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588246    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-trusted-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588255    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-installation-pull-secrets\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588266    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-registry-certificates\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:49.588536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:49.588279    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e05beb-7a5c-42a8-a0a2-6b33ce969271-ca-trust-extracted\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:35:50.266788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:50.266746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b54dcccd-z875d" event={"ID":"b8e05beb-7a5c-42a8-a0a2-6b33ce969271","Type":"ContainerDied","Data":"37b10423ab4dea7ac50065935e01a43b0fad650021b27ca79957759fad35155c"}
Jul 28 11:35:50.267209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:50.266806    2573 scope.go:117] "RemoveContainer" containerID="32181ce715e3da90d9e4dc1a2a40f53025cf5e39c5a9c0dcfa61d223927b1091"
Jul 28 11:35:50.267209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:50.266763    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b54dcccd-z875d"
Jul 28 11:35:50.297973 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:50.297942    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:35:50.299187 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:50.299164    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69b54dcccd-z875d"]
Jul 28 11:35:51.266638 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:51.266601    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" path="/var/lib/kubelet/pods/b8e05beb-7a5c-42a8-a0a2-6b33ce969271/volumes"
Jul 28 11:35:54.289028 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:54.288994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:54.382096 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:54.382061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:55.291820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.291791    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:35:55.292284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.292070    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" containerName="registry"
Jul 28 11:35:55.292284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.292081    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" containerName="registry"
Jul 28 11:35:55.292284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.292164    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e05beb-7a5c-42a8-a0a2-6b33ce969271" containerName="registry"
Jul 28 11:35:55.296836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.296812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.300675 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.300629    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 11:35:55.300675 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.300631    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 11:35:55.300925 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.300700    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dzxgt\""
Jul 28 11:35:55.300925 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.300632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 11:35:55.301248 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.301229    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 11:35:55.301417 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.301396    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 11:35:55.311527 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.309075    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:35:55.311527 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.310701    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 11:35:55.443954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.443916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.443964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.444032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.444060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.444084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444307 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.444126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqzhr\" (UniqueName: \"kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.444307 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.444192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545298 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545298 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqzhr\" (UniqueName: \"kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.545569 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.545476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.546342 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.546309    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.546492 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.546415    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.546492 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.546470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.546615 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.546470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.548090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.548068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.548353 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.548333    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.553843 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.553818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqzhr\" (UniqueName: \"kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr\") pod \"console-95bcd965d-z5vbl\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") " pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:55.607893 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:55.607862    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:35:56.108650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:56.108611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:56.208528 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:56.208496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:56.308785 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:56.308748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:58.650369 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:58.650336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:35:58.746229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:35:58.746198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:00.120574 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:00.120540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:00.219308 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:00.219270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:00.420629 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:00.420600    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:36:00.505577 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:36:00.505544    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea4ced9_5821_4781_b460_a6fa56258ede.slice/crio-cb537f3459bedf35988971f69f02ee15f8054ed4fff41ffa048db2aa56f7af85 WatchSource:0}: Error finding container cb537f3459bedf35988971f69f02ee15f8054ed4fff41ffa048db2aa56f7af85: Status 404 returned error can't find the container with id cb537f3459bedf35988971f69f02ee15f8054ed4fff41ffa048db2aa56f7af85
Jul 28 11:36:01.315335 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:01.315291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-prhh2" event={"ID":"c714a46e-2233-4287-acbe-c73bc7fbf23a","Type":"ContainerStarted","Data":"cce3c9bd232529d178f6827d3cf42bd897483196d4edccf82135dec34eceb328"}
Jul 28 11:36:01.316088 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:01.315737    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:36:01.318220 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:01.318141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95bcd965d-z5vbl" event={"ID":"1ea4ced9-5821-4781-b460-a6fa56258ede","Type":"ContainerStarted","Data":"cb537f3459bedf35988971f69f02ee15f8054ed4fff41ffa048db2aa56f7af85"}
Jul 28 11:36:01.326886 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:01.326863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-prhh2"
Jul 28 11:36:01.338728 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:01.338458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-prhh2" podStartSLOduration=2.366541979 podStartE2EDuration="22.338440008s" totalImagesPullingTime="19.971898029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:01.336562525 +0000 UTC m=+324.525163543" watchObservedRunningTime="2026-07-28 11:36:01.338440008 +0000 UTC m=+324.527041006"
Jul 28 11:36:02.326818 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:02.326711    2573 generic.go:356] "Generic (PLEG): container finished" podID="d56b9553-c0ad-4572-926a-f9ce45d9aa83" containerID="b729f766629164a22d2d90f390602b34da8678035d344b068065195c808ae13a" exitCode=0
Jul 28 11:36:02.326818 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:02.326782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5f8lp" event={"ID":"d56b9553-c0ad-4572-926a-f9ce45d9aa83","Type":"ContainerDied","Data":"b729f766629164a22d2d90f390602b34da8678035d344b068065195c808ae13a"}
Jul 28 11:36:02.327677 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:02.327633    2573 scope.go:117] "RemoveContainer" containerID="b729f766629164a22d2d90f390602b34da8678035d344b068065195c808ae13a"
Jul 28 11:36:03.233671 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.233553    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-2mdlw_0837e0cf-73d1-457c-8a0a-10a29771450f/cluster-samples-operator/0.log"
Jul 28 11:36:03.241462 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.241366    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-2mdlw_0837e0cf-73d1-457c-8a0a-10a29771450f/cluster-samples-operator-watch/0.log"
Jul 28 11:36:03.335217 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.335172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5f8lp" event={"ID":"d56b9553-c0ad-4572-926a-f9ce45d9aa83","Type":"ContainerStarted","Data":"473cdb18ae4b8652ec6171037b77c5889d3b0ef50269c2f96c55cf725d1b18ce"}
Jul 28 11:36:03.395403 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.395314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:03.458539 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.458468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:03.922314 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:03.922256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:04.020556 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:04.020529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:04.388770 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:04.388736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:04.490150 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:04.490111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:05.347326 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:05.347292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95bcd965d-z5vbl" event={"ID":"1ea4ced9-5821-4781-b460-a6fa56258ede","Type":"ContainerStarted","Data":"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"}
Jul 28 11:36:05.383271 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:05.383219    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-95bcd965d-z5vbl" podStartSLOduration=6.382996522 podStartE2EDuration="10.383202244s" totalImagesPullingTime="4.000205722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:05.382610743 +0000 UTC m=+328.571211741" watchObservedRunningTime="2026-07-28 11:36:05.383202244 +0000 UTC m=+328.571803241"
Jul 28 11:36:05.608495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:05.608411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:36:05.608495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:05.608476    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:36:05.614267 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:05.614241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:36:06.355662 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:06.355623    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:36:08.362248 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:08.362213    2573 generic.go:356] "Generic (PLEG): container finished" podID="8f459f38-81c2-43ef-997f-48407db4bddd" containerID="490c0b22e87d096aba7c9037ca94343fc019d729e59c4fed42eb1d183bd091c0" exitCode=0
Jul 28 11:36:08.362763 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:08.362294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b" event={"ID":"8f459f38-81c2-43ef-997f-48407db4bddd","Type":"ContainerDied","Data":"490c0b22e87d096aba7c9037ca94343fc019d729e59c4fed42eb1d183bd091c0"}
Jul 28 11:36:08.362847 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:08.362826    2573 scope.go:117] "RemoveContainer" containerID="490c0b22e87d096aba7c9037ca94343fc019d729e59c4fed42eb1d183bd091c0"
Jul 28 11:36:09.369629 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:09.369591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-sgg9b" event={"ID":"8f459f38-81c2-43ef-997f-48407db4bddd","Type":"ContainerStarted","Data":"54b1ffa82fc134c14b97a1963ad3a1357b581834d1c9c0b8848e39a3e3ebf3a8"}
Jul 28 11:36:19.402885 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:19.402841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:19.469869 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:19.469831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:51.218229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.218194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:36:51.220551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.220524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c234aa72-1dc6-4af1-b70a-7f778abf2435-metrics-certs\") pod \"network-metrics-daemon-n48jw\" (UID: \"c234aa72-1dc6-4af1-b70a-7f778abf2435\") " pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:36:51.364853 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.364822    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mvc2\""
Jul 28 11:36:51.372700 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.372683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n48jw"
Jul 28 11:36:51.508303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.508197    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n48jw"]
Jul 28 11:36:51.510862 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:36:51.510838    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc234aa72_1dc6_4af1_b70a_7f778abf2435.slice/crio-8c4add2c013c141966501d4a15d1a5ebde7d9bb761c90e89b421835b353d1b2c WatchSource:0}: Error finding container 8c4add2c013c141966501d4a15d1a5ebde7d9bb761c90e89b421835b353d1b2c: Status 404 returned error can't find the container with id 8c4add2c013c141966501d4a15d1a5ebde7d9bb761c90e89b421835b353d1b2c
Jul 28 11:36:51.530444 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.530418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n48jw" event={"ID":"c234aa72-1dc6-4af1-b70a-7f778abf2435","Type":"ContainerStarted","Data":"8c4add2c013c141966501d4a15d1a5ebde7d9bb761c90e89b421835b353d1b2c"}
Jul 28 11:36:51.552773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.552748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:51.624290 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:51.624265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:53.540650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:53.540616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n48jw" event={"ID":"c234aa72-1dc6-4af1-b70a-7f778abf2435","Type":"ContainerStarted","Data":"a9986a052e5497b0f009a1d43473e7173ef558d34d05ce215e5b443e8cd4a64e"}
Jul 28 11:36:53.541028 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:53.540666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n48jw" event={"ID":"c234aa72-1dc6-4af1-b70a-7f778abf2435","Type":"ContainerStarted","Data":"1d2b57a7e024002fdd260eff2420201e17ccda2389756daecf57273958879b10"}
Jul 28 11:36:53.557663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:53.557607    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n48jw" podStartSLOduration=374.620328009 podStartE2EDuration="6m15.557591264s" totalImagesPullingTime="937.263255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:53.556347279 +0000 UTC m=+376.744948278" watchObservedRunningTime="2026-07-28 11:36:53.557591264 +0000 UTC m=+376.746192252"
Jul 28 11:36:53.656058 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:53.656028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:53.775284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:53.775252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:57.562190 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:57.562156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:36:57.680664 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:36:57.680627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:03.937856 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:03.937820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:04.037984 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:04.037952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:06.356783 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:06.356728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:06.443892 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:06.443851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:06.546655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:06.546626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:07.053776 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:07.053742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:07.116602 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:07.116574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:07.746214 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:07.746183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:17.621504 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:17.621470    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:37:17.740932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:17.740896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:17.845001 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:17.844970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:17.913503 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:17.913425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:33.406893 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:33.406851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:33.466262 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:33.466227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:37:42.641566 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:42.641501    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-95bcd965d-z5vbl" podUID="1ea4ced9-5821-4781-b460-a6fa56258ede" containerName="console" containerID="cri-o://5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec" gracePeriod=15
Jul 28 11:37:42.887038 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:42.887014    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:37:43.008121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008086    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008120    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqzhr\" (UniqueName: \"kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008157    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008175    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008418 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca\") pod \"1ea4ced9-5821-4781-b460-a6fa56258ede\" (UID: \"1ea4ced9-5821-4781-b460-a6fa56258ede\") "
Jul 28 11:37:43.008619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008529    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config" (OuterVolumeSpecName: "console-config") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:37:43.008619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008609    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:37:43.008732 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008618    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-console-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.008732 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008639    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:37:43.008922 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.008892    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:37:43.010526 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.010503    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:37:43.010622 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.010569    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:37:43.010622 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.010580    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr" (OuterVolumeSpecName: "kube-api-access-wqzhr") pod "1ea4ced9-5821-4781-b460-a6fa56258ede" (UID: "1ea4ced9-5821-4781-b460-a6fa56258ede"). InnerVolumeSpecName "kube-api-access-wqzhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:37:43.109202 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109169    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-trusted-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.109202 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109198    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqzhr\" (UniqueName: \"kubernetes.io/projected/1ea4ced9-5821-4781-b460-a6fa56258ede-kube-api-access-wqzhr\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.109202 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109208    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-oauth-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.109452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109216    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-oauth-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.109452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109231    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ea4ced9-5821-4781-b460-a6fa56258ede-console-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.109452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.109240    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea4ced9-5821-4781-b460-a6fa56258ede-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:37:43.724362 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.724325    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ea4ced9-5821-4781-b460-a6fa56258ede" containerID="5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec" exitCode=0
Jul 28 11:37:43.724813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.724370    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95bcd965d-z5vbl"
Jul 28 11:37:43.724813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.724407    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95bcd965d-z5vbl" event={"ID":"1ea4ced9-5821-4781-b460-a6fa56258ede","Type":"ContainerDied","Data":"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"}
Jul 28 11:37:43.724813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.724457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95bcd965d-z5vbl" event={"ID":"1ea4ced9-5821-4781-b460-a6fa56258ede","Type":"ContainerDied","Data":"cb537f3459bedf35988971f69f02ee15f8054ed4fff41ffa048db2aa56f7af85"}
Jul 28 11:37:43.724813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.724477    2573 scope.go:117] "RemoveContainer" containerID="5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"
Jul 28 11:37:43.732471 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.732455    2573 scope.go:117] "RemoveContainer" containerID="5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"
Jul 28 11:37:43.732738 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:37:43.732715    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec\": container with ID starting with 5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec not found: ID does not exist" containerID="5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"
Jul 28 11:37:43.732796 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.732746    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec"} err="failed to get container status \"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec\": rpc error: code = NotFound desc = could not find container \"5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec\": container with ID starting with 5b98d344f6508f148f65c6007faedbcc6df2e777edc395bff08883fc110958ec not found: ID does not exist"
Jul 28 11:37:43.740785 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.740762    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:37:43.744182 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:43.744161    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95bcd965d-z5vbl"]
Jul 28 11:37:45.266718 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:45.266678    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea4ced9-5821-4781-b460-a6fa56258ede" path="/var/lib/kubelet/pods/1ea4ced9-5821-4781-b460-a6fa56258ede/volumes"
Jul 28 11:37:58.569809 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:37:58.569769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:12.857040 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:12.856957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:12.956643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:12.956610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:16.370236 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:16.370193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:16.438097 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:16.438063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:24.871201 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:24.871171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:24.972924 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:24.972895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:27.007314 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:27.007279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:27.062671 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:27.062643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:27.117898 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:27.117862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:34.394554 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:34.394521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:38:34.495771 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:38:34.495737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:39:46.840866 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:46.840832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:39:46.940742 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:46.940708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:39:47.647499 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.647461    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"]
Jul 28 11:39:47.647746 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.647734    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea4ced9-5821-4781-b460-a6fa56258ede" containerName="console"
Jul 28 11:39:47.647789 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.647747    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea4ced9-5821-4781-b460-a6fa56258ede" containerName="console"
Jul 28 11:39:47.647822 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.647803    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea4ced9-5821-4781-b460-a6fa56258ede" containerName="console"
Jul 28 11:39:47.650576 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.650558    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.653168 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.653144    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 11:39:47.653289 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.653247    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wsnqk\""
Jul 28 11:39:47.654355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.654339    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 11:39:47.659788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.659760    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"]
Jul 28 11:39:47.753536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.753496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.753715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.753554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.753715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.753608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvc7\" (UniqueName: \"kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.854575 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.854543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.855034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.854610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.855034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.854659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvc7\" (UniqueName: \"kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.855034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.854927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.855034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.854962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.863121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.863087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvc7\" (UniqueName: \"kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:47.960397 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:47.960289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:39:48.087941 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:48.087916    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"]
Jul 28 11:39:48.090556 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:39:48.090526    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44be489c_b73d_467f_800d_c6f04404f4bf.slice/crio-00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad WatchSource:0}: Error finding container 00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad: Status 404 returned error can't find the container with id 00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad
Jul 28 11:39:48.175467 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:48.175435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr" event={"ID":"44be489c-b73d-467f-800d-c6f04404f4bf","Type":"ContainerStarted","Data":"00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad"}
Jul 28 11:39:55.206560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:55.206526    2573 generic.go:356] "Generic (PLEG): container finished" podID="44be489c-b73d-467f-800d-c6f04404f4bf" containerID="191f6775e60fa398ff1a8ab54e24d9d2fc850dc04c5134c8a3a6fae010cb4f71" exitCode=0
Jul 28 11:39:55.206951 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:55.206617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr" event={"ID":"44be489c-b73d-467f-800d-c6f04404f4bf","Type":"ContainerDied","Data":"191f6775e60fa398ff1a8ab54e24d9d2fc850dc04c5134c8a3a6fae010cb4f71"}
Jul 28 11:39:58.218334 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:58.218302    2573 generic.go:356] "Generic (PLEG): container finished" podID="44be489c-b73d-467f-800d-c6f04404f4bf" containerID="2d8425d8a486381fd668b25a9b5dec59223cc2a393a5ddb3e7632c84504ee35b" exitCode=0
Jul 28 11:39:58.218812 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:39:58.218368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr" event={"ID":"44be489c-b73d-467f-800d-c6f04404f4bf","Type":"ContainerDied","Data":"2d8425d8a486381fd668b25a9b5dec59223cc2a393a5ddb3e7632c84504ee35b"}
Jul 28 11:40:05.249173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:05.249089    2573 generic.go:356] "Generic (PLEG): container finished" podID="44be489c-b73d-467f-800d-c6f04404f4bf" containerID="6e4ec258b18c0cc890526230c2b7698180d32e595fb2a3886d3ce4924050aeb2" exitCode=0
Jul 28 11:40:05.249173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:05.249148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr" event={"ID":"44be489c-b73d-467f-800d-c6f04404f4bf","Type":"ContainerDied","Data":"6e4ec258b18c0cc890526230c2b7698180d32e595fb2a3886d3ce4924050aeb2"}
Jul 28 11:40:06.375772 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.375740    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:40:06.417757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.417731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle\") pod \"44be489c-b73d-467f-800d-c6f04404f4bf\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") "
Jul 28 11:40:06.417874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.417768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lvc7\" (UniqueName: \"kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7\") pod \"44be489c-b73d-467f-800d-c6f04404f4bf\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") "
Jul 28 11:40:06.417874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.417811    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util\") pod \"44be489c-b73d-467f-800d-c6f04404f4bf\" (UID: \"44be489c-b73d-467f-800d-c6f04404f4bf\") "
Jul 28 11:40:06.418417 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.418374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle" (OuterVolumeSpecName: "bundle") pod "44be489c-b73d-467f-800d-c6f04404f4bf" (UID: "44be489c-b73d-467f-800d-c6f04404f4bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:06.419897 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.419868    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7" (OuterVolumeSpecName: "kube-api-access-5lvc7") pod "44be489c-b73d-467f-800d-c6f04404f4bf" (UID: "44be489c-b73d-467f-800d-c6f04404f4bf"). InnerVolumeSpecName "kube-api-access-5lvc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:40:06.422486 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.422463    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util" (OuterVolumeSpecName: "util") pod "44be489c-b73d-467f-800d-c6f04404f4bf" (UID: "44be489c-b73d-467f-800d-c6f04404f4bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:06.518427 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.518360    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:06.518532 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.518438    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44be489c-b73d-467f-800d-c6f04404f4bf-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:06.518532 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:06.518451    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lvc7\" (UniqueName: \"kubernetes.io/projected/44be489c-b73d-467f-800d-c6f04404f4bf-kube-api-access-5lvc7\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:07.258577 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:07.258545    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr"
Jul 28 11:40:07.258577 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:07.258550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bv8pr" event={"ID":"44be489c-b73d-467f-800d-c6f04404f4bf","Type":"ContainerDied","Data":"00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad"}
Jul 28 11:40:07.258783 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:07.258625    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00a504b4b9b02225f550704ef5f5a8d41b6b3afc0c3fa1c120e2d26cf750e6ad"
Jul 28 11:40:08.659165 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:08.659128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:10.423598 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.423564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:10.638061 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638025    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"]
Jul 28 11:40:10.638408 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638362    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="extract"
Jul 28 11:40:10.638408 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638398    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="extract"
Jul 28 11:40:10.638545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638427    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="util"
Jul 28 11:40:10.638545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638435    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="util"
Jul 28 11:40:10.638545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638454    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="pull"
Jul 28 11:40:10.638545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638462    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="pull"
Jul 28 11:40:10.638545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.638542    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44be489c-b73d-467f-800d-c6f04404f4bf" containerName="extract"
Jul 28 11:40:10.670633 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.670606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.675264 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.675207    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:40:10.675264 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.675240    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-82ts5\""
Jul 28 11:40:10.675526 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.675508    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 11:40:10.685313 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.685290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"]
Jul 28 11:40:10.750698 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.750670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6faabab5-cea2-48b6-9558-f3d90a167640-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.750850 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.750714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqmq\" (UniqueName: \"kubernetes.io/projected/6faabab5-cea2-48b6-9558-f3d90a167640-kube-api-access-twqmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.851981 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.851941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6faabab5-cea2-48b6-9558-f3d90a167640-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.852147 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.852008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqmq\" (UniqueName: \"kubernetes.io/projected/6faabab5-cea2-48b6-9558-f3d90a167640-kube-api-access-twqmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.852333 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.852311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6faabab5-cea2-48b6-9558-f3d90a167640-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.862250 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.862213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqmq\" (UniqueName: \"kubernetes.io/projected/6faabab5-cea2-48b6-9558-f3d90a167640-kube-api-access-twqmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-9dwgv\" (UID: \"6faabab5-cea2-48b6-9558-f3d90a167640\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:10.980393 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:10.980293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"
Jul 28 11:40:11.136219 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:11.136173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv"]
Jul 28 11:40:11.274309 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:11.274233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv" event={"ID":"6faabab5-cea2-48b6-9558-f3d90a167640","Type":"ContainerStarted","Data":"4afc6f17098d1a7ddf644683d9cf5e2158802e58693216f7b383e2e87f6e54ed"}
Jul 28 11:40:12.314307 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:12.314264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:12.414858 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:12.414801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:13.419493 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:13.419463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:13.518886 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:13.518854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:14.290132 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.290102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv" event={"ID":"6faabab5-cea2-48b6-9558-f3d90a167640","Type":"ContainerStarted","Data":"f0a32a766f7051a97b0eee99ba4124deedf8fde6cf8f7c57ad31053fd40f6e59"}
Jul 28 11:40:14.322364 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.322305    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9dwgv" podStartSLOduration=1.992021845 podStartE2EDuration="4.322289747s" totalImagesPullingTime="2.330267902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:40:14.319787984 +0000 UTC m=+577.508389014" watchObservedRunningTime="2026-07-28 11:40:14.322289747 +0000 UTC m=+577.510890744"
Jul 28 11:40:14.341143 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.341115    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:14.440360 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.440331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:14.782174 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.782138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:14.887606 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:14.887573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:15.360684 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.360651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"]
Jul 28 11:40:15.363080 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.363063    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.365634 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.365604    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 11:40:15.365765 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.365604    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 11:40:15.366521 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.366499    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wsnqk\""
Jul 28 11:40:15.372658 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.372641    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"]
Jul 28 11:40:15.386573 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.386553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.386680 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.386581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsw8\" (UniqueName: \"kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.386680 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.386622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.488008 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.487980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.488470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.488040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.488470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.488060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsw8\" (UniqueName: \"kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.488470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.488333    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.488606 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.488477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.498882 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.498859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsw8\" (UniqueName: \"kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.673517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.673488    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:15.804782 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:15.804754    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"]
Jul 28 11:40:15.806668 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:40:15.806643    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82f2e83_1183_41f6_abfd_ea18bbb8f7a4.slice/crio-f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e WatchSource:0}: Error finding container f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e: Status 404 returned error can't find the container with id f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e
Jul 28 11:40:16.299178 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:16.299147    2573 generic.go:356] "Generic (PLEG): container finished" podID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerID="2ba8fa7c48621aee8462969e4e732812b899337bd019c846ee914fba20556599" exitCode=0
Jul 28 11:40:16.299366 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:16.299197    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx" event={"ID":"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4","Type":"ContainerDied","Data":"2ba8fa7c48621aee8462969e4e732812b899337bd019c846ee914fba20556599"}
Jul 28 11:40:16.299366 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:16.299231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx" event={"ID":"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4","Type":"ContainerStarted","Data":"f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e"}
Jul 28 11:40:16.543240 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:16.543191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:16.743940 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:16.743893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:19.315422 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:19.315360    2573 generic.go:356] "Generic (PLEG): container finished" podID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerID="32bc2eb9f57b9a65f94012333dccc0cb29ef72a8a58a2aec42b0b47cef2b6cf1" exitCode=0
Jul 28 11:40:19.315885 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:19.315453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx" event={"ID":"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4","Type":"ContainerDied","Data":"32bc2eb9f57b9a65f94012333dccc0cb29ef72a8a58a2aec42b0b47cef2b6cf1"}
Jul 28 11:40:19.851551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:19.851514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:19.928537 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:19.928503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:20.327651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:20.327618    2573 generic.go:356] "Generic (PLEG): container finished" podID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerID="28f88ceb64ea26bba55a37e365fceafc55ae33b7f365f5966641f82272a8b923" exitCode=0
Jul 28 11:40:20.328016 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:20.327700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx" event={"ID":"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4","Type":"ContainerDied","Data":"28f88ceb64ea26bba55a37e365fceafc55ae33b7f365f5966641f82272a8b923"}
Jul 28 11:40:21.455825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.455797    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:21.533497 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.533459    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle\") pod \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") "
Jul 28 11:40:21.533638 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.533542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util\") pod \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") "
Jul 28 11:40:21.533638 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.533567    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhsw8\" (UniqueName: \"kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8\") pod \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\" (UID: \"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4\") "
Jul 28 11:40:21.533928 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.533901    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle" (OuterVolumeSpecName: "bundle") pod "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" (UID: "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:21.535652 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.535622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8" (OuterVolumeSpecName: "kube-api-access-qhsw8") pod "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" (UID: "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4"). InnerVolumeSpecName "kube-api-access-qhsw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:40:21.538072 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.538049    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util" (OuterVolumeSpecName: "util") pod "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" (UID: "b82f2e83-1183-41f6-abfd-ea18bbb8f7a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:21.634517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.634488    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:21.634517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.634518    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhsw8\" (UniqueName: \"kubernetes.io/projected/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-kube-api-access-qhsw8\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:21.634704 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:21.634530    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82f2e83-1183-41f6-abfd-ea18bbb8f7a4-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:22.337560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:22.337533    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx"
Jul 28 11:40:22.337560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:22.337544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dxzx" event={"ID":"b82f2e83-1183-41f6-abfd-ea18bbb8f7a4","Type":"ContainerDied","Data":"f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e"}
Jul 28 11:40:22.337775 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:22.337584    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1690a2c7a35a5d5a93257176247ab00e945e146e3f484e1528a6ab855b3ec9e"
Jul 28 11:40:24.562317 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:24.562284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:25.311637 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311599    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ngt8j"]
Jul 28 11:40:25.311911 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311898    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="extract"
Jul 28 11:40:25.311955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311915    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="extract"
Jul 28 11:40:25.311955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311932    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="util"
Jul 28 11:40:25.311955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311938    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="util"
Jul 28 11:40:25.311955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311947    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="pull"
Jul 28 11:40:25.311955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.311952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="pull"
Jul 28 11:40:25.312147 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.312024    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82f2e83-1183-41f6-abfd-ea18bbb8f7a4" containerName="extract"
Jul 28 11:40:25.315691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.315670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.318353 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.318332    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 11:40:25.318460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.318332    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 11:40:25.318506 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.318440    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vjz6x\""
Jul 28 11:40:25.326132 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.326108    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ngt8j"]
Jul 28 11:40:25.360898 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.360870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-bound-sa-token\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.361076 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.360967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htg7n\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-kube-api-access-htg7n\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.461492 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.461461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-bound-sa-token\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.461673 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.461524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htg7n\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-kube-api-access-htg7n\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.469500 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.469476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-bound-sa-token\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.469643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.469624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htg7n\" (UniqueName: \"kubernetes.io/projected/fd0b4a00-fba9-4a4f-8059-d9cb5f722364-kube-api-access-htg7n\") pod \"cert-manager-55b4d954d5-ngt8j\" (UID: \"fd0b4a00-fba9-4a4f-8059-d9cb5f722364\") " pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.635189 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.635156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ngt8j"
Jul 28 11:40:25.765627 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:25.765603    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ngt8j"]
Jul 28 11:40:25.768010 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:40:25.767979    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd0b4a00_fba9_4a4f_8059_d9cb5f722364.slice/crio-0662dd36dc764ee9d1c57d01ba3ddfd3768106c200841e04e256f72d96b7c18a WatchSource:0}: Error finding container 0662dd36dc764ee9d1c57d01ba3ddfd3768106c200841e04e256f72d96b7c18a: Status 404 returned error can't find the container with id 0662dd36dc764ee9d1c57d01ba3ddfd3768106c200841e04e256f72d96b7c18a
Jul 28 11:40:26.356360 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:26.356326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ngt8j" event={"ID":"fd0b4a00-fba9-4a4f-8059-d9cb5f722364","Type":"ContainerStarted","Data":"0662dd36dc764ee9d1c57d01ba3ddfd3768106c200841e04e256f72d96b7c18a"}
Jul 28 11:40:26.457550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:26.457514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:26.555229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:26.555196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:28.366585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.366545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ngt8j" event={"ID":"fd0b4a00-fba9-4a4f-8059-d9cb5f722364","Type":"ContainerStarted","Data":"742f233644b2b8a5234a0621c6354cf826a98f5f38018a70053645d9934bd39f"}
Jul 28 11:40:28.383530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.383484    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ngt8j" podStartSLOduration=0.965866111 podStartE2EDuration="3.383468298s" totalImagesPullingTime="2.417602187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:40:28.383021074 +0000 UTC m=+591.571622071" watchObservedRunningTime="2026-07-28 11:40:28.383468298 +0000 UTC m=+591.572069286"
Jul 28 11:40:28.493278 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.493192    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"]
Jul 28 11:40:28.496668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.496649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.499908 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.499883    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 11:40:28.500010 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.499978    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 11:40:28.500060 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.500002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7x9tq\""
Jul 28 11:40:28.505343 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.505322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"]
Jul 28 11:40:28.586659 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.586629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-kube-api-access-69kks\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.586659 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.586664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.687739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.687703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-kube-api-access-69kks\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.687912 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.687747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.688196 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.688176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.696428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.696406    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kks\" (UniqueName: \"kubernetes.io/projected/0a534a16-f108-4d4d-a5e1-2865cfcbe1e4-kube-api-access-69kks\") pod \"openshift-lws-operator-fd8ccff4c-hl9sz\" (UID: \"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.805742 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.805654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"
Jul 28 11:40:28.943977 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:28.943950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz"]
Jul 28 11:40:28.945880 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:40:28.945855    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a534a16_f108_4d4d_a5e1_2865cfcbe1e4.slice/crio-bf021e4033253903e69abb0a4eff5b900f19f0a8e7829bdad23169fe5b5ef8a2 WatchSource:0}: Error finding container bf021e4033253903e69abb0a4eff5b900f19f0a8e7829bdad23169fe5b5ef8a2: Status 404 returned error can't find the container with id bf021e4033253903e69abb0a4eff5b900f19f0a8e7829bdad23169fe5b5ef8a2
Jul 28 11:40:29.372145 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:29.372101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz" event={"ID":"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4","Type":"ContainerStarted","Data":"bf021e4033253903e69abb0a4eff5b900f19f0a8e7829bdad23169fe5b5ef8a2"}
Jul 28 11:40:31.384699 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:31.384666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz" event={"ID":"0a534a16-f108-4d4d-a5e1-2865cfcbe1e4","Type":"ContainerStarted","Data":"f8302cc743adb23b03c624d4dcc56b393b2315d4b3061d74fefe8f3d1219f8c0"}
Jul 28 11:40:31.403200 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:31.403154    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hl9sz" podStartSLOduration=1.908202629 podStartE2EDuration="3.403140038s" totalImagesPullingTime="1.494937409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:40:31.401014032 +0000 UTC m=+594.589615029" watchObservedRunningTime="2026-07-28 11:40:31.403140038 +0000 UTC m=+594.591741034"
Jul 28 11:40:32.194227 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:32.194185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:32.293944 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:32.293891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:34.073025 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.072987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:34.331923 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.331844    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"]
Jul 28 11:40:34.335185 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.335164    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.337536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.337515    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 11:40:34.337650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.337577    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 11:40:34.337791 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.337776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wsnqk\""
Jul 28 11:40:34.347443 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.347418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"]
Jul 28 11:40:34.434709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.434674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.434862 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.434789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.434862 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.434839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfcs4\" (UniqueName: \"kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.535668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.535635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.535826 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.535686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.535826 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.535710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfcs4\" (UniqueName: \"kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.536030 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.536009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.536070 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.536044    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.544328 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.544299    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfcs4\" (UniqueName: \"kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.644677 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.644653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:34.774455 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:34.774430    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"]
Jul 28 11:40:34.777086 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:40:34.777060    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392efb02_9c5b_4bed_9e62_0bdf0462ba8f.slice/crio-22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664 WatchSource:0}: Error finding container 22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664: Status 404 returned error can't find the container with id 22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664
Jul 28 11:40:35.402312 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:35.402273    2573 generic.go:356] "Generic (PLEG): container finished" podID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerID="77a08373b18b1ba4d96da9a7aa7a4ea72dea74c6225abd48f54a0d7e8d80922d" exitCode=0
Jul 28 11:40:35.402703 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:35.402359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d" event={"ID":"392efb02-9c5b-4bed-9e62-0bdf0462ba8f","Type":"ContainerDied","Data":"77a08373b18b1ba4d96da9a7aa7a4ea72dea74c6225abd48f54a0d7e8d80922d"}
Jul 28 11:40:35.402703 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:35.402433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d" event={"ID":"392efb02-9c5b-4bed-9e62-0bdf0462ba8f","Type":"ContainerStarted","Data":"22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664"}
Jul 28 11:40:36.408523 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:36.408438    2573 generic.go:356] "Generic (PLEG): container finished" podID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerID="a191330f9fe25e16cb02283688b002dabe07b38485252ee4e233976b33adea5e" exitCode=0
Jul 28 11:40:36.408523 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:36.408481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d" event={"ID":"392efb02-9c5b-4bed-9e62-0bdf0462ba8f","Type":"ContainerDied","Data":"a191330f9fe25e16cb02283688b002dabe07b38485252ee4e233976b33adea5e"}
Jul 28 11:40:37.414939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:37.414900    2573 generic.go:356] "Generic (PLEG): container finished" podID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerID="4abaf252625d91fd29d3275fe98037d1bd54a8e12cee7a27d9040fb1811ff6db" exitCode=0
Jul 28 11:40:37.414939 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:37.414939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d" event={"ID":"392efb02-9c5b-4bed-9e62-0bdf0462ba8f","Type":"ContainerDied","Data":"4abaf252625d91fd29d3275fe98037d1bd54a8e12cee7a27d9040fb1811ff6db"}
Jul 28 11:40:38.390235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.390208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:40:38.392373 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.390846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:40:38.542059 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.542031    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:38.670084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.669994    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle\") pod \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") "
Jul 28 11:40:38.670084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.670030    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util\") pod \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") "
Jul 28 11:40:38.670084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.670076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfcs4\" (UniqueName: \"kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4\") pod \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\" (UID: \"392efb02-9c5b-4bed-9e62-0bdf0462ba8f\") "
Jul 28 11:40:38.670780 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.670749    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle" (OuterVolumeSpecName: "bundle") pod "392efb02-9c5b-4bed-9e62-0bdf0462ba8f" (UID: "392efb02-9c5b-4bed-9e62-0bdf0462ba8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:38.672488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.672457    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4" (OuterVolumeSpecName: "kube-api-access-xfcs4") pod "392efb02-9c5b-4bed-9e62-0bdf0462ba8f" (UID: "392efb02-9c5b-4bed-9e62-0bdf0462ba8f"). InnerVolumeSpecName "kube-api-access-xfcs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:40:38.675691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.675669    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util" (OuterVolumeSpecName: "util") pod "392efb02-9c5b-4bed-9e62-0bdf0462ba8f" (UID: "392efb02-9c5b-4bed-9e62-0bdf0462ba8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:40:38.771446 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.771410    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:38.771446 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.771438    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:38.771446 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:38.771451    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfcs4\" (UniqueName: \"kubernetes.io/projected/392efb02-9c5b-4bed-9e62-0bdf0462ba8f-kube-api-access-xfcs4\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:40:39.424629 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:39.424598    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d"
Jul 28 11:40:39.424784 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:39.424602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afthx4d" event={"ID":"392efb02-9c5b-4bed-9e62-0bdf0462ba8f","Type":"ContainerDied","Data":"22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664"}
Jul 28 11:40:39.424784 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:39.424719    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22d098a5cca6a83f132ff05aeb38e465654c3b709a3e1269cecdaa623d716664"
Jul 28 11:40:45.052229 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:45.052196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:45.152967 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:45.152931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:47.670651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:47.670618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:47.768691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:47.768660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.273560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.273530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.530719 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.530642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.627256 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.627225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.649681 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649652    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"]
Jul 28 11:40:48.649950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649938    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="util"
Jul 28 11:40:48.650000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649951    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="util"
Jul 28 11:40:48.650000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649960    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="extract"
Jul 28 11:40:48.650000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649966    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="extract"
Jul 28 11:40:48.650000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649978    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="pull"
Jul 28 11:40:48.650000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.649984    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="pull"
Jul 28 11:40:48.650142 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.650031    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="392efb02-9c5b-4bed-9e62-0bdf0462ba8f" containerName="extract"
Jul 28 11:40:48.655950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.655926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.658501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.658471    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 11:40:48.658640 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.658550    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 11:40:48.658640 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.658575    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 11:40:48.658640 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.658594    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sw542\""
Jul 28 11:40:48.658640 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.658635    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 11:40:48.667147 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.667127    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"]
Jul 28 11:40:48.753613 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.753576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-manifests\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.754012 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.753631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hppg\" (UniqueName: \"kubernetes.io/projected/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-kube-api-access-9hppg\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.754012 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.753683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-tmp\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.754012 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.753745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.754012 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.753780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.854588 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.854502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hppg\" (UniqueName: \"kubernetes.io/projected/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-kube-api-access-9hppg\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.854588 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.854561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-tmp\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.854864 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.854607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.854864 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.854637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.854864 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.854672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-manifests\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.855062 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.855039    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-manifests\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.855679 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.855650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.856879 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.856855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-tmp\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.857138 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.857122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.857195 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.857178    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.863286 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.863250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hppg\" (UniqueName: \"kubernetes.io/projected/48b8ca5d-9ffa-47ac-afff-5e2771a27ae6-kube-api-access-9hppg\") pod \"opendatahub-operator-controller-manager-6755d7577-bxlnb\" (UID: \"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6\") " pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:48.955762 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.955720    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:48.967774 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:48.967750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:49.055851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.055813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:49.106421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.106397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"]
Jul 28 11:40:49.108547 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:40:49.108518    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b8ca5d_9ffa_47ac_afff_5e2771a27ae6.slice/crio-4251048146cd330f9394ae34df2ee5b849dc4c09cc49358c8546fbf83a65ab5d WatchSource:0}: Error finding container 4251048146cd330f9394ae34df2ee5b849dc4c09cc49358c8546fbf83a65ab5d: Status 404 returned error can't find the container with id 4251048146cd330f9394ae34df2ee5b849dc4c09cc49358c8546fbf83a65ab5d
Jul 28 11:40:49.110672 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.110652    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 11:40:49.118239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.118212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:49.185211 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.185173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:49.290161 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.290133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:40:49.470099 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:49.470061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb" event={"ID":"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6","Type":"ContainerStarted","Data":"4251048146cd330f9394ae34df2ee5b849dc4c09cc49358c8546fbf83a65ab5d"}
Jul 28 11:40:52.486623 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:52.486543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb" event={"ID":"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6","Type":"ContainerStarted","Data":"20cf13911b4b8ffc2c9fc38b648b3939d70bb957af6003601287021697aedfe9"}
Jul 28 11:40:53.496895 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:53.496853    2573 generic.go:356] "Generic (PLEG): container finished" podID="48b8ca5d-9ffa-47ac-afff-5e2771a27ae6" containerID="20cf13911b4b8ffc2c9fc38b648b3939d70bb957af6003601287021697aedfe9" exitCode=0
Jul 28 11:40:53.497343 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:53.496907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb" event={"ID":"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6","Type":"ContainerDied","Data":"20cf13911b4b8ffc2c9fc38b648b3939d70bb957af6003601287021697aedfe9"}
Jul 28 11:40:54.503720 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:54.503682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb" event={"ID":"48b8ca5d-9ffa-47ac-afff-5e2771a27ae6","Type":"ContainerStarted","Data":"10a7bc567d0210c1ac3cc46a0103aaca34344d692fd95e800e9a23043b7a470f"}
Jul 28 11:40:54.504131 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:54.503818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:40:54.526779 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:54.526734    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb" podStartSLOduration=2.040740606 podStartE2EDuration="6.526720895s" totalImagesPullingTime="3.449683427s" totalInitContainerRuntime="1.036296862s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:40:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:40:54.525626688 +0000 UTC m=+617.714227699" watchObservedRunningTime="2026-07-28 11:40:54.526720895 +0000 UTC m=+617.715321891"
Jul 28 11:40:59.924642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:40:59.924552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:00.027759 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:00.027726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:05.510746 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:05.510716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6755d7577-bxlnb"
Jul 28 11:41:07.339992 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.339918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:07.447161 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.447123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:07.694566 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.694532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:07.844997 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.844964    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"]
Jul 28 11:41:07.848961 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.848941    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:07.851283 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.851258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 11:41:07.851402 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.851350    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cmk55\""
Jul 28 11:41:07.851402 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.851356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 11:41:07.860675 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.860649    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"]
Jul 28 11:41:07.983578 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:07.983488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.015905 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.015874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpgdr\" (UniqueName: \"kubernetes.io/projected/84b4ebbe-a1f9-4b27-9a77-835538103775-kube-api-access-rpgdr\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.016055 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.015911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b4ebbe-a1f9-4b27-9a77-835538103775-tls-certs\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.016055 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.016000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b4ebbe-a1f9-4b27-9a77-835538103775-tmp\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.066715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.066686    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ww8jd"]
Jul 28 11:41:08.070417 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.070402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.072958 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.072937    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 11:41:08.073059 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.072939    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vfp5l\""
Jul 28 11:41:08.080767 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.080744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ww8jd"]
Jul 28 11:41:08.108311 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.108277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.117353 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.117327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b4ebbe-a1f9-4b27-9a77-835538103775-tls-certs\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.117484 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.117379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b4ebbe-a1f9-4b27-9a77-835538103775-tmp\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.117484 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.117454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpgdr\" (UniqueName: \"kubernetes.io/projected/84b4ebbe-a1f9-4b27-9a77-835538103775-kube-api-access-rpgdr\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.119630 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.119606    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b4ebbe-a1f9-4b27-9a77-835538103775-tmp\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.119865 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.119844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b4ebbe-a1f9-4b27-9a77-835538103775-tls-certs\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.126322 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.126298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpgdr\" (UniqueName: \"kubernetes.io/projected/84b4ebbe-a1f9-4b27-9a77-835538103775-kube-api-access-rpgdr\") pod \"kube-auth-proxy-8489dc4db9-dsm9r\" (UID: \"84b4ebbe-a1f9-4b27-9a77-835538103775\") " pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.157918 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.157893    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"
Jul 28 11:41:08.186130 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.186074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.218489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.218455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.218677 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.218650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cv89\" (UniqueName: \"kubernetes.io/projected/a7b552ce-918a-4627-8139-c9a07dc6981e-kube-api-access-2cv89\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.287292 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.287262    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r"]
Jul 28 11:41:08.289189 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:08.289164    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b4ebbe_a1f9_4b27_9a77_835538103775.slice/crio-b047ebd082c89c72761fb6074e20bfd7446ec952d553727fc72d2c59792013a3 WatchSource:0}: Error finding container b047ebd082c89c72761fb6074e20bfd7446ec952d553727fc72d2c59792013a3: Status 404 returned error can't find the container with id b047ebd082c89c72761fb6074e20bfd7446ec952d553727fc72d2c59792013a3
Jul 28 11:41:08.319226 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.319200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cv89\" (UniqueName: \"kubernetes.io/projected/a7b552ce-918a-4627-8139-c9a07dc6981e-kube-api-access-2cv89\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.319364 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.319255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.319451 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:08.319410    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 11:41:08.319555 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:08.319541    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert podName:a7b552ce-918a-4627-8139-c9a07dc6981e nodeName:}" failed. No retries permitted until 2026-07-28 11:41:08.819509797 +0000 UTC m=+632.008110785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert") pod "odh-model-controller-7998c67dc4-ww8jd" (UID: "a7b552ce-918a-4627-8139-c9a07dc6981e") : secret "odh-model-controller-webhook-cert" not found
Jul 28 11:41:08.328063 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.328037    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cv89\" (UniqueName: \"kubernetes.io/projected/a7b552ce-918a-4627-8139-c9a07dc6981e-kube-api-access-2cv89\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.516197 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.516115    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.573322 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.573290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r" event={"ID":"84b4ebbe-a1f9-4b27-9a77-835538103775","Type":"ContainerStarted","Data":"b047ebd082c89c72761fb6074e20bfd7446ec952d553727fc72d2c59792013a3"}
Jul 28 11:41:08.716070 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.716031    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l64pl"]
Jul 28 11:41:08.721243 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.721217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.723703 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.723683    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 11:41:08.724056 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.724041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8kc9m\""
Jul 28 11:41:08.729860 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.729838    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l64pl"]
Jul 28 11:41:08.736336 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.736307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.822192 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.822098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-tls-certs\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.822339 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.822221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.822339 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.822263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7tz\" (UniqueName: \"kubernetes.io/projected/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-kube-api-access-kj7tz\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.825025 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.824995    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7b552ce-918a-4627-8139-c9a07dc6981e-cert\") pod \"odh-model-controller-7998c67dc4-ww8jd\" (UID: \"a7b552ce-918a-4627-8139-c9a07dc6981e\") " pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:08.922740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.922693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7tz\" (UniqueName: \"kubernetes.io/projected/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-kube-api-access-kj7tz\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.922740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.922751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-tls-certs\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.925160 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.925120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-tls-certs\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.932177 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.932147    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7tz\" (UniqueName: \"kubernetes.io/projected/7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4-kube-api-access-kj7tz\") pod \"model-serving-api-54d89bd5fc-l64pl\" (UID: \"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4\") " pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:08.946951 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.946919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:08.981699 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:08.981670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:09.033444 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.033350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:09.142242 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.141880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ww8jd"]
Jul 28 11:41:09.142865 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:09.142792    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b552ce_918a_4627_8139_c9a07dc6981e.slice/crio-2602c4b30f45fe99caa25a1a7c6eee80a2ea6b476e89f386261ec0a085a475a4 WatchSource:0}: Error finding container 2602c4b30f45fe99caa25a1a7c6eee80a2ea6b476e89f386261ec0a085a475a4: Status 404 returned error can't find the container with id 2602c4b30f45fe99caa25a1a7c6eee80a2ea6b476e89f386261ec0a085a475a4
Jul 28 11:41:09.180013 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.179979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:09.185781 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.185281    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:09.190668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.190644    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.193417 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.193375    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 11:41:09.193539 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.193417    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 11:41:09.193539 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.193374    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 11:41:09.194172 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.194120    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mvwwj\""
Jul 28 11:41:09.194172 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.194153    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 11:41:09.204485 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.204430    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:09.210433 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.210407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l64pl"]
Jul 28 11:41:09.211728 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:09.211701    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0d8a3e_2ca5_453a_9b1f_c5a3617372d4.slice/crio-fc2770d17ddc98ee99d1d6de85ec3a44a902045859459656757b2d1da6964599 WatchSource:0}: Error finding container fc2770d17ddc98ee99d1d6de85ec3a44a902045859459656757b2d1da6964599: Status 404 returned error can't find the container with id fc2770d17ddc98ee99d1d6de85ec3a44a902045859459656757b2d1da6964599
Jul 28 11:41:09.249134 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.249100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:09.326423 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2tf\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.326683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.326657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427783 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2tf\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.427986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.427980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.428497 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.428461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.430924 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.430905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.431030 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.430972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.431121 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.431051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.431162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.431140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.435739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.435714    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.435836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.435815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2tf\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf\") pod \"istiod-openshift-gateway-7b7995d5cd-65ggl\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.503508 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.503470    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:09.580572 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.580489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl" event={"ID":"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4","Type":"ContainerStarted","Data":"fc2770d17ddc98ee99d1d6de85ec3a44a902045859459656757b2d1da6964599"}
Jul 28 11:41:09.582201 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.582171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd" event={"ID":"a7b552ce-918a-4627-8139-c9a07dc6981e","Type":"ContainerStarted","Data":"2602c4b30f45fe99caa25a1a7c6eee80a2ea6b476e89f386261ec0a085a475a4"}
Jul 28 11:41:09.650444 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:09.650411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:09.652243 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:09.652209    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode618ece2_5f77_4f22_a84a_4aedfde45f68.slice/crio-707f55dddb4fd68315857c080cff894e73ab96b8c5f45942882ede626113029f WatchSource:0}: Error finding container 707f55dddb4fd68315857c080cff894e73ab96b8c5f45942882ede626113029f: Status 404 returned error can't find the container with id 707f55dddb4fd68315857c080cff894e73ab96b8c5f45942882ede626113029f
Jul 28 11:41:10.176795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:10.176709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:10.589907 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:10.589808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" event={"ID":"e618ece2-5f77-4f22-a84a-4aedfde45f68","Type":"ContainerStarted","Data":"707f55dddb4fd68315857c080cff894e73ab96b8c5f45942882ede626113029f"}
Jul 28 11:41:13.606789 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.606751    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r" event={"ID":"84b4ebbe-a1f9-4b27-9a77-835538103775","Type":"ContainerStarted","Data":"8f1ac5d1d638d7834ad7c15816c87ed6febedce5e55782ec215ed54fb072a2dc"}
Jul 28 11:41:13.608171 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.608139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl" event={"ID":"7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4","Type":"ContainerStarted","Data":"afe7b38d85aac9437a2f18650bd442074c590b9c11d0653e5525ebf0d43dfbc8"}
Jul 28 11:41:13.608308 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.608205    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:13.609614 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.609589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd" event={"ID":"a7b552ce-918a-4627-8139-c9a07dc6981e","Type":"ContainerStarted","Data":"1b4b90c29fd0c8cf6a4d9db0a231ee2130c237ba20f167605b0eedb4eda37c4f"}
Jul 28 11:41:13.609750 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.609641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:13.622760 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.622716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8489dc4db9-dsm9r" podStartSLOduration=2.199173283 podStartE2EDuration="6.622700323s" totalImagesPullingTime="4.42352704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:13.622607681 +0000 UTC m=+636.811208696" watchObservedRunningTime="2026-07-28 11:41:13.622700323 +0000 UTC m=+636.811301321"
Jul 28 11:41:13.639442 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.639393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd" podStartSLOduration=2.013024329 podStartE2EDuration="5.639366006s" totalImagesPullingTime="3.626341677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:13.637458092 +0000 UTC m=+636.826059125" watchObservedRunningTime="2026-07-28 11:41:13.639366006 +0000 UTC m=+636.827967003"
Jul 28 11:41:13.653666 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:13.653613    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl" podStartSLOduration=2.150761177 podStartE2EDuration="5.653595788s" totalImagesPullingTime="3.502834611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:13.65325801 +0000 UTC m=+636.841859030" watchObservedRunningTime="2026-07-28 11:41:13.653595788 +0000 UTC m=+636.842196788"
Jul 28 11:41:16.709697 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:16.709651    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:41:16.709991 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:16.709747    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:41:17.632062 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.632010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" event={"ID":"e618ece2-5f77-4f22-a84a-4aedfde45f68","Type":"ContainerStarted","Data":"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"}
Jul 28 11:41:17.632253 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.632179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:17.634132 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.634106    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-65ggl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 11:41:17.634318 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.634298    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 11:41:17.679106 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.679050    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" podStartSLOduration=1.6242842130000001 podStartE2EDuration="8.67903036s" totalImagesPullingTime="7.054746147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:17.678315684 +0000 UTC m=+640.866916705" watchObservedRunningTime="2026-07-28 11:41:17.67903036 +0000 UTC m=+640.867631358"
Jul 28 11:41:17.780034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.779992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:17.891755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:17.891667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.132925 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.132889    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"]
Jul 28 11:41:18.136339 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.136318    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.143363 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.143334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zgq98\""
Jul 28 11:41:18.155596 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.155570    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"]
Jul 28 11:41:18.210169 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210169 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef183d4-c493-4d11-942b-57f77c204cff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210357 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrqs\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-kube-api-access-hnrqs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210357 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210357 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef183d4-c493-4d11-942b-57f77c204cff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.210501 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.210500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.216657 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.216633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.311170 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef183d4-c493-4d11-942b-57f77c204cff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef183d4-c493-4d11-942b-57f77c204cff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311695 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrqs\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-kube-api-access-hnrqs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311695 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311695 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311805 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.311901 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311865    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.312025 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.311930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.312265 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.312244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef183d4-c493-4d11-942b-57f77c204cff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.313630 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.313611    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef183d4-c493-4d11-942b-57f77c204cff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.313819 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.313803    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef183d4-c493-4d11-942b-57f77c204cff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.334144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.334114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrqs\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-kube-api-access-hnrqs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.336317 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.336299    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef183d4-c493-4d11-942b-57f77c204cff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfzj88\" (UID: \"aef183d4-c493-4d11-942b-57f77c204cff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.446489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.446396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:18.547416 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.547364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.591870 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.591842    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"]
Jul 28 11:41:18.592793 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:18.592766    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef183d4_c493_4d11_942b_57f77c204cff.slice/crio-61da78534918defbb73c7d8d355a2230cc94458fe53d76d4939cee46d505a895 WatchSource:0}: Error finding container 61da78534918defbb73c7d8d355a2230cc94458fe53d76d4939cee46d505a895: Status 404 returned error can't find the container with id 61da78534918defbb73c7d8d355a2230cc94458fe53d76d4939cee46d505a895
Jul 28 11:41:18.638639 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.638594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88" event={"ID":"aef183d4-c493-4d11-942b-57f77c204cff","Type":"ContainerStarted","Data":"61da78534918defbb73c7d8d355a2230cc94458fe53d76d4939cee46d505a895"}
Jul 28 11:41:18.639426 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.639401    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:18.668922 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.668887    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.757912 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.757827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.810466 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.810433    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"]
Jul 28 11:41:18.815543 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.815519    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:18.821512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.818454    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n2fx7\""
Jul 28 11:41:18.821512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.818697    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 11:41:18.830413 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.828560    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"]
Jul 28 11:41:18.856722 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.856697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:18.917194 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.917161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbxfs\" (UniqueName: \"kubernetes.io/projected/165ca687-c546-49cd-af1d-f2923b89b29f-kube-api-access-wbxfs\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:18.917424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:18.917232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:19.018124 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:19.018035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbxfs\" (UniqueName: \"kubernetes.io/projected/165ca687-c546-49cd-af1d-f2923b89b29f-kube-api-access-wbxfs\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:19.018124 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:19.018088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:19.018301 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:19.018205    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 11:41:19.018301 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:19.018260    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert podName:165ca687-c546-49cd-af1d-f2923b89b29f nodeName:}" failed. No retries permitted until 2026-07-28 11:41:19.518242555 +0000 UTC m=+642.706843530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert") pod "llmisvc-controller-manager-777c6bd7d5-d7ttm" (UID: "165ca687-c546-49cd-af1d-f2923b89b29f") : secret "llmisvc-webhook-server-cert" not found
Jul 28 11:41:19.033290 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:19.033261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbxfs\" (UniqueName: \"kubernetes.io/projected/165ca687-c546-49cd-af1d-f2923b89b29f-kube-api-access-wbxfs\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:19.064037 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:19.064010    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:19.523156 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:19.523125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:19.523349 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:19.523246    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 11:41:19.523349 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:19.523302    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert podName:165ca687-c546-49cd-af1d-f2923b89b29f nodeName:}" failed. No retries permitted until 2026-07-28 11:41:20.52328631 +0000 UTC m=+643.711887286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert") pod "llmisvc-controller-manager-777c6bd7d5-d7ttm" (UID: "165ca687-c546-49cd-af1d-f2923b89b29f") : secret "llmisvc-webhook-server-cert" not found
Jul 28 11:41:20.131326 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.131290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:20.248092 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.248045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:20.349236 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.349191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:20.532262 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.532168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:20.534835 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.534808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165ca687-c546-49cd-af1d-f2923b89b29f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-d7ttm\" (UID: \"165ca687-c546-49cd-af1d-f2923b89b29f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:20.631954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.631920    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:20.644349 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.644319    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:20.649085 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:20.649051    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerName="discovery" containerID="cri-o://1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0" gracePeriod=30
Jul 28 11:41:21.311886 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.311855    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:41:21.312148 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.311926    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:41:21.312148 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.311965    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:41:21.383673 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.383649    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"]
Jul 28 11:41:21.385044 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.385021    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:21.386072 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:41:21.386050    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod165ca687_c546_49cd_af1d_f2923b89b29f.slice/crio-5d3845bb396fa1db075f630e0995f1349f36996b402626c03fb662b8e7dbad33 WatchSource:0}: Error finding container 5d3845bb396fa1db075f630e0995f1349f36996b402626c03fb662b8e7dbad33: Status 404 returned error can't find the container with id 5d3845bb396fa1db075f630e0995f1349f36996b402626c03fb662b8e7dbad33
Jul 28 11:41:21.441825 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.441790    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq2tf\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.441842    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.441958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.442018    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.442048    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.442089    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.442114    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert\") pod \"e618ece2-5f77-4f22-a84a-4aedfde45f68\" (UID: \"e618ece2-5f77-4f22-a84a-4aedfde45f68\") "
Jul 28 11:41:21.442835 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.442716    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:41:21.444683 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.444653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token" (OuterVolumeSpecName: "istio-token") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:41:21.444790 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.444696    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf" (OuterVolumeSpecName: "kube-api-access-pq2tf") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "kube-api-access-pq2tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:41:21.444884 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.444862    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:41:21.444941 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.444893    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs" (OuterVolumeSpecName: "local-certs") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:41:21.445030 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.445011    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts" (OuterVolumeSpecName: "cacerts") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:41:21.445820 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.445801    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e618ece2-5f77-4f22-a84a-4aedfde45f68" (UID: "e618ece2-5f77-4f22-a84a-4aedfde45f68"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:41:21.543502 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543473    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e618ece2-5f77-4f22-a84a-4aedfde45f68-local-certs\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543505    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-token\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543521    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-ca-configmap\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543535    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-cacerts\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543549    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-csr-dns-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543563    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq2tf\" (UniqueName: \"kubernetes.io/projected/e618ece2-5f77-4f22-a84a-4aedfde45f68-kube-api-access-pq2tf\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.543636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.543578    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e618ece2-5f77-4f22-a84a-4aedfde45f68-istio-kubeconfig\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:41:21.655856 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.655817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88" event={"ID":"aef183d4-c493-4d11-942b-57f77c204cff","Type":"ContainerStarted","Data":"1ab13c220522a8ad3f7bc95c6ede8af79e899be9c66426e14c72b16b916087aa"}
Jul 28 11:41:21.657186 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.657161    2573 generic.go:356] "Generic (PLEG): container finished" podID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerID="1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0" exitCode=0
Jul 28 11:41:21.657312 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.657197    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"
Jul 28 11:41:21.657312 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.657240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" event={"ID":"e618ece2-5f77-4f22-a84a-4aedfde45f68","Type":"ContainerDied","Data":"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"}
Jul 28 11:41:21.657312 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.657278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl" event={"ID":"e618ece2-5f77-4f22-a84a-4aedfde45f68","Type":"ContainerDied","Data":"707f55dddb4fd68315857c080cff894e73ab96b8c5f45942882ede626113029f"}
Jul 28 11:41:21.657312 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.657295    2573 scope.go:117] "RemoveContainer" containerID="1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"
Jul 28 11:41:21.658787 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.658557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm" event={"ID":"165ca687-c546-49cd-af1d-f2923b89b29f","Type":"ContainerStarted","Data":"5d3845bb396fa1db075f630e0995f1349f36996b402626c03fb662b8e7dbad33"}
Jul 28 11:41:21.666884 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.666867    2573 scope.go:117] "RemoveContainer" containerID="1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"
Jul 28 11:41:21.667145 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:41:21.667127    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0\": container with ID starting with 1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0 not found: ID does not exist" containerID="1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"
Jul 28 11:41:21.667201 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.667152    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0"} err="failed to get container status \"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0\": rpc error: code = NotFound desc = could not find container \"1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0\": container with ID starting with 1421f7728d1b950c0dddad98258eafda11a834d60057d1ca4f8b606fdbc98df0 not found: ID does not exist"
Jul 28 11:41:21.677482 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.677427    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88" podStartSLOduration=0.960753218 podStartE2EDuration="3.6774112s" totalImagesPullingTime="2.716657982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:21.677056326 +0000 UTC m=+644.865657352" watchObservedRunningTime="2026-07-28 11:41:21.6774112 +0000 UTC m=+644.866012196"
Jul 28 11:41:21.690360 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.690337    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:21.695710 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:21.695688    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65ggl"]
Jul 28 11:41:22.447468 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:22.447435    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:22.452797 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:22.452765    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:22.667768 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:22.667740    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:22.668998 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:22.668962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfzj88"
Jul 28 11:41:23.266985 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:23.266954    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" path="/var/lib/kubelet/pods/e618ece2-5f77-4f22-a84a-4aedfde45f68/volumes"
Jul 28 11:41:24.616788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:24.616756    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ww8jd"
Jul 28 11:41:24.618482 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:24.618456    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l64pl"
Jul 28 11:41:24.683455 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:24.683406    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm" event={"ID":"165ca687-c546-49cd-af1d-f2923b89b29f","Type":"ContainerStarted","Data":"50a944499af8331a39edbae960c31bd233bf992f3a1ce4edb7e203ec3d999eca"}
Jul 28 11:41:24.705340 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:24.705285    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm" podStartSLOduration=3.603386611 podStartE2EDuration="6.705257388s" totalImagesPullingTime="3.101870777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:41:24.704051545 +0000 UTC m=+647.892652562" watchObservedRunningTime="2026-07-28 11:41:24.705257388 +0000 UTC m=+647.893858386"
Jul 28 11:41:25.688641 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:25.688614    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:41:52.190612 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:52.190576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:41:56.695442 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:41:56.695403    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-d7ttm"
Jul 28 11:42:08.949191 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:08.949120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:09.023851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.023781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:09.087373 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.087338    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:09.088105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.088090    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerName="discovery"
Jul 28 11:42:09.088151 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.088107    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerName="discovery"
Jul 28 11:42:09.088196 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.088168    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e618ece2-5f77-4f22-a84a-4aedfde45f68" containerName="discovery"
Jul 28 11:42:09.093739 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.093707    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:09.096412 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.096370    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n7cv7\""
Jul 28 11:42:09.097478 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.097457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 11:42:09.097612 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.097457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 11:42:09.101361 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.101334    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:09.136495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.136465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:09.145879 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.145851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hmh\" (UniqueName: \"kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh\") pod \"kuadrant-operator-catalog-mlsxv\" (UID: \"e67fca2e-68ce-43c3-bc6c-1ef934aa489a\") " pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:09.246709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.246637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hmh\" (UniqueName: \"kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh\") pod \"kuadrant-operator-catalog-mlsxv\" (UID: \"e67fca2e-68ce-43c3-bc6c-1ef934aa489a\") " pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:09.256391 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.256354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hmh\" (UniqueName: \"kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh\") pod \"kuadrant-operator-catalog-mlsxv\" (UID: \"e67fca2e-68ce-43c3-bc6c-1ef934aa489a\") " pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:09.407222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.407188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:09.446403 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.445898    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:09.553834 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.553808    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:09.555628 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:09.555600    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67fca2e_68ce_43c3_bc6c_1ef934aa489a.slice/crio-a58e4e340f3be3f7ecef208b74b4914db7b4cf5ed132a1dea13f6e32cf000295 WatchSource:0}: Error finding container a58e4e340f3be3f7ecef208b74b4914db7b4cf5ed132a1dea13f6e32cf000295: Status 404 returned error can't find the container with id a58e4e340f3be3f7ecef208b74b4914db7b4cf5ed132a1dea13f6e32cf000295
Jul 28 11:42:09.656663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.656634    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7bbr"]
Jul 28 11:42:09.661069 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.661053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:09.668985 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.668959    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7bbr"]
Jul 28 11:42:09.753736 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.753700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfpdj\" (UniqueName: \"kubernetes.io/projected/2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf-kube-api-access-pfpdj\") pod \"kuadrant-operator-catalog-r7bbr\" (UID: \"2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf\") " pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:09.854425 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.854330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfpdj\" (UniqueName: \"kubernetes.io/projected/2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf-kube-api-access-pfpdj\") pod \"kuadrant-operator-catalog-r7bbr\" (UID: \"2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf\") " pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:09.863781 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.863758    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfpdj\" (UniqueName: \"kubernetes.io/projected/2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf-kube-api-access-pfpdj\") pod \"kuadrant-operator-catalog-r7bbr\" (UID: \"2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf\") " pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:09.879548 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.879516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:09.898544 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.898519    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" event={"ID":"e67fca2e-68ce-43c3-bc6c-1ef934aa489a","Type":"ContainerStarted","Data":"a58e4e340f3be3f7ecef208b74b4914db7b4cf5ed132a1dea13f6e32cf000295"}
Jul 28 11:42:09.971708 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:09.971684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:10.103258 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:10.103232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:10.103451 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:10.103432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7bbr"]
Jul 28 11:42:10.105422 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:10.105356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe23fea_eb9a_4660_a4b8_6b4f452e4bdf.slice/crio-4160d272957d80f036bb468ac57a2d03ef59acd7f9191c36f3bf90040a63aed0 WatchSource:0}: Error finding container 4160d272957d80f036bb468ac57a2d03ef59acd7f9191c36f3bf90040a63aed0: Status 404 returned error can't find the container with id 4160d272957d80f036bb468ac57a2d03ef59acd7f9191c36f3bf90040a63aed0
Jul 28 11:42:10.906240 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:10.906206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr" event={"ID":"2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf","Type":"ContainerStarted","Data":"4160d272957d80f036bb468ac57a2d03ef59acd7f9191c36f3bf90040a63aed0"}
Jul 28 11:42:11.913014 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:11.912976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" event={"ID":"e67fca2e-68ce-43c3-bc6c-1ef934aa489a","Type":"ContainerStarted","Data":"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"}
Jul 28 11:42:11.913521 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:11.912995    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" podUID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" containerName="registry-server" containerID="cri-o://9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618" gracePeriod=2
Jul 28 11:42:11.914617 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:11.914594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr" event={"ID":"2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf","Type":"ContainerStarted","Data":"f730a36c683a0531075cacfc373bbbe0ce162088506b886af405291494622845"}
Jul 28 11:42:11.928398 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:11.928292    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" podStartSLOduration=0.88901584 podStartE2EDuration="2.92827472s" totalImagesPullingTime="2.03925888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:11.927821645 +0000 UTC m=+695.116422669" watchObservedRunningTime="2026-07-28 11:42:11.92827472 +0000 UTC m=+695.116875732"
Jul 28 11:42:11.944007 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:11.943964    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr" podStartSLOduration=1.453555332 podStartE2EDuration="2.943951434s" totalImagesPullingTime="1.490396102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:11.942133289 +0000 UTC m=+695.130734316" watchObservedRunningTime="2026-07-28 11:42:11.943951434 +0000 UTC m=+695.132552431"
Jul 28 11:42:12.151765 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.151739    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:12.176746 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.176691    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96hmh\" (UniqueName: \"kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh\") pod \"e67fca2e-68ce-43c3-bc6c-1ef934aa489a\" (UID: \"e67fca2e-68ce-43c3-bc6c-1ef934aa489a\") "
Jul 28 11:42:12.178771 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.178749    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh" (OuterVolumeSpecName: "kube-api-access-96hmh") pod "e67fca2e-68ce-43c3-bc6c-1ef934aa489a" (UID: "e67fca2e-68ce-43c3-bc6c-1ef934aa489a"). InnerVolumeSpecName "kube-api-access-96hmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:42:12.277440 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.277408    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96hmh\" (UniqueName: \"kubernetes.io/projected/e67fca2e-68ce-43c3-bc6c-1ef934aa489a-kube-api-access-96hmh\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:12.771011 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.770973    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55995b4956-xhlgf"]
Jul 28 11:42:12.771334 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.771322    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" containerName="registry-server"
Jul 28 11:42:12.771411 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.771336    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" containerName="registry-server"
Jul 28 11:42:12.771457 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.771419    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" containerName="registry-server"
Jul 28 11:42:12.774480 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.774457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.776893 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.776869    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 11:42:12.777021 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.777005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 11:42:12.777980 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.777960    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 11:42:12.777980 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.777969    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 11:42:12.778147 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.777976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dzxgt\""
Jul 28 11:42:12.778147 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.777995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 11:42:12.784041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.784021    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55995b4956-xhlgf"]
Jul 28 11:42:12.784163 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.784038    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 11:42:12.820767 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.820728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:12.882806 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.882770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g42\" (UniqueName: \"kubernetes.io/projected/7dde145e-59c1-4ea2-ae81-09d8d8b95334-kube-api-access-78g42\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.882973 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.882814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.882973 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.882908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-service-ca\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.883090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.882968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-oauth-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.883090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.882995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.883090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.883019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-oauth-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.883090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.883050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-trusted-ca-bundle\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.921332 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921298    2573 generic.go:356] "Generic (PLEG): container finished" podID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" containerID="9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618" exitCode=0
Jul 28 11:42:12.921804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:12.921804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921496    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" event={"ID":"e67fca2e-68ce-43c3-bc6c-1ef934aa489a","Type":"ContainerDied","Data":"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"}
Jul 28 11:42:12.921804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921575    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv"
Jul 28 11:42:12.921804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921592    2573 scope.go:117] "RemoveContainer" containerID="9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"
Jul 28 11:42:12.921804 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.921580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mlsxv" event={"ID":"e67fca2e-68ce-43c3-bc6c-1ef934aa489a","Type":"ContainerDied","Data":"a58e4e340f3be3f7ecef208b74b4914db7b4cf5ed132a1dea13f6e32cf000295"}
Jul 28 11:42:12.931199 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.931184    2573 scope.go:117] "RemoveContainer" containerID="9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"
Jul 28 11:42:12.931455 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:42:12.931434    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618\": container with ID starting with 9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618 not found: ID does not exist" containerID="9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"
Jul 28 11:42:12.931497 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.931463    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618"} err="failed to get container status \"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618\": rpc error: code = NotFound desc = could not find container \"9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618\": container with ID starting with 9ec718897c79820163f34a574448c6715919cabcc2c6b70706563d78a6deb618 not found: ID does not exist"
Jul 28 11:42:12.944310 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.944285    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:12.948262 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.948237    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mlsxv"]
Jul 28 11:42:12.983897 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.983865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-service-ca\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.983902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-oauth-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.983920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.983939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-oauth-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.983965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-trusted-ca-bundle\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984032 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78g42\" (UniqueName: \"kubernetes.io/projected/7dde145e-59c1-4ea2-ae81-09d8d8b95334-kube-api-access-78g42\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984742 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984713    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-service-ca\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984742 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-oauth-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984880 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984772    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.984991 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.984971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde145e-59c1-4ea2-ae81-09d8d8b95334-trusted-ca-bundle\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.986411 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.986373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-oauth-config\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.986604 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.986587    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde145e-59c1-4ea2-ae81-09d8d8b95334-console-serving-cert\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:12.994524 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:12.994505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g42\" (UniqueName: \"kubernetes.io/projected/7dde145e-59c1-4ea2-ae81-09d8d8b95334-kube-api-access-78g42\") pod \"console-55995b4956-xhlgf\" (UID: \"7dde145e-59c1-4ea2-ae81-09d8d8b95334\") " pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:13.025139 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.025099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:13.086249 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.086208    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:13.129148 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.129116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:13.222795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.222769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55995b4956-xhlgf"]
Jul 28 11:42:13.225115 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:13.225094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dde145e_59c1_4ea2_ae81_09d8d8b95334.slice/crio-4b355e6745c9902d58326d63e256fc017460d44727a31a88ecb7c41f7f222a37 WatchSource:0}: Error finding container 4b355e6745c9902d58326d63e256fc017460d44727a31a88ecb7c41f7f222a37: Status 404 returned error can't find the container with id 4b355e6745c9902d58326d63e256fc017460d44727a31a88ecb7c41f7f222a37
Jul 28 11:42:13.267008 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.266976    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67fca2e-68ce-43c3-bc6c-1ef934aa489a" path="/var/lib/kubelet/pods/e67fca2e-68ce-43c3-bc6c-1ef934aa489a/volumes"
Jul 28 11:42:13.564984 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.564882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:13.927507 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.927470    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55995b4956-xhlgf" event={"ID":"7dde145e-59c1-4ea2-ae81-09d8d8b95334","Type":"ContainerStarted","Data":"be62713e73acdaea1a0b4e8abb3a7105454a1ede693fd56bfde1970bedef9ed1"}
Jul 28 11:42:13.927964 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.927528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55995b4956-xhlgf" event={"ID":"7dde145e-59c1-4ea2-ae81-09d8d8b95334","Type":"ContainerStarted","Data":"4b355e6745c9902d58326d63e256fc017460d44727a31a88ecb7c41f7f222a37"}
Jul 28 11:42:13.946545 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:13.946496    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55995b4956-xhlgf" podStartSLOduration=1.9464804610000002 podStartE2EDuration="1.946480461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:13.944916955 +0000 UTC m=+697.133517980" watchObservedRunningTime="2026-07-28 11:42:13.946480461 +0000 UTC m=+697.135081458"
Jul 28 11:42:19.971949 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:19.971916    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:19.972442 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:19.971996    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:19.993139 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:19.993113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:20.982485 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:20.982456    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r7bbr"
Jul 28 11:42:22.137112 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:22.137081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:23.086881 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:23.086849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:23.087116 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:23.087100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:23.091429 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:23.091406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:23.979885 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:23.979857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55995b4956-xhlgf"
Jul 28 11:42:24.092691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.092660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:24.193308 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.193275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:24.293264 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.293175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:24.351296 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.351263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:24.956144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.956109    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"]
Jul 28 11:42:24.960717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.960699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:24.966196 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.966169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v6kx8\""
Jul 28 11:42:24.984300 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:24.984274    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"]
Jul 28 11:42:25.088161 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.088130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.088331 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.088226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.088465 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.088437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxv74\" (UniqueName: \"kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.189828 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.189792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.189962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.189865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.189962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.189891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxv74\" (UniqueName: \"kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.190157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.190137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.190218 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.190200    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.197956 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.197926    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxv74\" (UniqueName: \"kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.270522 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.270452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:25.399519 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.399495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"]
Jul 28 11:42:25.401196 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:25.401166    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f35a47_bd7d_42e0_b835_98970ddb36cb.slice/crio-e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e WatchSource:0}: Error finding container e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e: Status 404 returned error can't find the container with id e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e
Jul 28 11:42:25.693650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.693617    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"]
Jul 28 11:42:25.697143 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.697123    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.707306 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.707280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"]
Jul 28 11:42:25.796163 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.796077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.796163 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.796130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65v2l\" (UniqueName: \"kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.796362 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.796212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.897443 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.897376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65v2l\" (UniqueName: \"kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.897623 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.897536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.897623 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.897611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.897979 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.897957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.898015 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.897974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.906456 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.906425    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65v2l\" (UniqueName: \"kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:25.987295 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.987256    2573 generic.go:356] "Generic (PLEG): container finished" podID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerID="712adf1dd0f23803c29163997ec9865802e492ea3fe6166e1da3ab061cbfc96f" exitCode=0
Jul 28 11:42:25.987950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.987343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn" event={"ID":"58f35a47-bd7d-42e0-b835-98970ddb36cb","Type":"ContainerDied","Data":"712adf1dd0f23803c29163997ec9865802e492ea3fe6166e1da3ab061cbfc96f"}
Jul 28 11:42:25.987950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:25.987414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn" event={"ID":"58f35a47-bd7d-42e0-b835-98970ddb36cb","Type":"ContainerStarted","Data":"e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e"}
Jul 28 11:42:26.006992 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.006970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:26.093111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.093080    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"]
Jul 28 11:42:26.097807 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.097782    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.106755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.106727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"]
Jul 28 11:42:26.137751 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.137723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"]
Jul 28 11:42:26.138988 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:26.138962    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac32d02_e26f_464a_9996_30890d9f4e1b.slice/crio-99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f WatchSource:0}: Error finding container 99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f: Status 404 returned error can't find the container with id 99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f
Jul 28 11:42:26.200279 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.200253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.200375 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.200297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b66n\" (UniqueName: \"kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.200472 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.200448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.301736 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.301703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b66n\" (UniqueName: \"kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.301874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.301770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.301874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.301806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.302146 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.302130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.302184 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.302155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.309955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.309902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b66n\" (UniqueName: \"kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.411635 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.411606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:26.487509 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.487479    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"]
Jul 28 11:42:26.492264 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.492240    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.501081 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.501011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"]
Jul 28 11:42:26.545072 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.545033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"]
Jul 28 11:42:26.547757 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:26.547733    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45428e3a_88a6_43ca_80a0_918885efb3b1.slice/crio-6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247 WatchSource:0}: Error finding container 6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247: Status 404 returned error can't find the container with id 6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247
Jul 28 11:42:26.604491 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.604467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.604596 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.604554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.604596 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.604584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256gs\" (UniqueName: \"kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.705661 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.705635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.705763 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.705674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256gs\" (UniqueName: \"kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.705763 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.705733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.706031 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.706009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.706096 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.706068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.723582 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.723547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-256gs\" (UniqueName: \"kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.805465 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.805435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:26.934616 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.934580    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"]
Jul 28 11:42:26.936722 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:26.936699    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4ba2cc_080c_4663_b5d2_e685d3ace874.slice/crio-6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a WatchSource:0}: Error finding container 6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a: Status 404 returned error can't find the container with id 6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a
Jul 28 11:42:26.994094 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.994068    2573 generic.go:356] "Generic (PLEG): container finished" podID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerID="388f606c40368027c65d1966beb5714a38ab80527e11805bec9fd18fe0d6af6b" exitCode=0
Jul 28 11:42:26.994470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.994143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn" event={"ID":"58f35a47-bd7d-42e0-b835-98970ddb36cb","Type":"ContainerDied","Data":"388f606c40368027c65d1966beb5714a38ab80527e11805bec9fd18fe0d6af6b"}
Jul 28 11:42:26.995656 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.995638    2573 generic.go:356] "Generic (PLEG): container finished" podID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerID="d00a58eef47888236bea0392bb8abf3f65eeb03af21c5b0c024e9d8cefb6bb99" exitCode=0
Jul 28 11:42:26.995741 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.995704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2" event={"ID":"45428e3a-88a6-43ca-80a0-918885efb3b1","Type":"ContainerDied","Data":"d00a58eef47888236bea0392bb8abf3f65eeb03af21c5b0c024e9d8cefb6bb99"}
Jul 28 11:42:26.995808 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.995740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2" event={"ID":"45428e3a-88a6-43ca-80a0-918885efb3b1","Type":"ContainerStarted","Data":"6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247"}
Jul 28 11:42:26.997497 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.997470    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerID="0ee3c10a64babcd0c98993207e41745a1d99cafd35c3e8b4a25655d703ded2af" exitCode=0
Jul 28 11:42:26.997635 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.997550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerDied","Data":"0ee3c10a64babcd0c98993207e41745a1d99cafd35c3e8b4a25655d703ded2af"}
Jul 28 11:42:26.997635 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.997601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerStarted","Data":"99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f"}
Jul 28 11:42:26.999530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.999508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerStarted","Data":"e3ed4fd3fc5fa91022d5c79750a907290ca946ff1b02798e1c70531b38a567af"}
Jul 28 11:42:26.999588 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:26.999557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerStarted","Data":"6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a"}
Jul 28 11:42:28.006681 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.006648    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerID="e3ed4fd3fc5fa91022d5c79750a907290ca946ff1b02798e1c70531b38a567af" exitCode=0
Jul 28 11:42:28.007041 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.006740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerDied","Data":"e3ed4fd3fc5fa91022d5c79750a907290ca946ff1b02798e1c70531b38a567af"}
Jul 28 11:42:28.009440 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.009415    2573 generic.go:356] "Generic (PLEG): container finished" podID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerID="6f83e4a939720ef87dd1d6ce2a8c695b7667b0744535d100f368ee68f24c3674" exitCode=0
Jul 28 11:42:28.009568 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.009491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn" event={"ID":"58f35a47-bd7d-42e0-b835-98970ddb36cb","Type":"ContainerDied","Data":"6f83e4a939720ef87dd1d6ce2a8c695b7667b0744535d100f368ee68f24c3674"}
Jul 28 11:42:28.011491 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.011461    2573 generic.go:356] "Generic (PLEG): container finished" podID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerID="b80ce08d2e212fea31abab0b4faf858f174c6e18da0efb63e6bbc743a8cc34f7" exitCode=0
Jul 28 11:42:28.011599 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.011542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2" event={"ID":"45428e3a-88a6-43ca-80a0-918885efb3b1","Type":"ContainerDied","Data":"b80ce08d2e212fea31abab0b4faf858f174c6e18da0efb63e6bbc743a8cc34f7"}
Jul 28 11:42:28.013732 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:28.013709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerStarted","Data":"2cb60727d1716b236ecd1f9351e176044afbedaa3d025de35478785861066819"}
Jul 28 11:42:29.023258 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.023165    2573 generic.go:356] "Generic (PLEG): container finished" podID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerID="6009ee2059bd0dc307cf4a8976f5dca774bb66b8994471c74efe3bf7b35f41cb" exitCode=0
Jul 28 11:42:29.023862 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.023264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2" event={"ID":"45428e3a-88a6-43ca-80a0-918885efb3b1","Type":"ContainerDied","Data":"6009ee2059bd0dc307cf4a8976f5dca774bb66b8994471c74efe3bf7b35f41cb"}
Jul 28 11:42:29.025346 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.025316    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerID="2cb60727d1716b236ecd1f9351e176044afbedaa3d025de35478785861066819" exitCode=0
Jul 28 11:42:29.025573 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.025405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerDied","Data":"2cb60727d1716b236ecd1f9351e176044afbedaa3d025de35478785861066819"}
Jul 28 11:42:29.027721 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.027696    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerID="56686c09207b69ac8a7b467e2d81a855356c4f1d0c955ddd1ffa65a2fe10ad39" exitCode=0
Jul 28 11:42:29.027852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.027786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerDied","Data":"56686c09207b69ac8a7b467e2d81a855356c4f1d0c955ddd1ffa65a2fe10ad39"}
Jul 28 11:42:29.172200 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.172174    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:29.229372 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.229344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util\") pod \"58f35a47-bd7d-42e0-b835-98970ddb36cb\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") "
Jul 28 11:42:29.229489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.229409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle\") pod \"58f35a47-bd7d-42e0-b835-98970ddb36cb\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") "
Jul 28 11:42:29.229489 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.229444    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxv74\" (UniqueName: \"kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74\") pod \"58f35a47-bd7d-42e0-b835-98970ddb36cb\" (UID: \"58f35a47-bd7d-42e0-b835-98970ddb36cb\") "
Jul 28 11:42:29.230021 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.229995    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle" (OuterVolumeSpecName: "bundle") pod "58f35a47-bd7d-42e0-b835-98970ddb36cb" (UID: "58f35a47-bd7d-42e0-b835-98970ddb36cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:29.231410 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.231371    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74" (OuterVolumeSpecName: "kube-api-access-lxv74") pod "58f35a47-bd7d-42e0-b835-98970ddb36cb" (UID: "58f35a47-bd7d-42e0-b835-98970ddb36cb"). InnerVolumeSpecName "kube-api-access-lxv74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:42:29.234642 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.234608    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util" (OuterVolumeSpecName: "util") pod "58f35a47-bd7d-42e0-b835-98970ddb36cb" (UID: "58f35a47-bd7d-42e0-b835-98970ddb36cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:29.330571 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.330546    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxv74\" (UniqueName: \"kubernetes.io/projected/58f35a47-bd7d-42e0-b835-98970ddb36cb-kube-api-access-lxv74\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:29.330571 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.330568    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:29.330728 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:29.330579    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58f35a47-bd7d-42e0-b835-98970ddb36cb-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:30.034452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.034423    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn"
Jul 28 11:42:30.034452 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.034430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn" event={"ID":"58f35a47-bd7d-42e0-b835-98970ddb36cb","Type":"ContainerDied","Data":"e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e"}
Jul 28 11:42:30.034930 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.034482    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e951185fcaba32759b76006dd407ab557d3e80516892c6e1ae2ba6dd7face93e"
Jul 28 11:42:30.036814 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.036787    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerID="8f68434fe230b1dcde83c0e25dc4217f04b8046360a84acf8cb0c0811c792fd2" exitCode=0
Jul 28 11:42:30.036915 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.036903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerDied","Data":"8f68434fe230b1dcde83c0e25dc4217f04b8046360a84acf8cb0c0811c792fd2"}
Jul 28 11:42:30.039047 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.039024    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerID="a2451ef7eb66c199ae4adea19980a4ec79f8d950a5afc040c96c424fd4a0232d" exitCode=0
Jul 28 11:42:30.039175 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.039104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerDied","Data":"a2451ef7eb66c199ae4adea19980a4ec79f8d950a5afc040c96c424fd4a0232d"}
Jul 28 11:42:30.172548 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.172524    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:30.238580 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.238545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle\") pod \"45428e3a-88a6-43ca-80a0-918885efb3b1\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") "
Jul 28 11:42:30.238748 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.238588    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b66n\" (UniqueName: \"kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n\") pod \"45428e3a-88a6-43ca-80a0-918885efb3b1\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") "
Jul 28 11:42:30.238748 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.238620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util\") pod \"45428e3a-88a6-43ca-80a0-918885efb3b1\" (UID: \"45428e3a-88a6-43ca-80a0-918885efb3b1\") "
Jul 28 11:42:30.239111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.239086    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle" (OuterVolumeSpecName: "bundle") pod "45428e3a-88a6-43ca-80a0-918885efb3b1" (UID: "45428e3a-88a6-43ca-80a0-918885efb3b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:30.240651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.240628    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n" (OuterVolumeSpecName: "kube-api-access-9b66n") pod "45428e3a-88a6-43ca-80a0-918885efb3b1" (UID: "45428e3a-88a6-43ca-80a0-918885efb3b1"). InnerVolumeSpecName "kube-api-access-9b66n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:42:30.246591 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.246567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util" (OuterVolumeSpecName: "util") pod "45428e3a-88a6-43ca-80a0-918885efb3b1" (UID: "45428e3a-88a6-43ca-80a0-918885efb3b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:30.339883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.339785    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:30.339883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.339831    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b66n\" (UniqueName: \"kubernetes.io/projected/45428e3a-88a6-43ca-80a0-918885efb3b1-kube-api-access-9b66n\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:30.339883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:30.339842    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45428e3a-88a6-43ca-80a0-918885efb3b1-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.049613 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.049581    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2"
Jul 28 11:42:31.049613 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.049597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2" event={"ID":"45428e3a-88a6-43ca-80a0-918885efb3b1","Type":"ContainerDied","Data":"6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247"}
Jul 28 11:42:31.050118 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.049642    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c632324c0b573391c69a3a3030a0aef79a5f979403981ba96cb50758879b247"
Jul 28 11:42:31.190322 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.190299    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:31.215901 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.215879    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:31.246872 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.246849    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65v2l\" (UniqueName: \"kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l\") pod \"5ac32d02-e26f-464a-9996-30890d9f4e1b\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") "
Jul 28 11:42:31.246999 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.246934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle\") pod \"5ac32d02-e26f-464a-9996-30890d9f4e1b\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") "
Jul 28 11:42:31.246999 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.246957    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util\") pod \"5ac32d02-e26f-464a-9996-30890d9f4e1b\" (UID: \"5ac32d02-e26f-464a-9996-30890d9f4e1b\") "
Jul 28 11:42:31.247424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.247377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle" (OuterVolumeSpecName: "bundle") pod "5ac32d02-e26f-464a-9996-30890d9f4e1b" (UID: "5ac32d02-e26f-464a-9996-30890d9f4e1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:31.248926 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.248900    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l" (OuterVolumeSpecName: "kube-api-access-65v2l") pod "5ac32d02-e26f-464a-9996-30890d9f4e1b" (UID: "5ac32d02-e26f-464a-9996-30890d9f4e1b"). InnerVolumeSpecName "kube-api-access-65v2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:42:31.252461 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.252437    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util" (OuterVolumeSpecName: "util") pod "5ac32d02-e26f-464a-9996-30890d9f4e1b" (UID: "5ac32d02-e26f-464a-9996-30890d9f4e1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:31.348338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-256gs\" (UniqueName: \"kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs\") pod \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") "
Jul 28 11:42:31.348338 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle\") pod \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") "
Jul 28 11:42:31.348551 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348426    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util\") pod \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\" (UID: \"2e4ba2cc-080c-4663-b5d2-e685d3ace874\") "
Jul 28 11:42:31.348943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348732    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.348943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348754    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac32d02-e26f-464a-9996-30890d9f4e1b-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.348943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348767    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65v2l\" (UniqueName: \"kubernetes.io/projected/5ac32d02-e26f-464a-9996-30890d9f4e1b-kube-api-access-65v2l\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.349139 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.348989    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle" (OuterVolumeSpecName: "bundle") pod "2e4ba2cc-080c-4663-b5d2-e685d3ace874" (UID: "2e4ba2cc-080c-4663-b5d2-e685d3ace874"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:31.350581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.350560    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs" (OuterVolumeSpecName: "kube-api-access-256gs") pod "2e4ba2cc-080c-4663-b5d2-e685d3ace874" (UID: "2e4ba2cc-080c-4663-b5d2-e685d3ace874"). InnerVolumeSpecName "kube-api-access-256gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:42:31.353668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.353638    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util" (OuterVolumeSpecName: "util") pod "2e4ba2cc-080c-4663-b5d2-e685d3ace874" (UID: "2e4ba2cc-080c-4663-b5d2-e685d3ace874"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:42:31.449280 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.449251    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-256gs\" (UniqueName: \"kubernetes.io/projected/2e4ba2cc-080c-4663-b5d2-e685d3ace874-kube-api-access-256gs\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.449280 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.449277    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:31.449454 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:31.449289    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4ba2cc-080c-4663-b5d2-e685d3ace874-util\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:42:32.056774 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.056744    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7"
Jul 28 11:42:32.056774 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.056753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7" event={"ID":"5ac32d02-e26f-464a-9996-30890d9f4e1b","Type":"ContainerDied","Data":"99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f"}
Jul 28 11:42:32.057226 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.056833    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99387d7e838438b81cda9291663ae42ab653db362417dc0aa991edd999cb7a2f"
Jul 28 11:42:32.058699 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.058671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4" event={"ID":"2e4ba2cc-080c-4663-b5d2-e685d3ace874","Type":"ContainerDied","Data":"6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a"}
Jul 28 11:42:32.058844 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.058715    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6184877ee6d753f360f052afdbb7f105f840084d54a0ffe5df096f0b68942a5a"
Jul 28 11:42:32.058844 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:32.058738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4"
Jul 28 11:42:38.162424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:38.162360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:41.598602 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:41.598568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:42.952269 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952239    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"]
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952602    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="util"
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952613    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="util"
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952623    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="pull"
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952628    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="pull"
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952638    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="extract"
Jul 28 11:42:42.952643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952643    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952652    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952658    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952664    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952669    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952676    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952682    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952694    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952701    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952707    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952712    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952717    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952725    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952730    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="pull"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952735    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952740    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952746    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952751    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="util"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952801    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac32d02-e26f-464a-9996-30890d9f4e1b" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952810    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f35a47-bd7d-42e0-b835-98970ddb36cb" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952818    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="45428e3a-88a6-43ca-80a0-918885efb3b1" containerName="extract"
Jul 28 11:42:42.952852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.952826    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e4ba2cc-080c-4663-b5d2-e685d3ace874" containerName="extract"
Jul 28 11:42:42.960717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.960696    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:42.963230 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.963207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ljvfk\""
Jul 28 11:42:42.973194 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:42.973174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"]
Jul 28 11:42:43.049641 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.049614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.049766 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.049668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2428\" (UniqueName: \"kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.150423 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.150370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2428\" (UniqueName: \"kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.150563 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.150468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.150797 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.150781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.168132 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.168098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2428\" (UniqueName: \"kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.270166 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.270100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:43.408647 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.408625    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"]
Jul 28 11:42:43.410895 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:43.410871    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46028fcb_c459_40f2_91e9_65f24340b6e2.slice/crio-b4c09d566d168d5be84f790f2b6f0d542388c4b1630e6f51c3d5692a8c9b944a WatchSource:0}: Error finding container b4c09d566d168d5be84f790f2b6f0d542388c4b1630e6f51c3d5692a8c9b944a: Status 404 returned error can't find the container with id b4c09d566d168d5be84f790f2b6f0d542388c4b1630e6f51c3d5692a8c9b944a
Jul 28 11:42:43.566156 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:43.566078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:44.121304 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.121262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w" event={"ID":"46028fcb-c459-40f2-91e9-65f24340b6e2","Type":"ContainerStarted","Data":"b4c09d566d168d5be84f790f2b6f0d542388c4b1630e6f51c3d5692a8c9b944a"}
Jul 28 11:42:44.867467 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.867429    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"]
Jul 28 11:42:44.871091 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.871075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:44.874930 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.874908    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 11:42:44.875048 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.874945    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vn2mh\""
Jul 28 11:42:44.890985 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.890956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"]
Jul 28 11:42:44.966843 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:44.966808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4m9q\" (UniqueName: \"kubernetes.io/projected/12e8ef80-2bf9-47d1-9d4d-214d3b131957-kube-api-access-t4m9q\") pod \"dns-operator-controller-manager-864dd78c4c-7xct5\" (UID: \"12e8ef80-2bf9-47d1-9d4d-214d3b131957\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:45.068078 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.068035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4m9q\" (UniqueName: \"kubernetes.io/projected/12e8ef80-2bf9-47d1-9d4d-214d3b131957-kube-api-access-t4m9q\") pod \"dns-operator-controller-manager-864dd78c4c-7xct5\" (UID: \"12e8ef80-2bf9-47d1-9d4d-214d3b131957\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:45.080668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.080633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4m9q\" (UniqueName: \"kubernetes.io/projected/12e8ef80-2bf9-47d1-9d4d-214d3b131957-kube-api-access-t4m9q\") pod \"dns-operator-controller-manager-864dd78c4c-7xct5\" (UID: \"12e8ef80-2bf9-47d1-9d4d-214d3b131957\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:45.149167 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.149134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:45.183173 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.183141    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:45.331813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.331790    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"]
Jul 28 11:42:45.334401 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:45.334355    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e8ef80_2bf9_47d1_9d4d_214d3b131957.slice/crio-630882917c185f80fbe4f091f30ca7dbba2acbeb82a5d51c3019754e653079d7 WatchSource:0}: Error finding container 630882917c185f80fbe4f091f30ca7dbba2acbeb82a5d51c3019754e653079d7: Status 404 returned error can't find the container with id 630882917c185f80fbe4f091f30ca7dbba2acbeb82a5d51c3019754e653079d7
Jul 28 11:42:45.419857 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.419780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:45.570344 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:45.570307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:46.135134 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:46.135042    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5" event={"ID":"12e8ef80-2bf9-47d1-9d4d-214d3b131957","Type":"ContainerStarted","Data":"630882917c185f80fbe4f091f30ca7dbba2acbeb82a5d51c3019754e653079d7"}
Jul 28 11:42:48.212573 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.212550    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"]
Jul 28 11:42:48.215934 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.215917    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:48.219344 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.219322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qz4c6\""
Jul 28 11:42:48.225332 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.225311    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"]
Jul 28 11:42:48.400807 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.400773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfh6\" (UniqueName: \"kubernetes.io/projected/0bf16519-53c3-4d3a-8d36-c03e2be44e38-kube-api-access-rdfh6\") pod \"authorino-operator-75cc8d5cb7-ksms2\" (UID: \"0bf16519-53c3-4d3a-8d36-c03e2be44e38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:48.501284 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.501236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfh6\" (UniqueName: \"kubernetes.io/projected/0bf16519-53c3-4d3a-8d36-c03e2be44e38-kube-api-access-rdfh6\") pod \"authorino-operator-75cc8d5cb7-ksms2\" (UID: \"0bf16519-53c3-4d3a-8d36-c03e2be44e38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:48.514938 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.514908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfh6\" (UniqueName: \"kubernetes.io/projected/0bf16519-53c3-4d3a-8d36-c03e2be44e38-kube-api-access-rdfh6\") pod \"authorino-operator-75cc8d5cb7-ksms2\" (UID: \"0bf16519-53c3-4d3a-8d36-c03e2be44e38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:48.525737 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.525713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:48.676314 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.676289    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"]
Jul 28 11:42:48.677639 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:48.677613    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf16519_53c3_4d3a_8d36_c03e2be44e38.slice/crio-853acabf01d71d0fdab38f2f5fe5d8989f9ea69172e6c63097d5758a958dbd8b WatchSource:0}: Error finding container 853acabf01d71d0fdab38f2f5fe5d8989f9ea69172e6c63097d5758a958dbd8b: Status 404 returned error can't find the container with id 853acabf01d71d0fdab38f2f5fe5d8989f9ea69172e6c63097d5758a958dbd8b
Jul 28 11:42:48.761591 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:48.761560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:49.092962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.092876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:49.154185 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.154152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w" event={"ID":"46028fcb-c459-40f2-91e9-65f24340b6e2","Type":"ContainerStarted","Data":"84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1"}
Jul 28 11:42:49.154361 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.154220    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:42:49.155440 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.155418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2" event={"ID":"0bf16519-53c3-4d3a-8d36-c03e2be44e38","Type":"ContainerStarted","Data":"853acabf01d71d0fdab38f2f5fe5d8989f9ea69172e6c63097d5758a958dbd8b"}
Jul 28 11:42:49.156967 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.156947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5" event={"ID":"12e8ef80-2bf9-47d1-9d4d-214d3b131957","Type":"ContainerStarted","Data":"2daa0ed94f266d30c1f8859387e19fbf17b4198a006a1858aac22f874bf5d28e"}
Jul 28 11:42:49.157077 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.157064    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:42:49.180554 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.180512    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w" podStartSLOduration=2.497851594 podStartE2EDuration="7.18049673s" totalImagesPullingTime="4.682645136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:49.178924488 +0000 UTC m=+732.367525498" watchObservedRunningTime="2026-07-28 11:42:49.18049673 +0000 UTC m=+732.369097727"
Jul 28 11:42:49.193248 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.193225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:49.209627 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:49.209590    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5" podStartSLOduration=2.396884753 podStartE2EDuration="5.209577793s" totalImagesPullingTime="2.81269304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:49.206202803 +0000 UTC m=+732.394803799" watchObservedRunningTime="2026-07-28 11:42:49.209577793 +0000 UTC m=+732.398178791"
Jul 28 11:42:50.806258 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:50.806224    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"]
Jul 28 11:42:50.815884 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:50.815851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:50.818725 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:50.818686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7bmcc\""
Jul 28 11:42:50.818932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:50.818900    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"]
Jul 28 11:42:50.925523 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:50.925483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7c9\" (UniqueName: \"kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9\") pod \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" (UID: \"b9f8cdef-3dd1-49da-a646-178e06334099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:51.026759 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.026734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7c9\" (UniqueName: \"kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9\") pod \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" (UID: \"b9f8cdef-3dd1-49da-a646-178e06334099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:51.043487 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.043458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7c9\" (UniqueName: \"kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9\") pod \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" (UID: \"b9f8cdef-3dd1-49da-a646-178e06334099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:51.130634 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.130602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:51.171640 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.171601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2" event={"ID":"0bf16519-53c3-4d3a-8d36-c03e2be44e38","Type":"ContainerStarted","Data":"c7ddb904fd3116f1b3fb6a88b0355c7fe8c8795b0ea8b361c2b488e9fa75ed7f"}
Jul 28 11:42:51.171821 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.171780    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:42:51.191116 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.191072    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2" podStartSLOduration=0.865894905 podStartE2EDuration="3.191054943s" totalImagesPullingTime="2.325160038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:51.190269511 +0000 UTC m=+734.378870536" watchObservedRunningTime="2026-07-28 11:42:51.191054943 +0000 UTC m=+734.379655939"
Jul 28 11:42:51.261547 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.261508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:51.272279 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.272240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"]
Jul 28 11:42:51.274676 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:42:51.274651    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f8cdef_3dd1_49da_a646_178e06334099.slice/crio-e4515b7557a2f2b8b5949a118b7b30d1d5dc0f34c19c84c61764094bcb520056 WatchSource:0}: Error finding container e4515b7557a2f2b8b5949a118b7b30d1d5dc0f34c19c84c61764094bcb520056: Status 404 returned error can't find the container with id e4515b7557a2f2b8b5949a118b7b30d1d5dc0f34c19c84c61764094bcb520056
Jul 28 11:42:51.478054 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:51.478021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:52.053301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:52.053266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:52.179393 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:52.179347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd" event={"ID":"b9f8cdef-3dd1-49da-a646-178e06334099","Type":"ContainerStarted","Data":"e4515b7557a2f2b8b5949a118b7b30d1d5dc0f34c19c84c61764094bcb520056"}
Jul 28 11:42:53.159660 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:53.159628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:42:53.186590 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:53.186503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd" event={"ID":"b9f8cdef-3dd1-49da-a646-178e06334099","Type":"ContainerStarted","Data":"2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487"}
Jul 28 11:42:53.186734 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:53.186589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:42:53.204394 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:53.204349    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd" podStartSLOduration=1.569918211 podStartE2EDuration="3.204335806s" totalImagesPullingTime="1.634417595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:42:53.202438577 +0000 UTC m=+736.391039593" watchObservedRunningTime="2026-07-28 11:42:53.204335806 +0000 UTC m=+736.392936802"
Jul 28 11:42:53.261643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:42:53.261614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:00.165935 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:00.165900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7xct5"
Jul 28 11:43:00.166341 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:00.166034    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:00.831031 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:00.830996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:00.931355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:00.931323    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:01.924486 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.924450    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"]
Jul 28 11:43:01.924894 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.924650    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" containerName="manager" containerID="cri-o://84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1" gracePeriod=2
Jul 28 11:43:01.933105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.933062    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"]
Jul 28 11:43:01.935374 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.935332    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"46028fcb-c459-40f2-91e9-65f24340b6e2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:01.945337 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.945309    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"]
Jul 28 11:43:01.945592 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.945541    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" containerName="manager" containerID="cri-o://2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487" gracePeriod=2
Jul 28 11:43:01.947613 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.947578    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:01.947893 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.947861    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:01.949858 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.949834    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:01.950460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.950323    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" containerName="manager"
Jul 28 11:43:01.950460 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.950345    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" containerName="manager"
Jul 28 11:43:01.950600 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.950477    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" containerName="manager"
Jul 28 11:43:01.954581 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.954543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:01.958015 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.957991    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"]
Jul 28 11:43:01.959207 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.959178    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b9f8cdef-3dd1-49da-a646-178e06334099\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-gqjqd\": pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:01.961961 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.961935    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:01.968423 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.968398    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:01.980937 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.980915    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"]
Jul 28 11:43:01.981286 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.981273    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" containerName="manager"
Jul 28 11:43:01.981331 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.981288    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" containerName="manager"
Jul 28 11:43:01.981363 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.981351    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" containerName="manager"
Jul 28 11:43:01.984262 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.984245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:01.994889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:01.994865    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"]
Jul 28 11:43:01.997273 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.997246    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:01.999513 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:01.999489    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.018076 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.018043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6hd\" (UniqueName: \"kubernetes.io/projected/2299de78-e7c5-4903-a7f1-c3092e2c4e23-kube-api-access-rv6hd\") pod \"limitador-operator-controller-manager-859d7b78bd-bbk6n\" (UID: \"2299de78-e7c5-4903-a7f1-c3092e2c4e23\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:02.018191 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.018099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.018270 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.018251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btj2z\" (UniqueName: \"kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.021545 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.021516    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.119164 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.119129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btj2z\" (UniqueName: \"kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.119310 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.119197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6hd\" (UniqueName: \"kubernetes.io/projected/2299de78-e7c5-4903-a7f1-c3092e2c4e23-kube-api-access-rv6hd\") pod \"limitador-operator-controller-manager-859d7b78bd-bbk6n\" (UID: \"2299de78-e7c5-4903-a7f1-c3092e2c4e23\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:02.119310 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.119245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.119709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.119675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.128923 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.128856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6hd\" (UniqueName: \"kubernetes.io/projected/2299de78-e7c5-4903-a7f1-c3092e2c4e23-kube-api-access-rv6hd\") pod \"limitador-operator-controller-manager-859d7b78bd-bbk6n\" (UID: \"2299de78-e7c5-4903-a7f1-c3092e2c4e23\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:02.130247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.130221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btj2z\" (UniqueName: \"kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dj7pv\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.181474 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.181358    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksms2"
Jul 28 11:43:02.183742 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.183710    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.184579 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.184562    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.185626 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.185602    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.186516 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.186500    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.208978 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.208950    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.210866 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.210844    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.220166 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.220143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7c9\" (UniqueName: \"kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9\") pod \"b9f8cdef-3dd1-49da-a646-178e06334099\" (UID: \"b9f8cdef-3dd1-49da-a646-178e06334099\") "
Jul 28 11:43:02.220276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.220203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume\") pod \"46028fcb-c459-40f2-91e9-65f24340b6e2\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") "
Jul 28 11:43:02.220276 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.220229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2428\" (UniqueName: \"kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428\") pod \"46028fcb-c459-40f2-91e9-65f24340b6e2\" (UID: \"46028fcb-c459-40f2-91e9-65f24340b6e2\") "
Jul 28 11:43:02.220857 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.220829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46028fcb-c459-40f2-91e9-65f24340b6e2" (UID: "46028fcb-c459-40f2-91e9-65f24340b6e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:43:02.222334 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.222307    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9" (OuterVolumeSpecName: "kube-api-access-mv7c9") pod "b9f8cdef-3dd1-49da-a646-178e06334099" (UID: "b9f8cdef-3dd1-49da-a646-178e06334099"). InnerVolumeSpecName "kube-api-access-mv7c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:43:02.222500 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.222480    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428" (OuterVolumeSpecName: "kube-api-access-p2428") pod "46028fcb-c459-40f2-91e9-65f24340b6e2" (UID: "46028fcb-c459-40f2-91e9-65f24340b6e2"). InnerVolumeSpecName "kube-api-access-p2428". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:43:02.237910 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.237883    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9f8cdef-3dd1-49da-a646-178e06334099" containerID="2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487" exitCode=0
Jul 28 11:43:02.237999 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.237941    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.237999 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.237982    2573 scope.go:117] "RemoveContainer" containerID="2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487"
Jul 28 11:43:02.239923 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.239900    2573 generic.go:356] "Generic (PLEG): container finished" podID="46028fcb-c459-40f2-91e9-65f24340b6e2" containerID="84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1" exitCode=0
Jul 28 11:43:02.240039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.239934    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.240652 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.240625    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.242755 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.242726    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.244771 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.244746    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.246697 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.246646    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.248814 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.248798    2573 scope.go:117] "RemoveContainer" containerID="2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487"
Jul 28 11:43:02.249092 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.249073    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487\": container with ID starting with 2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487 not found: ID does not exist" containerID="2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487"
Jul 28 11:43:02.249181 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.249103    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487"} err="failed to get container status \"2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487\": rpc error: code = NotFound desc = could not find container \"2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487\": container with ID starting with 2a2d2ea3387059a33e62d6ce11f3a9f8a2a4fc2f7b2bbb8383ef6e99e925a487 not found: ID does not exist"
Jul 28 11:43:02.249181 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.249125    2573 scope.go:117] "RemoveContainer" containerID="84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1"
Jul 28 11:43:02.253556 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.253529    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.255609 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.255585    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.257768 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.257742    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:02.258150 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.258134    2573 scope.go:117] "RemoveContainer" containerID="84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1"
Jul 28 11:43:02.258376 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.258358    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1\": container with ID starting with 84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1 not found: ID does not exist" containerID="84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1"
Jul 28 11:43:02.258475 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.258404    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1"} err="failed to get container status \"84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1\": rpc error: code = NotFound desc = could not find container \"84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1\": container with ID starting with 84a0a301bd59f5fbe92e8f5921d1bef150a48daf5de08a9d56b4f93c26a41ee1 not found: ID does not exist"
Jul 28 11:43:02.259884 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:02.259865    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:02.321485 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.321462    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7c9\" (UniqueName: \"kubernetes.io/projected/b9f8cdef-3dd1-49da-a646-178e06334099-kube-api-access-mv7c9\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:43:02.321485 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.321484    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46028fcb-c459-40f2-91e9-65f24340b6e2-extensions-socket-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:43:02.321651 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.321495    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2428\" (UniqueName: \"kubernetes.io/projected/46028fcb-c459-40f2-91e9-65f24340b6e2-kube-api-access-p2428\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:43:02.373938 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.373910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:02.381039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.381012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:02.533016 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.532990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:02.533925 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:02.533883    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194b914c_d632_433f_815d_8fb8aa55991c.slice/crio-cd9d4ede1dd40a2a6572388e12242acf761e660d9ed98ac0d810e8427944495b WatchSource:0}: Error finding container cd9d4ede1dd40a2a6572388e12242acf761e660d9ed98ac0d810e8427944495b: Status 404 returned error can't find the container with id cd9d4ede1dd40a2a6572388e12242acf761e660d9ed98ac0d810e8427944495b
Jul 28 11:43:02.558538 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:02.558400    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"]
Jul 28 11:43:02.559978 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:02.559950    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2299de78_e7c5_4903_a7f1_c3092e2c4e23.slice/crio-7c209fc1377ef03edfc7870a8cb8a26d1c4d6dd891fabab03709acc684a55bca WatchSource:0}: Error finding container 7c209fc1377ef03edfc7870a8cb8a26d1c4d6dd891fabab03709acc684a55bca: Status 404 returned error can't find the container with id 7c209fc1377ef03edfc7870a8cb8a26d1c4d6dd891fabab03709acc684a55bca
Jul 28 11:43:03.250285 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.250207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n" event={"ID":"2299de78-e7c5-4903-a7f1-c3092e2c4e23","Type":"ContainerStarted","Data":"e2763fa1f465f0fe1222f04c1039f7f094384da547f34deda63a3b4644744c21"}
Jul 28 11:43:03.250285 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.250258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n" event={"ID":"2299de78-e7c5-4903-a7f1-c3092e2c4e23","Type":"ContainerStarted","Data":"7c209fc1377ef03edfc7870a8cb8a26d1c4d6dd891fabab03709acc684a55bca"}
Jul 28 11:43:03.250807 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.250324    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:03.251940 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.251908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" event={"ID":"194b914c-d632-433f-815d-8fb8aa55991c","Type":"ContainerStarted","Data":"068951aa010c1d5e3e084f85d4051d23d549602ef4a44e1ce1bb6fea4e451edb"}
Jul 28 11:43:03.252023 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.251959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" event={"ID":"194b914c-d632-433f-815d-8fb8aa55991c","Type":"ContainerStarted","Data":"cd9d4ede1dd40a2a6572388e12242acf761e660d9ed98ac0d810e8427944495b"}
Jul 28 11:43:03.252023 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.252000    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:03.254566 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:03.254543    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gqjqd\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqjqd"
Jul 28 11:43:03.268216 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.268193    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" path="/var/lib/kubelet/pods/46028fcb-c459-40f2-91e9-65f24340b6e2/volumes"
Jul 28 11:43:03.268567 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.268553    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f8cdef-3dd1-49da-a646-178e06334099" path="/var/lib/kubelet/pods/b9f8cdef-3dd1-49da-a646-178e06334099/volumes"
Jul 28 11:43:03.299412 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:43:03.299364    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xpz5w\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="46028fcb-c459-40f2-91e9-65f24340b6e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xpz5w"
Jul 28 11:43:03.299512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.299417    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n" podStartSLOduration=2.299403496 podStartE2EDuration="2.299403496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:03.296470823 +0000 UTC m=+746.485071820" watchObservedRunningTime="2026-07-28 11:43:03.299403496 +0000 UTC m=+746.488004487"
Jul 28 11:43:03.341756 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:03.341707    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" podStartSLOduration=2.34169152 podStartE2EDuration="2.34169152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:03.338652499 +0000 UTC m=+746.527253487" watchObservedRunningTime="2026-07-28 11:43:03.34169152 +0000 UTC m=+746.530292511"
Jul 28 11:43:06.592426 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:06.592374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:06.694737 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:06.694701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:09.664123 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:09.664091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:09.764067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:09.764034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:13.393679 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:13.393645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:13.462560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:13.462528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:14.263902 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:14.263870    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:14.264162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:14.264142    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bbk6n"
Jul 28 11:43:19.740161 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:19.740131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:19.828185 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:19.828153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:20.689975 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:20.689941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:26.369036 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:26.369000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:26.462298 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:26.462255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:29.185957 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.185915    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:29.186410 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.186160    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" podUID="194b914c-d632-433f-815d-8fb8aa55991c" containerName="manager" containerID="cri-o://068951aa010c1d5e3e084f85d4051d23d549602ef4a44e1ce1bb6fea4e451edb" gracePeriod=10
Jul 28 11:43:29.380318 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.380266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:29.398250 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.398220    2573 generic.go:356] "Generic (PLEG): container finished" podID="194b914c-d632-433f-815d-8fb8aa55991c" containerID="068951aa010c1d5e3e084f85d4051d23d549602ef4a44e1ce1bb6fea4e451edb" exitCode=0
Jul 28 11:43:29.398424 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.398297    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" event={"ID":"194b914c-d632-433f-815d-8fb8aa55991c","Type":"ContainerDied","Data":"068951aa010c1d5e3e084f85d4051d23d549602ef4a44e1ce1bb6fea4e451edb"}
Jul 28 11:43:29.441209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.441136    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:29.492038 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.491993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:29.551530 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.551498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btj2z\" (UniqueName: \"kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z\") pod \"194b914c-d632-433f-815d-8fb8aa55991c\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") "
Jul 28 11:43:29.551684 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.551574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume\") pod \"194b914c-d632-433f-815d-8fb8aa55991c\" (UID: \"194b914c-d632-433f-815d-8fb8aa55991c\") "
Jul 28 11:43:29.551947 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.551923    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "194b914c-d632-433f-815d-8fb8aa55991c" (UID: "194b914c-d632-433f-815d-8fb8aa55991c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 11:43:29.553622 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.553598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z" (OuterVolumeSpecName: "kube-api-access-btj2z") pod "194b914c-d632-433f-815d-8fb8aa55991c" (UID: "194b914c-d632-433f-815d-8fb8aa55991c"). InnerVolumeSpecName "kube-api-access-btj2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:43:29.652883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.652853    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btj2z\" (UniqueName: \"kubernetes.io/projected/194b914c-d632-433f-815d-8fb8aa55991c-kube-api-access-btj2z\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:43:29.652883 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:29.652878    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194b914c-d632-433f-815d-8fb8aa55991c-extensions-socket-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:43:30.405024 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:30.404986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv" event={"ID":"194b914c-d632-433f-815d-8fb8aa55991c","Type":"ContainerDied","Data":"cd9d4ede1dd40a2a6572388e12242acf761e660d9ed98ac0d810e8427944495b"}
Jul 28 11:43:30.405024 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:30.405011    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"
Jul 28 11:43:30.405591 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:30.405052    2573 scope.go:117] "RemoveContainer" containerID="068951aa010c1d5e3e084f85d4051d23d549602ef4a44e1ce1bb6fea4e451edb"
Jul 28 11:43:30.436833 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:30.436799    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:30.443294 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:30.443266    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dj7pv"]
Jul 28 11:43:31.267681 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:31.267647    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194b914c-d632-433f-815d-8fb8aa55991c" path="/var/lib/kubelet/pods/194b914c-d632-433f-815d-8fb8aa55991c/volumes"
Jul 28 11:43:33.535098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:33.535068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:33.627885 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:33.627852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:39.384584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:39.384547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:39.485851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:39.485822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:40.676730 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:40.676694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:40.777378 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:40.777343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:45.731239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.731203    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"]
Jul 28 11:43:45.731689 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.731605    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194b914c-d632-433f-815d-8fb8aa55991c" containerName="manager"
Jul 28 11:43:45.731689 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.731618    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="194b914c-d632-433f-815d-8fb8aa55991c" containerName="manager"
Jul 28 11:43:45.731689 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.731683    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="194b914c-d632-433f-815d-8fb8aa55991c" containerName="manager"
Jul 28 11:43:45.736217 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.736195    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.739834 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.739817    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2rglq\""
Jul 28 11:43:45.751793 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.751770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"]
Jul 28 11:43:45.766007 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.765982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:45.896949 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.896916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.896949 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.896952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbh5\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-kube-api-access-2kbh5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.896998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897328 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.897328 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.897238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.926103 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.926080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:45.997945 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.997867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.997945 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.997908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.997945 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.997929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbh5\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-kube-api-access-2kbh5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.997976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.997997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998306    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998438    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998723 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:45.998852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:45.998830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.000363 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.000344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.000520 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.000501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.009879 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.009847    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.009989 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.009968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbh5\" (UniqueName: \"kubernetes.io/projected/dcdbfee6-e977-4a87-a4ba-58abc4faee7e-kube-api-access-2kbh5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dg67k\" (UID: \"dcdbfee6-e977-4a87-a4ba-58abc4faee7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.046895 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.046862    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:46.184343 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.184318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"]
Jul 28 11:43:46.186586 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:46.186558    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdbfee6_e977_4a87_a4ba_58abc4faee7e.slice/crio-18782f3a8eaf5042e543b9d9809a165b156c5f7a520ba240d3478e6d93b3e008 WatchSource:0}: Error finding container 18782f3a8eaf5042e543b9d9809a165b156c5f7a520ba240d3478e6d93b3e008: Status 404 returned error can't find the container with id 18782f3a8eaf5042e543b9d9809a165b156c5f7a520ba240d3478e6d93b3e008
Jul 28 11:43:46.188655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.188616    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:43:46.188761 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.188699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:43:46.188761 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.188729    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:43:46.496537 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.496487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" event={"ID":"dcdbfee6-e977-4a87-a4ba-58abc4faee7e","Type":"ContainerStarted","Data":"e70b8b913751e4ce3281f8f7468bd469cb03c2a01e00950ff5df5981c5cb45d3"}
Jul 28 11:43:46.496701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.496600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" event={"ID":"dcdbfee6-e977-4a87-a4ba-58abc4faee7e","Type":"ContainerStarted","Data":"18782f3a8eaf5042e543b9d9809a165b156c5f7a520ba240d3478e6d93b3e008"}
Jul 28 11:43:46.516917 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.516817    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" podStartSLOduration=1.516802457 podStartE2EDuration="1.516802457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:46.515455593 +0000 UTC m=+789.704056611" watchObservedRunningTime="2026-07-28 11:43:46.516802457 +0000 UTC m=+789.705403454"
Jul 28 11:43:46.689862 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.689828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:46.788164 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.788082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:46.894696 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:46.894656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:47.047658 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:47.047568    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:47.052415 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:47.052376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:47.502048 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:47.502015    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:47.503082 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:47.503064    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:43:49.690950 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:49.690916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:49.798289 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:49.798256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:51.337707 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.337674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:51.350745 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.350717    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:43:51.361142 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.360899    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.363702 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.363672    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:43:51.363845 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.363694    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v6kx8\""
Jul 28 11:43:51.363845 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.363709    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 11:43:51.450178 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.450146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:43:51.473078 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.473039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:51.545927 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.545898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpnt8\" (UniqueName: \"kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.546084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.545989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.573874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.573844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:51.647188 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.647158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.647346 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.647232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpnt8\" (UniqueName: \"kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.647832 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.647812    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.656327 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.656302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpnt8\" (UniqueName: \"kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8\") pod \"limitador-limitador-64c94fd64f-8gf6n\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.672120 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.672095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:51.820734 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:51.820703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:43:51.822196 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:51.822165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5010ee58_c589_45f5_bcb8_15ed8119d080.slice/crio-61ffdd3916e440a579461b7892ed1b2f99ca3dd270e4ff14940bc1b8126f6401 WatchSource:0}: Error finding container 61ffdd3916e440a579461b7892ed1b2f99ca3dd270e4ff14940bc1b8126f6401: Status 404 returned error can't find the container with id 61ffdd3916e440a579461b7892ed1b2f99ca3dd270e4ff14940bc1b8126f6401
Jul 28 11:43:52.251689 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.251654    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:43:52.256606 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.256575    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:52.259824 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.259804    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wlznp\""
Jul 28 11:43:52.272740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.272716    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:43:52.338299 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.338271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:52.453293 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.453116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8xpc\" (UniqueName: \"kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc\") pod \"authorino-58cd955675-9rtjj\" (UID: \"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c\") " pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:52.462947 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.462883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:43:52.522688 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.522611    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:43:52.527636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.527064    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:43:52.534708 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.534642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" event={"ID":"5010ee58-c589-45f5-bcb8-15ed8119d080","Type":"ContainerStarted","Data":"61ffdd3916e440a579461b7892ed1b2f99ca3dd270e4ff14940bc1b8126f6401"}
Jul 28 11:43:52.538680 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.538529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:43:52.555043 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.554668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8xpc\" (UniqueName: \"kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc\") pod \"authorino-58cd955675-9rtjj\" (UID: \"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c\") " pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:52.566507 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.566366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8xpc\" (UniqueName: \"kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc\") pod \"authorino-58cd955675-9rtjj\" (UID: \"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c\") " pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:52.656137 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.656095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjxgw\" (UniqueName: \"kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw\") pod \"authorino-75d556bd77-77bw9\" (UID: \"72e1f4f1-0522-414d-87d2-725d24b9211f\") " pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:43:52.757477 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.757400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxgw\" (UniqueName: \"kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw\") pod \"authorino-75d556bd77-77bw9\" (UID: \"72e1f4f1-0522-414d-87d2-725d24b9211f\") " pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:43:52.768890 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.768570    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxgw\" (UniqueName: \"kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw\") pod \"authorino-75d556bd77-77bw9\" (UID: \"72e1f4f1-0522-414d-87d2-725d24b9211f\") " pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:43:52.843009 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.842935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:43:52.866023 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:52.865993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:53.010247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:53.010181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:43:53.011433 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:53.011404    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72e1f4f1_0522_414d_87d2_725d24b9211f.slice/crio-a88dba81b2aced6e3cb25348d482dcb0771028eb05c7cacb920188b01a5457d0 WatchSource:0}: Error finding container a88dba81b2aced6e3cb25348d482dcb0771028eb05c7cacb920188b01a5457d0: Status 404 returned error can't find the container with id a88dba81b2aced6e3cb25348d482dcb0771028eb05c7cacb920188b01a5457d0
Jul 28 11:43:53.036600 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:53.036572    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:43:53.037329 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:43:53.037303    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae147e7_14ad_4a26_8dbe_623d0e3a0d5c.slice/crio-d4796b9cde2d635f3c1672d7784830bf4967b3ac1308a524dc3a8d3bb4a1663d WatchSource:0}: Error finding container d4796b9cde2d635f3c1672d7784830bf4967b3ac1308a524dc3a8d3bb4a1663d: Status 404 returned error can't find the container with id d4796b9cde2d635f3c1672d7784830bf4967b3ac1308a524dc3a8d3bb4a1663d
Jul 28 11:43:53.545181 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:53.545147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-77bw9" event={"ID":"72e1f4f1-0522-414d-87d2-725d24b9211f","Type":"ContainerStarted","Data":"a88dba81b2aced6e3cb25348d482dcb0771028eb05c7cacb920188b01a5457d0"}
Jul 28 11:43:53.546428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:53.546396    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9rtjj" event={"ID":"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c","Type":"ContainerStarted","Data":"d4796b9cde2d635f3c1672d7784830bf4967b3ac1308a524dc3a8d3bb4a1663d"}
Jul 28 11:43:55.566787 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:55.566732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" event={"ID":"5010ee58-c589-45f5-bcb8-15ed8119d080","Type":"ContainerStarted","Data":"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"}
Jul 28 11:43:55.567266 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:55.566847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:43:55.591473 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:55.591409    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" podStartSLOduration=1.709684346 podStartE2EDuration="4.591374672s" totalImagesPullingTime="2.881690326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:55.58521916 +0000 UTC m=+798.773820176" watchObservedRunningTime="2026-07-28 11:43:55.591374672 +0000 UTC m=+798.779975673"
Jul 28 11:43:57.580521 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:57.580480    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-77bw9" event={"ID":"72e1f4f1-0522-414d-87d2-725d24b9211f","Type":"ContainerStarted","Data":"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"}
Jul 28 11:43:57.581919 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:57.581889    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9rtjj" event={"ID":"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c","Type":"ContainerStarted","Data":"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"}
Jul 28 11:43:57.606550 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:57.606501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-77bw9" podStartSLOduration=1.656676034 podStartE2EDuration="5.606487418s" totalImagesPullingTime="3.949811384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:57.603771572 +0000 UTC m=+800.792372569" watchObservedRunningTime="2026-07-28 11:43:57.606487418 +0000 UTC m=+800.795088414"
Jul 28 11:43:57.645474 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:57.645406    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9rtjj" podStartSLOduration=1.732895359 podStartE2EDuration="5.645373208s" totalImagesPullingTime="3.912477849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:43:57.643171554 +0000 UTC m=+800.831772552" watchObservedRunningTime="2026-07-28 11:43:57.645373208 +0000 UTC m=+800.833974206"
Jul 28 11:43:57.665262 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:57.665230    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:43:59.592536 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:59.592453    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9rtjj" podUID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" containerName="authorino" containerID="cri-o://4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec" gracePeriod=30
Jul 28 11:43:59.847439 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:59.847368    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:43:59.924140 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:59.924111    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8xpc\" (UniqueName: \"kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc\") pod \"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c\" (UID: \"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c\") "
Jul 28 11:43:59.926120 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:43:59.926089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc" (OuterVolumeSpecName: "kube-api-access-p8xpc") pod "eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" (UID: "eae147e7-14ad-4a26-8dbe-623d0e3a0d5c"). InnerVolumeSpecName "kube-api-access-p8xpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:00.024985 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.024959    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8xpc\" (UniqueName: \"kubernetes.io/projected/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c-kube-api-access-p8xpc\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:00.599077 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.599040    2573 generic.go:356] "Generic (PLEG): container finished" podID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" containerID="4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec" exitCode=0
Jul 28 11:44:00.599077 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.599083    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9rtjj"
Jul 28 11:44:00.599597 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.599081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9rtjj" event={"ID":"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c","Type":"ContainerDied","Data":"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"}
Jul 28 11:44:00.599597 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.599206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9rtjj" event={"ID":"eae147e7-14ad-4a26-8dbe-623d0e3a0d5c","Type":"ContainerDied","Data":"d4796b9cde2d635f3c1672d7784830bf4967b3ac1308a524dc3a8d3bb4a1663d"}
Jul 28 11:44:00.599597 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.599230    2573 scope.go:117] "RemoveContainer" containerID="4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"
Jul 28 11:44:00.609272 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.609254    2573 scope.go:117] "RemoveContainer" containerID="4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"
Jul 28 11:44:00.609564 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:00.609545    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec\": container with ID starting with 4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec not found: ID does not exist" containerID="4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"
Jul 28 11:44:00.609616 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.609573    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec"} err="failed to get container status \"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec\": rpc error: code = NotFound desc = could not find container \"4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec\": container with ID starting with 4eba3410dbc0afc594ef8985410fa5d75ddb4d8a60a1949a936395a5df6e19ec not found: ID does not exist"
Jul 28 11:44:00.630209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.625767    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:44:00.630209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:00.629840    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9rtjj"]
Jul 28 11:44:01.268396 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:01.268349    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" path="/var/lib/kubelet/pods/eae147e7-14ad-4a26-8dbe-623d0e3a0d5c/volumes"
Jul 28 11:44:06.275335 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.275299    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:44:06.275777 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.275526    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" podUID="5010ee58-c589-45f5-bcb8-15ed8119d080" containerName="limitador" containerID="cri-o://6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a" gracePeriod=30
Jul 28 11:44:06.276279 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.276262    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:44:06.830636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.830607    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:44:06.882597 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.882563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpnt8\" (UniqueName: \"kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8\") pod \"5010ee58-c589-45f5-bcb8-15ed8119d080\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") "
Jul 28 11:44:06.882748 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.882645    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file\") pod \"5010ee58-c589-45f5-bcb8-15ed8119d080\" (UID: \"5010ee58-c589-45f5-bcb8-15ed8119d080\") "
Jul 28 11:44:06.882996 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.882973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file" (OuterVolumeSpecName: "config-file") pod "5010ee58-c589-45f5-bcb8-15ed8119d080" (UID: "5010ee58-c589-45f5-bcb8-15ed8119d080"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 11:44:06.884663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.884639    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8" (OuterVolumeSpecName: "kube-api-access-gpnt8") pod "5010ee58-c589-45f5-bcb8-15ed8119d080" (UID: "5010ee58-c589-45f5-bcb8-15ed8119d080"). InnerVolumeSpecName "kube-api-access-gpnt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:06.984039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.984003    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpnt8\" (UniqueName: \"kubernetes.io/projected/5010ee58-c589-45f5-bcb8-15ed8119d080-kube-api-access-gpnt8\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:06.984039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:06.984032    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5010ee58-c589-45f5-bcb8-15ed8119d080-config-file\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:07.641456 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.641422    2573 generic.go:356] "Generic (PLEG): container finished" podID="5010ee58-c589-45f5-bcb8-15ed8119d080" containerID="6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a" exitCode=0
Jul 28 11:44:07.641863 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.641479    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"
Jul 28 11:44:07.641863 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.641509    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" event={"ID":"5010ee58-c589-45f5-bcb8-15ed8119d080","Type":"ContainerDied","Data":"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"}
Jul 28 11:44:07.641863 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.641577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8gf6n" event={"ID":"5010ee58-c589-45f5-bcb8-15ed8119d080","Type":"ContainerDied","Data":"61ffdd3916e440a579461b7892ed1b2f99ca3dd270e4ff14940bc1b8126f6401"}
Jul 28 11:44:07.641863 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.641599    2573 scope.go:117] "RemoveContainer" containerID="6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"
Jul 28 11:44:07.650889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.650868    2573 scope.go:117] "RemoveContainer" containerID="6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"
Jul 28 11:44:07.651147 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:07.651129    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a\": container with ID starting with 6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a not found: ID does not exist" containerID="6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"
Jul 28 11:44:07.651222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.651161    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a"} err="failed to get container status \"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a\": rpc error: code = NotFound desc = could not find container \"6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a\": container with ID starting with 6b75152e95b6a8e0b0ccce82c35a3ad349d0aeed73db797a97289056f868e43a not found: ID does not exist"
Jul 28 11:44:07.660794 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.660773    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:44:07.664792 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:07.664772    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8gf6n"]
Jul 28 11:44:09.043665 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.043632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:09.140848 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.140816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:09.267853 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.267814    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5010ee58-c589-45f5-bcb8-15ed8119d080" path="/var/lib/kubelet/pods/5010ee58-c589-45f5-bcb8-15ed8119d080/volumes"
Jul 28 11:44:09.602962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.602930    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"]
Jul 28 11:44:09.603502 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603484    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5010ee58-c589-45f5-bcb8-15ed8119d080" containerName="limitador"
Jul 28 11:44:09.603502 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603503    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5010ee58-c589-45f5-bcb8-15ed8119d080" containerName="limitador"
Jul 28 11:44:09.603619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603511    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" containerName="authorino"
Jul 28 11:44:09.603619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603517    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" containerName="authorino"
Jul 28 11:44:09.603619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603579    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae147e7-14ad-4a26-8dbe-623d0e3a0d5c" containerName="authorino"
Jul 28 11:44:09.603619 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.603587    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5010ee58-c589-45f5-bcb8-15ed8119d080" containerName="limitador"
Jul 28 11:44:09.608038 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.608019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.610974 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.610949    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-79dxk\""
Jul 28 11:44:09.611083 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.610991    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 11:44:09.611083 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.610991    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 11:44:09.612016 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.611994    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 11:44:09.616985 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.616961    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"]
Jul 28 11:44:09.637094 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.637070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:09.707449 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.707425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1d7ff37-a755-4f34-8b2c-2794231282aa-data\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.707449 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.707459    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkn6\" (UniqueName: \"kubernetes.io/projected/d1d7ff37-a755-4f34-8b2c-2794231282aa-kube-api-access-fkkn6\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.808506 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.808475    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1d7ff37-a755-4f34-8b2c-2794231282aa-data\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.808669 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.808511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkn6\" (UniqueName: \"kubernetes.io/projected/d1d7ff37-a755-4f34-8b2c-2794231282aa-kube-api-access-fkkn6\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.808839 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.808820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1d7ff37-a755-4f34-8b2c-2794231282aa-data\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.817566 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.817544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkn6\" (UniqueName: \"kubernetes.io/projected/d1d7ff37-a755-4f34-8b2c-2794231282aa-kube-api-access-fkkn6\") pod \"postgres-69fb4594cf-hhblq\" (UID: \"d1d7ff37-a755-4f34-8b2c-2794231282aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:09.920594 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:09.920564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:10.057057 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:10.057031    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"]
Jul 28 11:44:10.058166 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:44:10.058137    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d7ff37_a755_4f34_8b2c_2794231282aa.slice/crio-990190683a71d847da456a397707247dd77d192e2342d29f1286915c19d8a712 WatchSource:0}: Error finding container 990190683a71d847da456a397707247dd77d192e2342d29f1286915c19d8a712: Status 404 returned error can't find the container with id 990190683a71d847da456a397707247dd77d192e2342d29f1286915c19d8a712
Jul 28 11:44:10.659314 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:10.659279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq" event={"ID":"d1d7ff37-a755-4f34-8b2c-2794231282aa","Type":"ContainerStarted","Data":"990190683a71d847da456a397707247dd77d192e2342d29f1286915c19d8a712"}
Jul 28 11:44:15.696867 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:15.696775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq" event={"ID":"d1d7ff37-a755-4f34-8b2c-2794231282aa","Type":"ContainerStarted","Data":"0251a9f898f4a5fec75003cd7e8cbb2a7290239096337ff9eefe499a5a16f92b"}
Jul 28 11:44:15.696867 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:15.696849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:15.713488 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:15.713435    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq" podStartSLOduration=1.345619933 podStartE2EDuration="6.713417014s" totalImagesPullingTime="5.367797081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:44:15.712677354 +0000 UTC m=+818.901278365" watchObservedRunningTime="2026-07-28 11:44:15.713417014 +0000 UTC m=+818.902018005"
Jul 28 11:44:21.730863 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:21.730818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhblq"
Jul 28 11:44:22.097944 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.097862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:22.198283 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.198251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:22.330925 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.330893    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vh4zl"]
Jul 28 11:44:22.336846 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.336830    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.344088 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.344000    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vh4zl"]
Jul 28 11:44:22.426621 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.426594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjcqr\" (UniqueName: \"kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr\") pod \"authorino-5d4b67c446-vh4zl\" (UID: \"94713b43-b081-4960-b84d-d26e650e35bc\") " pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.519610 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.519576    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vh4zl"]
Jul 28 11:44:22.519845 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:22.519825    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kjcqr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-vh4zl" podUID="94713b43-b081-4960-b84d-d26e650e35bc"
Jul 28 11:44:22.527720 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.527695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjcqr\" (UniqueName: \"kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr\") pod \"authorino-5d4b67c446-vh4zl\" (UID: \"94713b43-b081-4960-b84d-d26e650e35bc\") " pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.537293 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.537267    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjcqr\" (UniqueName: \"kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr\") pod \"authorino-5d4b67c446-vh4zl\" (UID: \"94713b43-b081-4960-b84d-d26e650e35bc\") " pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.559271 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.559248    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-qn9fm"]
Jul 28 11:44:22.563485 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.563470    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.565911 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.565894    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 11:44:22.574206 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.574185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-qn9fm"]
Jul 28 11:44:22.614294 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.614270    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qn9fm"]
Jul 28 11:44:22.614532 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:22.614513    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gtpv6 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-gtpv6 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-qn9fm" podUID="1658dce0-f35d-4241-9f1d-8c5eec0c430a"
Jul 28 11:44:22.647111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.647088    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:44:22.651096 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.651080    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.661495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.661473    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:44:22.728663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.728604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwlc9\" (UniqueName: \"kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.728663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.728638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.728823 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.728670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtpv6\" (UniqueName: \"kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.728823 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.728730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.735303 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.735280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.735679 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.735281    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.742717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.742700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.745782 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.745764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:22.829242 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.829207    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjcqr\" (UniqueName: \"kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr\") pod \"94713b43-b081-4960-b84d-d26e650e35bc\" (UID: \"94713b43-b081-4960-b84d-d26e650e35bc\") "
Jul 28 11:44:22.829420 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.829405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtpv6\" (UniqueName: \"kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.829471 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.829445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.829585 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.829569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwlc9\" (UniqueName: \"kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.829643 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.829611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.831517 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.831485    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr" (OuterVolumeSpecName: "kube-api-access-kjcqr") pod "94713b43-b081-4960-b84d-d26e650e35bc" (UID: "94713b43-b081-4960-b84d-d26e650e35bc"). InnerVolumeSpecName "kube-api-access-kjcqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:22.831837 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.831814    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.831913 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.831861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.837649 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.837624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwlc9\" (UniqueName: \"kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9\") pod \"authorino-699cb767b4-twmmz\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") " pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:22.837741 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.837716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtpv6\" (UniqueName: \"kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6\") pod \"authorino-76877994-qn9fm\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") " pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:22.930494 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.930467    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert\") pod \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") "
Jul 28 11:44:22.930649 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.930574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtpv6\" (UniqueName: \"kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6\") pod \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\" (UID: \"1658dce0-f35d-4241-9f1d-8c5eec0c430a\") "
Jul 28 11:44:22.930761 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.930748    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjcqr\" (UniqueName: \"kubernetes.io/projected/94713b43-b081-4960-b84d-d26e650e35bc-kube-api-access-kjcqr\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:22.932541 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.932506    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1658dce0-f35d-4241-9f1d-8c5eec0c430a" (UID: "1658dce0-f35d-4241-9f1d-8c5eec0c430a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:44:22.932656 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.932557    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6" (OuterVolumeSpecName: "kube-api-access-gtpv6") pod "1658dce0-f35d-4241-9f1d-8c5eec0c430a" (UID: "1658dce0-f35d-4241-9f1d-8c5eec0c430a"). InnerVolumeSpecName "kube-api-access-gtpv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:22.960290 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:22.960267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:44:23.031583 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.031553    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtpv6\" (UniqueName: \"kubernetes.io/projected/1658dce0-f35d-4241-9f1d-8c5eec0c430a-kube-api-access-gtpv6\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:23.031583 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.031579    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1658dce0-f35d-4241-9f1d-8c5eec0c430a-tls-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:23.095419 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.095377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:44:23.096536 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:44:23.096512    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4eec372_9291_40bc_8830_c5cc09b18201.slice/crio-140d0730ef661168dda892bcd01a19edc2bc7eaadb816cd1a486c5cfbd0056f7 WatchSource:0}: Error finding container 140d0730ef661168dda892bcd01a19edc2bc7eaadb816cd1a486c5cfbd0056f7: Status 404 returned error can't find the container with id 140d0730ef661168dda892bcd01a19edc2bc7eaadb816cd1a486c5cfbd0056f7
Jul 28 11:44:23.742594 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.742560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699cb767b4-twmmz" event={"ID":"c4eec372-9291-40bc-8830-c5cc09b18201","Type":"ContainerStarted","Data":"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"}
Jul 28 11:44:23.743029 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.742605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699cb767b4-twmmz" event={"ID":"c4eec372-9291-40bc-8830-c5cc09b18201","Type":"ContainerStarted","Data":"140d0730ef661168dda892bcd01a19edc2bc7eaadb816cd1a486c5cfbd0056f7"}
Jul 28 11:44:23.743029 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.742612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vh4zl"
Jul 28 11:44:23.743029 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.742620    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qn9fm"
Jul 28 11:44:23.759755 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.759707    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-699cb767b4-twmmz" podStartSLOduration=1.466348566 podStartE2EDuration="1.759695045s" totalImagesPullingTime="293.346479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:44:23.75850024 +0000 UTC m=+826.947101237" watchObservedRunningTime="2026-07-28 11:44:23.759695045 +0000 UTC m=+826.948296042"
Jul 28 11:44:23.787084 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.787035    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qn9fm"]
Jul 28 11:44:23.790221 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.790197    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:44:23.790408 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.790361    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-77bw9" podUID="72e1f4f1-0522-414d-87d2-725d24b9211f" containerName="authorino" containerID="cri-o://c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9" gracePeriod=30
Jul 28 11:44:23.792705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.792671    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-qn9fm"]
Jul 28 11:44:23.814583 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.814552    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vh4zl"]
Jul 28 11:44:23.817705 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:23.817668    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vh4zl"]
Jul 28 11:44:24.041726 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.041703    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:44:24.142944 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.142909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjxgw\" (UniqueName: \"kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw\") pod \"72e1f4f1-0522-414d-87d2-725d24b9211f\" (UID: \"72e1f4f1-0522-414d-87d2-725d24b9211f\") "
Jul 28 11:44:24.145049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.145023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw" (OuterVolumeSpecName: "kube-api-access-tjxgw") pod "72e1f4f1-0522-414d-87d2-725d24b9211f" (UID: "72e1f4f1-0522-414d-87d2-725d24b9211f"). InnerVolumeSpecName "kube-api-access-tjxgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:24.243656 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.243616    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjxgw\" (UniqueName: \"kubernetes.io/projected/72e1f4f1-0522-414d-87d2-725d24b9211f-kube-api-access-tjxgw\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:24.750214 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.750176    2573 generic.go:356] "Generic (PLEG): container finished" podID="72e1f4f1-0522-414d-87d2-725d24b9211f" containerID="c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9" exitCode=0
Jul 28 11:44:24.750701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.750219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-77bw9"
Jul 28 11:44:24.750701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.750262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-77bw9" event={"ID":"72e1f4f1-0522-414d-87d2-725d24b9211f","Type":"ContainerDied","Data":"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"}
Jul 28 11:44:24.750701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.750316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-77bw9" event={"ID":"72e1f4f1-0522-414d-87d2-725d24b9211f","Type":"ContainerDied","Data":"a88dba81b2aced6e3cb25348d482dcb0771028eb05c7cacb920188b01a5457d0"}
Jul 28 11:44:24.750701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.750344    2573 scope.go:117] "RemoveContainer" containerID="c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"
Jul 28 11:44:24.759277 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.759260    2573 scope.go:117] "RemoveContainer" containerID="c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"
Jul 28 11:44:24.759546 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:24.759529    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9\": container with ID starting with c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9 not found: ID does not exist" containerID="c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"
Jul 28 11:44:24.759602 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.759555    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9"} err="failed to get container status \"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9\": rpc error: code = NotFound desc = could not find container \"c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9\": container with ID starting with c495db25852cc096afbd5c85d7d198ca9b99f97663aaf1ba2b126e7dcd080cd9 not found: ID does not exist"
Jul 28 11:44:24.771788 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.771759    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:44:24.777584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:24.777561    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-77bw9"]
Jul 28 11:44:25.267400 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:25.267349    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1658dce0-f35d-4241-9f1d-8c5eec0c430a" path="/var/lib/kubelet/pods/1658dce0-f35d-4241-9f1d-8c5eec0c430a/volumes"
Jul 28 11:44:25.267621 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:25.267607    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e1f4f1-0522-414d-87d2-725d24b9211f" path="/var/lib/kubelet/pods/72e1f4f1-0522-414d-87d2-725d24b9211f/volumes"
Jul 28 11:44:25.267893 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:25.267882    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94713b43-b081-4960-b84d-d26e650e35bc" path="/var/lib/kubelet/pods/94713b43-b081-4960-b84d-d26e650e35bc/volumes"
Jul 28 11:44:28.848098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.848047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:28.860681 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.860652    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:28.861113 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.861091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e1f4f1-0522-414d-87d2-725d24b9211f" containerName="authorino"
Jul 28 11:44:28.861113 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.861111    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e1f4f1-0522-414d-87d2-725d24b9211f" containerName="authorino"
Jul 28 11:44:28.861316 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.861252    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e1f4f1-0522-414d-87d2-725d24b9211f" containerName="authorino"
Jul 28 11:44:28.948653 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:28.948623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:29.009158 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.009120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:29.066065 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.066033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:29.066230 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.066083    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:44:29.066230 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.066171    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.068954 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.068932    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 11:44:29.069071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.069029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nprmb\""
Jul 28 11:44:29.070093 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.070073    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 11:44:29.100570 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.100502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:44:29.100676 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.100606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.188526 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.188490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.188735 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.188536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9446t\" (UniqueName: \"kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.188735 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.188646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhfc\" (UniqueName: \"kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.188735 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.188718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.206983 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.206951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:29.289554 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.289524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.289727 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.289580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.289727 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.289609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9446t\" (UniqueName: \"kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.289727 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.289654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhfc\" (UniqueName: \"kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.292045 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.292020    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.292144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.292028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.298606 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.298585    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhfc\" (UniqueName: \"kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc\") pod \"maas-controller-6954b9867f-p964v\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") " pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.298731 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.298713    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9446t\" (UniqueName: \"kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t\") pod \"maas-controller-6d844fcccb-vslw4\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") " pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.377709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.377683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:29.410208 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.410182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:29.557353 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.557322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:29.558576 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:44:29.558540    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f980fc_ae37_4369_898b_8b93ea4c5dfa.slice/crio-101f1503c0c38b1613c6f19a9ee51375c3bfc8e2bbe03841dd4ad87141f37605 WatchSource:0}: Error finding container 101f1503c0c38b1613c6f19a9ee51375c3bfc8e2bbe03841dd4ad87141f37605: Status 404 returned error can't find the container with id 101f1503c0c38b1613c6f19a9ee51375c3bfc8e2bbe03841dd4ad87141f37605
Jul 28 11:44:29.582866 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.582842    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:44:29.584752 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:44:29.584728    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d618508_4ea0_4c5c_b4e2_a3bf351ce454.slice/crio-622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0 WatchSource:0}: Error finding container 622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0: Status 404 returned error can't find the container with id 622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0
Jul 28 11:44:29.779491 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.779402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d844fcccb-vslw4" event={"ID":"e1f980fc-ae37-4369-898b-8b93ea4c5dfa","Type":"ContainerStarted","Data":"101f1503c0c38b1613c6f19a9ee51375c3bfc8e2bbe03841dd4ad87141f37605"}
Jul 28 11:44:29.780537 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:29.780515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6954b9867f-p964v" event={"ID":"4d618508-4ea0-4c5c-b4e2-a3bf351ce454","Type":"ContainerStarted","Data":"622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0"}
Jul 28 11:44:32.273634 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.273603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:32.375221 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.375186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:44:32.808212 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.808120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d844fcccb-vslw4" event={"ID":"e1f980fc-ae37-4369-898b-8b93ea4c5dfa","Type":"ContainerStarted","Data":"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"}
Jul 28 11:44:32.808212 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.808181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:32.809655 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.809618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6954b9867f-p964v" event={"ID":"4d618508-4ea0-4c5c-b4e2-a3bf351ce454","Type":"ContainerStarted","Data":"84e9af1a60368b915ee098e70453259f51ac7c0f7c64eee3038f7e583b6e9454"}
Jul 28 11:44:32.809772 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.809687    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:32.825247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.825202    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d844fcccb-vslw4" podStartSLOduration=2.299423557 podStartE2EDuration="4.825181284s" totalImagesPullingTime="2.525757727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:44:32.824418163 +0000 UTC m=+836.013019171" watchObservedRunningTime="2026-07-28 11:44:32.825181284 +0000 UTC m=+836.013782280"
Jul 28 11:44:32.841589 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:32.841547    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6954b9867f-p964v" podStartSLOduration=1.335213717 podStartE2EDuration="3.841532611s" totalImagesPullingTime="2.506318894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:44:32.840830883 +0000 UTC m=+836.029431892" watchObservedRunningTime="2026-07-28 11:44:32.841532611 +0000 UTC m=+836.030133609"
Jul 28 11:44:43.818059 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:43.818028    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:43.818499 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:43.818096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:44:43.888456 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:43.888421    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:43.888685 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:43.888662    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d844fcccb-vslw4" podUID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" containerName="manager" containerID="cri-o://e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff" gracePeriod=30
Jul 28 11:44:44.143700 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.143674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:44.217715 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.217681    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert\") pod \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") "
Jul 28 11:44:44.217918 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.217754    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9446t\" (UniqueName: \"kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t\") pod \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\" (UID: \"e1f980fc-ae37-4369-898b-8b93ea4c5dfa\") "
Jul 28 11:44:44.219851 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.219819    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1f980fc-ae37-4369-898b-8b93ea4c5dfa" (UID: "e1f980fc-ae37-4369-898b-8b93ea4c5dfa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:44:44.219973 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.219882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t" (OuterVolumeSpecName: "kube-api-access-9446t") pod "e1f980fc-ae37-4369-898b-8b93ea4c5dfa" (UID: "e1f980fc-ae37-4369-898b-8b93ea4c5dfa"). InnerVolumeSpecName "kube-api-access-9446t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:44:44.318786 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.318755    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-webhook-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:44.318786 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.318784    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9446t\" (UniqueName: \"kubernetes.io/projected/e1f980fc-ae37-4369-898b-8b93ea4c5dfa-kube-api-access-9446t\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:44:44.879013 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.878977    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" containerID="e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff" exitCode=0
Jul 28 11:44:44.879436 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.879020    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d844fcccb-vslw4"
Jul 28 11:44:44.879436 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.879071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d844fcccb-vslw4" event={"ID":"e1f980fc-ae37-4369-898b-8b93ea4c5dfa","Type":"ContainerDied","Data":"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"}
Jul 28 11:44:44.879436 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.879127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d844fcccb-vslw4" event={"ID":"e1f980fc-ae37-4369-898b-8b93ea4c5dfa","Type":"ContainerDied","Data":"101f1503c0c38b1613c6f19a9ee51375c3bfc8e2bbe03841dd4ad87141f37605"}
Jul 28 11:44:44.879436 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.879150    2573 scope.go:117] "RemoveContainer" containerID="e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"
Jul 28 11:44:44.888502 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.888485    2573 scope.go:117] "RemoveContainer" containerID="e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"
Jul 28 11:44:44.888760 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:44:44.888743    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff\": container with ID starting with e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff not found: ID does not exist" containerID="e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"
Jul 28 11:44:44.888819 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.888770    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff"} err="failed to get container status \"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff\": rpc error: code = NotFound desc = could not find container \"e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff\": container with ID starting with e1caf1ae7f7314539e0beb65e1d50d3f83838d2c54cf569a3513d1ce72903aff not found: ID does not exist"
Jul 28 11:44:44.901584 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.901561    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:44.907098 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:44.907075    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d844fcccb-vslw4"]
Jul 28 11:44:45.267412 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:44:45.267325    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" path="/var/lib/kubelet/pods/e1f980fc-ae37-4369-898b-8b93ea4c5dfa/volumes"
Jul 28 11:45:04.937199 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:04.937160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:05.058146 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.058108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:05.399810 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.399775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:05.530844 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.530818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:05.704294 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.704204    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8649546779-d67nh"]
Jul 28 11:45:05.704668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.704651    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" containerName="manager"
Jul 28 11:45:05.704668 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.704668    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" containerName="manager"
Jul 28 11:45:05.704805 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.704735    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f980fc-ae37-4369-898b-8b93ea4c5dfa" containerName="manager"
Jul 28 11:45:05.707997 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.707980    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.711223 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.711198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xchcw\""
Jul 28 11:45:05.711313 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.711198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 11:45:05.723706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.723685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8649546779-d67nh"]
Jul 28 11:45:05.809356 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.809310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05bd3e1b-c046-4238-a413-d0c105c64080-maas-api-tls\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.809580 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.809421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zpz\" (UniqueName: \"kubernetes.io/projected/05bd3e1b-c046-4238-a413-d0c105c64080-kube-api-access-k7zpz\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.809580 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.809547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bd3e1b-c046-4238-a413-d0c105c64080-openshift-service-ca\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.910810 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.910780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05bd3e1b-c046-4238-a413-d0c105c64080-maas-api-tls\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.911038 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.910824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zpz\" (UniqueName: \"kubernetes.io/projected/05bd3e1b-c046-4238-a413-d0c105c64080-kube-api-access-k7zpz\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.911038 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.910874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bd3e1b-c046-4238-a413-d0c105c64080-openshift-service-ca\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.911599 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.911575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bd3e1b-c046-4238-a413-d0c105c64080-openshift-service-ca\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.913361 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.913337    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05bd3e1b-c046-4238-a413-d0c105c64080-maas-api-tls\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:05.919691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:05.919664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zpz\" (UniqueName: \"kubernetes.io/projected/05bd3e1b-c046-4238-a413-d0c105c64080-kube-api-access-k7zpz\") pod \"maas-api-8649546779-d67nh\" (UID: \"05bd3e1b-c046-4238-a413-d0c105c64080\") " pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:06.018351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.018269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:06.029441 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.029401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:06.139200 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.139166    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"]
Jul 28 11:45:06.141737 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.141713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:06.143564 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.143544    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.146044 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.146023    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 11:45:06.152995 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.152711    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"]
Jul 28 11:45:06.158986 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.158966    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-lhx87"]
Jul 28 11:45:06.162247 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.162223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.165685 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.165668    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dvd7x\""
Jul 28 11:45:06.181091 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.181068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-lhx87"]
Jul 28 11:45:06.182909 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:06.182888    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bd3e1b_c046_4238_a413_d0c105c64080.slice/crio-81cbc6c417f7d6f1341208ef79ca41a687e0d0cf532ec2dff2c0965b31855ac0 WatchSource:0}: Error finding container 81cbc6c417f7d6f1341208ef79ca41a687e0d0cf532ec2dff2c0965b31855ac0: Status 404 returned error can't find the container with id 81cbc6c417f7d6f1341208ef79ca41a687e0d0cf532ec2dff2c0965b31855ac0
Jul 28 11:45:06.184151 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.184130    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8649546779-d67nh"]
Jul 28 11:45:06.213162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.213135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdbsk\" (UniqueName: \"kubernetes.io/projected/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-kube-api-access-wdbsk\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.213280 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.213168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2m4\" (UniqueName: \"kubernetes.io/projected/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-kube-api-access-ng2m4\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.213322 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.213280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.213357 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.213326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.314127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.314127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.314127 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdbsk\" (UniqueName: \"kubernetes.io/projected/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-kube-api-access-wdbsk\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.314445 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2m4\" (UniqueName: \"kubernetes.io/projected/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-kube-api-access-ng2m4\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.314850 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.314943 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.314833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.323090 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.323065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2m4\" (UniqueName: \"kubernetes.io/projected/2ef2bab4-bbb9-43bc-9ff8-11d65d240af6-kube-api-access-ng2m4\") pod \"payload-pre-processing-687dbb6cf6-bhjjt\" (UID: \"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.323222 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.323109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdbsk\" (UniqueName: \"kubernetes.io/projected/52b12ed1-f161-4ce6-b2d7-e7e3a9192f72-kube-api-access-wdbsk\") pod \"payload-processing-5cc6cd444b-lhx87\" (UID: \"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72\") " pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.457559 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.457521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:06.473065 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.473032    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:06.633353 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.633328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-lhx87"]
Jul 28 11:45:06.636049 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:06.635963    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b12ed1_f161_4ce6_b2d7_e7e3a9192f72.slice/crio-d00d0014a4e83f1f969aa79834346b232e8b4be976466a9da562dee32676ba6d WatchSource:0}: Error finding container d00d0014a4e83f1f969aa79834346b232e8b4be976466a9da562dee32676ba6d: Status 404 returned error can't find the container with id d00d0014a4e83f1f969aa79834346b232e8b4be976466a9da562dee32676ba6d
Jul 28 11:45:06.810932 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:06.810901    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"]
Jul 28 11:45:06.811793 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:06.811767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef2bab4_bbb9_43bc_9ff8_11d65d240af6.slice/crio-fdb78d0199e289e25bcec7bd0a5eca9eb4bfdbff930d32c83b2ebe4e6aa02c83 WatchSource:0}: Error finding container fdb78d0199e289e25bcec7bd0a5eca9eb4bfdbff930d32c83b2ebe4e6aa02c83: Status 404 returned error can't find the container with id fdb78d0199e289e25bcec7bd0a5eca9eb4bfdbff930d32c83b2ebe4e6aa02c83
Jul 28 11:45:07.010763 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:07.010727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87" event={"ID":"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72","Type":"ContainerStarted","Data":"d00d0014a4e83f1f969aa79834346b232e8b4be976466a9da562dee32676ba6d"}
Jul 28 11:45:07.012220 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:07.012187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh" event={"ID":"05bd3e1b-c046-4238-a413-d0c105c64080","Type":"ContainerStarted","Data":"81cbc6c417f7d6f1341208ef79ca41a687e0d0cf532ec2dff2c0965b31855ac0"}
Jul 28 11:45:07.013810 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:07.013784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt" event={"ID":"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6","Type":"ContainerStarted","Data":"fdb78d0199e289e25bcec7bd0a5eca9eb4bfdbff930d32c83b2ebe4e6aa02c83"}
Jul 28 11:45:09.035350 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:09.035275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh" event={"ID":"05bd3e1b-c046-4238-a413-d0c105c64080","Type":"ContainerStarted","Data":"209c1b2d815e425304a94040f05a012248a219a1611291e814206b1fffb25de7"}
Jul 28 11:45:09.035819 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:09.035543    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:10.043618 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.043528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87" event={"ID":"52b12ed1-f161-4ce6-b2d7-e7e3a9192f72","Type":"ContainerStarted","Data":"b67b4e1c18ba6fdcd18443d33e429af6398adfda5cbce9c8b55362b09576188a"}
Jul 28 11:45:10.044332 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.044209    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:10.047641 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.047604    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt" event={"ID":"2ef2bab4-bbb9-43bc-9ff8-11d65d240af6","Type":"ContainerStarted","Data":"c1cba55e342efa2319a0958536d4d3ac02914046587928e18d83d76b1e9c5ff8"}
Jul 28 11:45:10.047836 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.047821    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:10.061740 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.061690    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh" podStartSLOduration=2.673634133 podStartE2EDuration="5.06166963s" totalImagesPullingTime="2.388035497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:09.067664147 +0000 UTC m=+872.256265161" watchObservedRunningTime="2026-07-28 11:45:10.06166963 +0000 UTC m=+873.250270629"
Jul 28 11:45:10.082555 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.082505    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt" podStartSLOduration=1.685043684 podStartE2EDuration="4.082490667s" totalImagesPullingTime="2.397446983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:10.080568808 +0000 UTC m=+873.269169801" watchObservedRunningTime="2026-07-28 11:45:10.082490667 +0000 UTC m=+873.271091664"
Jul 28 11:45:10.083990 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:10.083960    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87" podStartSLOduration=1.518882276 podStartE2EDuration="4.083950875s" totalImagesPullingTime="2.565068599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:10.065044528 +0000 UTC m=+873.253645530" watchObservedRunningTime="2026-07-28 11:45:10.083950875 +0000 UTC m=+873.272551872"
Jul 28 11:45:14.078599 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.078515    2573 generic.go:356] "Generic (PLEG): container finished" podID="dcdbfee6-e977-4a87-a4ba-58abc4faee7e" containerID="e70b8b913751e4ce3281f8f7468bd469cb03c2a01e00950ff5df5981c5cb45d3" exitCode=0
Jul 28 11:45:14.078599 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.078576    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" event={"ID":"dcdbfee6-e977-4a87-a4ba-58abc4faee7e","Type":"ContainerDied","Data":"e70b8b913751e4ce3281f8f7468bd469cb03c2a01e00950ff5df5981c5cb45d3"}
Jul 28 11:45:14.079278 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.078949    2573 scope.go:117] "RemoveContainer" containerID="e70b8b913751e4ce3281f8f7468bd469cb03c2a01e00950ff5df5981c5cb45d3"
Jul 28 11:45:14.079962 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.079931    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:45:14.080080 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.080003    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:45:14.080080 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:14.080034    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 11:45:15.055748 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:15.055708    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8649546779-d67nh"
Jul 28 11:45:15.088220 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:15.088190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" event={"ID":"dcdbfee6-e977-4a87-a4ba-58abc4faee7e","Type":"ContainerStarted","Data":"4c79f9ecc7dcddd19cf38b005cca243078b7370e79ce31fbbbab6bd0a39f61b1"}
Jul 28 11:45:16.047484 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:16.047448    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:45:16.049136 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:16.049109    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dg67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 28 11:45:16.049351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:16.049329    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" podUID="dcdbfee6-e977-4a87-a4ba-58abc4faee7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 28 11:45:16.069252 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:16.069152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:17.047832 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:17.047791    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dg67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 28 11:45:17.048438 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:17.048401    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" podUID="dcdbfee6-e977-4a87-a4ba-58abc4faee7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 28 11:45:17.469034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:17.468973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:17.501958 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:17.501928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:45:18.047842 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:18.047797    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dg67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 28 11:45:18.048348 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:18.047875    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k" podUID="dcdbfee6-e977-4a87-a4ba-58abc4faee7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 28 11:45:19.051213 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:19.051175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:45:19.052598 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:19.052574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dg67k"
Jul 28 11:45:22.067000 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.066969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bhjjt"
Jul 28 11:45:22.067486 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.067157    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-lhx87"
Jul 28 11:45:22.431034 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.431002    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"]
Jul 28 11:45:22.434780 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.434764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.437830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.437805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 11:45:22.437955 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.437827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n92jt\""
Jul 28 11:45:22.438688 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.438672    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 11:45:22.438776 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.438678    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 11:45:22.444503 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.444484    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"]
Jul 28 11:45:22.455445 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.455378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:22.572650 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.572613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.572895 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.572867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.572997 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.572954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.573058 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.573014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.573118 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.573060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.573118 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.573107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czp8k\" (UniqueName: \"kubernetes.io/projected/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-kube-api-access-czp8k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674111 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674305 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674305 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674305 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674305 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czp8k\" (UniqueName: \"kubernetes.io/projected/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-kube-api-access-czp8k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674635 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.674701 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.674680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.676952 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.676928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.677129 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.677114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.682336 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.682284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czp8k\" (UniqueName: \"kubernetes.io/projected/9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf-kube-api-access-czp8k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4\" (UID: \"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.747143 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.747117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:22.881209 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:22.881176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"]
Jul 28 11:45:22.882263 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:22.882238    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c82ab5c_67d9_40dd_8e2c_3b06e40cedcf.slice/crio-e956fd16aa86d7e775b4f1037a6652b22f43a4bba179b8c76f395b391b3eb9b1 WatchSource:0}: Error finding container e956fd16aa86d7e775b4f1037a6652b22f43a4bba179b8c76f395b391b3eb9b1: Status 404 returned error can't find the container with id e956fd16aa86d7e775b4f1037a6652b22f43a4bba179b8c76f395b391b3eb9b1
Jul 28 11:45:23.142065 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:23.142027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4" event={"ID":"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf","Type":"ContainerStarted","Data":"e956fd16aa86d7e775b4f1037a6652b22f43a4bba179b8c76f395b391b3eb9b1"}
Jul 28 11:45:24.150799 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:24.150761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4" event={"ID":"9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf","Type":"ContainerStarted","Data":"c4115b6cf99a60bd374c9675c65c2df5447c652b286a3447e20175c688a879b0"}
Jul 28 11:45:24.169783 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:24.169735    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4" podStartSLOduration=1.032743295 podStartE2EDuration="2.169719752s" totalImagesPullingTime="1.136976457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:24.167752107 +0000 UTC m=+887.356353116" watchObservedRunningTime="2026-07-28 11:45:24.169719752 +0000 UTC m=+887.358320748"
Jul 28 11:45:27.905351 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.905315    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"]
Jul 28 11:45:27.909478 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.909447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.911995 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.911966    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 11:45:27.920251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.920227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"]
Jul 28 11:45:27.921719 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.921698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527cf7ff-ca91-4869-aa6d-58d257018199-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.921882 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.921860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.921994 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.921972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.922047 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.922035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnqp\" (UniqueName: \"kubernetes.io/projected/527cf7ff-ca91-4869-aa6d-58d257018199-kube-api-access-mnnqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.922105 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.922094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.922162 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.922148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:27.945422 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:27.945372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:28.022791 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.022913 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnnqp\" (UniqueName: \"kubernetes.io/projected/527cf7ff-ca91-4869-aa6d-58d257018199-kube-api-access-mnnqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.022913 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.022913 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.023064 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527cf7ff-ca91-4869-aa6d-58d257018199-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.023064 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.022949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.023204 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.023182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.023269 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.023218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.023269 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.023244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.025146 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.025125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527cf7ff-ca91-4869-aa6d-58d257018199-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.025480 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.025464    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527cf7ff-ca91-4869-aa6d-58d257018199-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.030430 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.030410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnnqp\" (UniqueName: \"kubernetes.io/projected/527cf7ff-ca91-4869-aa6d-58d257018199-kube-api-access-mnnqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x9xfl\" (UID: \"527cf7ff-ca91-4869-aa6d-58d257018199\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.222004 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.221928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:28.369377 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:28.369353    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"]
Jul 28 11:45:28.371183 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:28.371156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527cf7ff_ca91_4869_aa6d_58d257018199.slice/crio-b5a679673b4805065dbcf00829dfaaf0b603eb6811b0e2b3ac97b8c3c23b179f WatchSource:0}: Error finding container b5a679673b4805065dbcf00829dfaaf0b603eb6811b0e2b3ac97b8c3c23b179f: Status 404 returned error can't find the container with id b5a679673b4805065dbcf00829dfaaf0b603eb6811b0e2b3ac97b8c3c23b179f
Jul 28 11:45:29.181235 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:29.181196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl" event={"ID":"527cf7ff-ca91-4869-aa6d-58d257018199","Type":"ContainerStarted","Data":"aa23a53b80cd75558a66e9e6b8e6528da835f9254a05c12a7943f4e6e46a8d01"}
Jul 28 11:45:29.181653 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:29.181260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl" event={"ID":"527cf7ff-ca91-4869-aa6d-58d257018199","Type":"ContainerStarted","Data":"b5a679673b4805065dbcf00829dfaaf0b603eb6811b0e2b3ac97b8c3c23b179f"}
Jul 28 11:45:29.200716 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:29.200670    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl" podStartSLOduration=1.942557385 podStartE2EDuration="2.200652169s" totalImagesPullingTime="258.094784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:29.198812036 +0000 UTC m=+892.387413047" watchObservedRunningTime="2026-07-28 11:45:29.200652169 +0000 UTC m=+892.389253166"
Jul 28 11:45:29.990841 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:29.990803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:32.747711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:32.747673    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:32.748134 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:32.747749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:32.761094 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:32.761062    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:33.216186 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:33.216154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4"
Jul 28 11:45:35.939009 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:35.938972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:38.222304 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.222262    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:38.222813 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.222340    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:38.236456 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.236429    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:38.249513 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.249484    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x9xfl"
Jul 28 11:45:38.435087 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.435055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:45:38.435509 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:38.435489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:45:43.504144 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.504110    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"]
Jul 28 11:45:43.509917 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.509894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.512466 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.512443    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 11:45:43.525067 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.525034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"]
Jul 28 11:45:43.532874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.532851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:43.568573 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwzs7\" (UniqueName: \"kubernetes.io/projected/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-kube-api-access-pwzs7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.568709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.568709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.568709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.568860 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.568860 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.568752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670060 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670219 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670219 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670219 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670219 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzs7\" (UniqueName: \"kubernetes.io/projected/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-kube-api-access-pwzs7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670415 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670602 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670585    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.670710 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.670681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.672546 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.672521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.672636 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.672613    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.679308 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.679283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwzs7\" (UniqueName: \"kubernetes.io/projected/ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f-kube-api-access-pwzs7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j\" (UID: \"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.821600 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.821531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:43.956428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:43.956371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"]
Jul 28 11:45:43.957454 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:45:43.957429    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebab8fc2_93b3_4ad7_b1cf_5ab91aaa1e8f.slice/crio-a8b533ce121775ac8c20ce9aa4570e2e72e163efe5262389f35ee07109484d5f WatchSource:0}: Error finding container a8b533ce121775ac8c20ce9aa4570e2e72e163efe5262389f35ee07109484d5f: Status 404 returned error can't find the container with id a8b533ce121775ac8c20ce9aa4570e2e72e163efe5262389f35ee07109484d5f
Jul 28 11:45:44.276203 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:44.276167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j" event={"ID":"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f","Type":"ContainerStarted","Data":"e8782ab5245c78fc5ac13771cebba2f79d0dd1867ba5158d5a656217c595c185"}
Jul 28 11:45:44.276358 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:44.276227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j" event={"ID":"ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f","Type":"ContainerStarted","Data":"a8b533ce121775ac8c20ce9aa4570e2e72e163efe5262389f35ee07109484d5f"}
Jul 28 11:45:44.295299 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:44.295243    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j" podStartSLOduration=1.104526208 podStartE2EDuration="1.295229451s" totalImagesPullingTime="190.703243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:45:44.293463286 +0000 UTC m=+907.482064308" watchObservedRunningTime="2026-07-28 11:45:44.295229451 +0000 UTC m=+907.483830448"
Jul 28 11:45:53.822526 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:53.822491    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:53.823003 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:53.822549    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:53.835217 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:53.835192    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:54.347725 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:54.347696    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j"
Jul 28 11:45:59.728026 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:59.727994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:45:59.785717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:45:59.785686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:46:14.141428 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:14.141395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:46:32.209039 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.208997    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"]
Jul 28 11:46:32.213960 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.213941    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.216520 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.216496    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 11:46:32.222773 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.222753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"]
Jul 28 11:46:32.307706 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.307671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:46:32.317830 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.317804    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.317941 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.317837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wjxx\" (UniqueName: \"kubernetes.io/projected/6a4c8b00-af42-4ad0-affe-558f15e59306-kube-api-access-7wjxx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.317982 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.317938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.318035 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.318018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.318071 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.318054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.318122 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.318108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4c8b00-af42-4ad0-affe-558f15e59306-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.418762 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.418728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.418762 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.418764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4c8b00-af42-4ad0-affe-558f15e59306-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419008 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.418820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419008 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.418846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wjxx\" (UniqueName: \"kubernetes.io/projected/6a4c8b00-af42-4ad0-affe-558f15e59306-kube-api-access-7wjxx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419008 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.418907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419182 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.419067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419239 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.419193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419299 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.419249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.419498 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.419469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.421123 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.421104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4c8b00-af42-4ad0-affe-558f15e59306-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.421407 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.421374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4c8b00-af42-4ad0-affe-558f15e59306-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.427334 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.427312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wjxx\" (UniqueName: \"kubernetes.io/projected/6a4c8b00-af42-4ad0-affe-558f15e59306-kube-api-access-7wjxx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-llgcc\" (UID: \"6a4c8b00-af42-4ad0-affe-558f15e59306\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.524591 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.524506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:32.663176 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.663144    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"]
Jul 28 11:46:32.664573 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:46:32.664546    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a4c8b00_af42_4ad0_affe_558f15e59306.slice/crio-e905c73853aa7b244385b17c1cc10ebe3176ececa119e74664f0df3e71100c08 WatchSource:0}: Error finding container e905c73853aa7b244385b17c1cc10ebe3176ececa119e74664f0df3e71100c08: Status 404 returned error can't find the container with id e905c73853aa7b244385b17c1cc10ebe3176ececa119e74664f0df3e71100c08
Jul 28 11:46:32.665922 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:32.665903    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 11:46:33.568969 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:33.568928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc" event={"ID":"6a4c8b00-af42-4ad0-affe-558f15e59306","Type":"ContainerStarted","Data":"8b389c3746c1791acb9aac3e3d9bdf3bbbd007c74e37e1d88de5c6c82cfb8fab"}
Jul 28 11:46:33.569447 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:33.568976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc" event={"ID":"6a4c8b00-af42-4ad0-affe-558f15e59306","Type":"ContainerStarted","Data":"e905c73853aa7b244385b17c1cc10ebe3176ececa119e74664f0df3e71100c08"}
Jul 28 11:46:33.587765 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:33.587724    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc" podStartSLOduration=1.407440128 podStartE2EDuration="1.587710366s" totalImagesPullingTime="180.270238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:46:33.586491802 +0000 UTC m=+956.775092846" watchObservedRunningTime="2026-07-28 11:46:33.587710366 +0000 UTC m=+956.776311363"
Jul 28 11:46:42.525451 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:42.525416    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:42.526068 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:42.525467    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:42.537918 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:42.537895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:42.630859 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:42.630830    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-llgcc"
Jul 28 11:46:50.560754 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:50.560719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:46:50.616046 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:46:50.616017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:47:49.935993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:49.935955    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5848d5b577-k6nm8"]
Jul 28 11:47:49.939704 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:49.939687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:49.946682 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:49.946654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5848d5b577-k6nm8"]
Jul 28 11:47:50.045344 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.045316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e36a13-128b-4e01-9489-4580e0d468f4-tls-cert\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.045525 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.045403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljz6j\" (UniqueName: \"kubernetes.io/projected/50e36a13-128b-4e01-9489-4580e0d468f4-kube-api-access-ljz6j\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.146450 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.146411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e36a13-128b-4e01-9489-4580e0d468f4-tls-cert\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.146639 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.146509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljz6j\" (UniqueName: \"kubernetes.io/projected/50e36a13-128b-4e01-9489-4580e0d468f4-kube-api-access-ljz6j\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.148889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.148866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e36a13-128b-4e01-9489-4580e0d468f4-tls-cert\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.155411 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.155360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljz6j\" (UniqueName: \"kubernetes.io/projected/50e36a13-128b-4e01-9489-4580e0d468f4-kube-api-access-ljz6j\") pod \"authorino-5848d5b577-k6nm8\" (UID: \"50e36a13-128b-4e01-9489-4580e0d468f4\") " pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.251251 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.251167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5848d5b577-k6nm8"
Jul 28 11:47:50.386045 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:50.386015    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5848d5b577-k6nm8"]
Jul 28 11:47:50.386976 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:47:50.386947    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50e36a13_128b_4e01_9489_4580e0d468f4.slice/crio-d83e4bfa3bee387ca1cc9b186a1ce717e7da24c401cd1b66dcfe7c7a9cdca012 WatchSource:0}: Error finding container d83e4bfa3bee387ca1cc9b186a1ce717e7da24c401cd1b66dcfe7c7a9cdca012: Status 404 returned error can't find the container with id d83e4bfa3bee387ca1cc9b186a1ce717e7da24c401cd1b66dcfe7c7a9cdca012
Jul 28 11:47:51.028576 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.028533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5848d5b577-k6nm8" event={"ID":"50e36a13-128b-4e01-9489-4580e0d468f4","Type":"ContainerStarted","Data":"893962b6fc3ae04a9f8fd6532daa251cb7c7140046133f096ef7ecd8b0ff3315"}
Jul 28 11:47:51.029157 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.028585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5848d5b577-k6nm8" event={"ID":"50e36a13-128b-4e01-9489-4580e0d468f4","Type":"ContainerStarted","Data":"d83e4bfa3bee387ca1cc9b186a1ce717e7da24c401cd1b66dcfe7c7a9cdca012"}
Jul 28 11:47:51.052711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.052659    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5848d5b577-k6nm8" podStartSLOduration=1.583143261 podStartE2EDuration="2.052642179s" totalImagesPullingTime="469.498918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:47:51.050993573 +0000 UTC m=+1034.239594570" watchObservedRunningTime="2026-07-28 11:47:51.052642179 +0000 UTC m=+1034.241243222"
Jul 28 11:47:51.112918 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.112838    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:47:51.113054 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.113021    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-699cb767b4-twmmz" podUID="c4eec372-9291-40bc-8830-c5cc09b18201" containerName="authorino" containerID="cri-o://7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000" gracePeriod=30
Jul 28 11:47:51.387117 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.387082    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:47:51.460634 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.460595    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwlc9\" (UniqueName: \"kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9\") pod \"c4eec372-9291-40bc-8830-c5cc09b18201\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") "
Jul 28 11:47:51.460803 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.460738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert\") pod \"c4eec372-9291-40bc-8830-c5cc09b18201\" (UID: \"c4eec372-9291-40bc-8830-c5cc09b18201\") "
Jul 28 11:47:51.462663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.462630    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9" (OuterVolumeSpecName: "kube-api-access-qwlc9") pod "c4eec372-9291-40bc-8830-c5cc09b18201" (UID: "c4eec372-9291-40bc-8830-c5cc09b18201"). InnerVolumeSpecName "kube-api-access-qwlc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:47:51.473139 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.473107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c4eec372-9291-40bc-8830-c5cc09b18201" (UID: "c4eec372-9291-40bc-8830-c5cc09b18201"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:47:51.561583 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.561545    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eec372-9291-40bc-8830-c5cc09b18201-tls-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:47:51.561583 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.561580    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwlc9\" (UniqueName: \"kubernetes.io/projected/c4eec372-9291-40bc-8830-c5cc09b18201-kube-api-access-qwlc9\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:47:51.650709 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.650671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:47:51.766704 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:51.766668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:47:52.036272 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.036185    2573 generic.go:356] "Generic (PLEG): container finished" podID="c4eec372-9291-40bc-8830-c5cc09b18201" containerID="7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000" exitCode=0
Jul 28 11:47:52.036272 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.036246    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699cb767b4-twmmz"
Jul 28 11:47:52.036795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.036273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699cb767b4-twmmz" event={"ID":"c4eec372-9291-40bc-8830-c5cc09b18201","Type":"ContainerDied","Data":"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"}
Jul 28 11:47:52.036795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.036318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699cb767b4-twmmz" event={"ID":"c4eec372-9291-40bc-8830-c5cc09b18201","Type":"ContainerDied","Data":"140d0730ef661168dda892bcd01a19edc2bc7eaadb816cd1a486c5cfbd0056f7"}
Jul 28 11:47:52.036795 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.036342    2573 scope.go:117] "RemoveContainer" containerID="7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"
Jul 28 11:47:52.046421 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.046374    2573 scope.go:117] "RemoveContainer" containerID="7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"
Jul 28 11:47:52.046677 ip-10-0-142-146 kubenswrapper[2573]: E0728 11:47:52.046657    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000\": container with ID starting with 7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000 not found: ID does not exist" containerID="7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"
Jul 28 11:47:52.046757 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.046685    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000"} err="failed to get container status \"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000\": rpc error: code = NotFound desc = could not find container \"7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000\": container with ID starting with 7d14c2ac52955906c2cf013d821d33071628382c6026bf5ce02a76cb38234000 not found: ID does not exist"
Jul 28 11:47:52.062718 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.062692    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:47:52.068968 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.068939    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-699cb767b4-twmmz"]
Jul 28 11:47:52.911248 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:52.911209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:47:53.011518 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:53.011484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:47:53.269861 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:47:53.269781    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4eec372-9291-40bc-8830-c5cc09b18201" path="/var/lib/kubelet/pods/c4eec372-9291-40bc-8830-c5cc09b18201/volumes"
Jul 28 11:48:45.112995 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.112958    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:48:45.113541 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.113147    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6954b9867f-p964v" podUID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" containerName="manager" containerID="cri-o://84e9af1a60368b915ee098e70453259f51ac7c0f7c64eee3038f7e583b6e9454" gracePeriod=30
Jul 28 11:48:45.358769 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.358738    2573 generic.go:356] "Generic (PLEG): container finished" podID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" containerID="84e9af1a60368b915ee098e70453259f51ac7c0f7c64eee3038f7e583b6e9454" exitCode=0
Jul 28 11:48:45.358889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.358814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6954b9867f-p964v" event={"ID":"4d618508-4ea0-4c5c-b4e2-a3bf351ce454","Type":"ContainerDied","Data":"84e9af1a60368b915ee098e70453259f51ac7c0f7c64eee3038f7e583b6e9454"}
Jul 28 11:48:45.358889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.358862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6954b9867f-p964v" event={"ID":"4d618508-4ea0-4c5c-b4e2-a3bf351ce454","Type":"ContainerDied","Data":"622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0"}
Jul 28 11:48:45.358889 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.358878    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="622f2b0be4171df4edbb769fa003b812c5d4abd167f344f1b3e5e1670b31a4d0"
Jul 28 11:48:45.364560 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.364507    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:48:45.475608 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.475573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnhfc\" (UniqueName: \"kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc\") pod \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") "
Jul 28 11:48:45.475805 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.475765    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert\") pod \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\" (UID: \"4d618508-4ea0-4c5c-b4e2-a3bf351ce454\") "
Jul 28 11:48:45.477527 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.477499    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc" (OuterVolumeSpecName: "kube-api-access-qnhfc") pod "4d618508-4ea0-4c5c-b4e2-a3bf351ce454" (UID: "4d618508-4ea0-4c5c-b4e2-a3bf351ce454"). InnerVolumeSpecName "kube-api-access-qnhfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 11:48:45.477691 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.477666    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4d618508-4ea0-4c5c-b4e2-a3bf351ce454" (UID: "4d618508-4ea0-4c5c-b4e2-a3bf351ce454"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 11:48:45.576798 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.576759    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnhfc\" (UniqueName: \"kubernetes.io/projected/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-kube-api-access-qnhfc\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:48:45.576798 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:45.576794    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d618508-4ea0-4c5c-b4e2-a3bf351ce454-webhook-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 11:48:46.368412 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:46.367490    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6954b9867f-p964v"
Jul 28 11:48:46.392977 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:46.392952    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:48:46.396493 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:46.396468    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6954b9867f-p964v"]
Jul 28 11:48:47.269605 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:47.269570    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" path="/var/lib/kubelet/pods/4d618508-4ea0-4c5c-b4e2-a3bf351ce454/volumes"
Jul 28 11:48:48.967596 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:48.967561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:48:49.065547 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:48:49.065510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:06.396254 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:06.396163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:07.959856 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:07.959822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:21.499036 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:21.499000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:37.331859 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:37.331829    2573 scope.go:117] "RemoveContainer" containerID="84e9af1a60368b915ee098e70453259f51ac7c0f7c64eee3038f7e583b6e9454"
Jul 28 11:50:38.482180 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:38.482150    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:50:38.482901 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:38.482880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:50:49.439302 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:49.439265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:49.558413 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:49.558351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:49.719807 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:49.719702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:52.891799 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:52.891767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:52.993267 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:52.993233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:56.063279 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:56.063245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:56.163355 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:56.163313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:56.323042 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:56.322949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:56.419478 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:56.419438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:50:56.621953 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:50:56.621919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:51:02.619101 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:51:02.619060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:51:02.719663 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:51:02.719627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:53:31.123448 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:53:31.123344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:53:31.209512 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:53:31.209476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:55:38.520882 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:55:38.520844    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:55:38.523781 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:55:38.523760    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 11:56:43.958042 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:56:43.958005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:59:10.299852 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.299775    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 11:59:10.300301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300206    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4eec372-9291-40bc-8830-c5cc09b18201" containerName="authorino"
Jul 28 11:59:10.300301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300217    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4eec372-9291-40bc-8830-c5cc09b18201" containerName="authorino"
Jul 28 11:59:10.300301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300230    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" containerName="manager"
Jul 28 11:59:10.300301 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300237    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" containerName="manager"
Jul 28 11:59:10.300454 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300331    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d618508-4ea0-4c5c-b4e2-a3bf351ce454" containerName="manager"
Jul 28 11:59:10.300454 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.300342    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4eec372-9291-40bc-8830-c5cc09b18201" containerName="authorino"
Jul 28 11:59:10.303277 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.303260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.306049 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.306030    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-637c70a6-kserve-self-signed-certs\""
Jul 28 11:59:10.324277 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.324222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 11:59:10.357944 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.357911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:59:10.483495 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.483717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srg56\" (UniqueName: \"kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.483717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.483717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.483717 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.483901 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.483754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584470 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srg56\" (UniqueName: \"kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584711 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584926 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584803    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.584926 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.585013 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.584985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.586974 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.586943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.587224 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.587208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.594541 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.594508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srg56\" (UniqueName: \"kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56\") pod \"e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") " pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.619322 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.619283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:10.760747 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:10.760713    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 11:59:10.762518 ip-10-0-142-146 kubenswrapper[2573]: W0728 11:59:10.762493    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod547fabdf_8c61_4935_ab66_af7ab976a112.slice/crio-f272973526c1a634dde19a1c6242d6ab6a8886effa13d9fb00e5acf7ae5e53ce WatchSource:0}: Error finding container f272973526c1a634dde19a1c6242d6ab6a8886effa13d9fb00e5acf7ae5e53ce: Status 404 returned error can't find the container with id f272973526c1a634dde19a1c6242d6ab6a8886effa13d9fb00e5acf7ae5e53ce
Jul 28 11:59:11.051572 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:11.051527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" event={"ID":"547fabdf-8c61-4935-ab66-af7ab976a112","Type":"ContainerStarted","Data":"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"}
Jul 28 11:59:11.051750 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:11.051579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" event={"ID":"547fabdf-8c61-4935-ab66-af7ab976a112","Type":"ContainerStarted","Data":"f272973526c1a634dde19a1c6242d6ab6a8886effa13d9fb00e5acf7ae5e53ce"}
Jul 28 11:59:11.070961 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:11.070892    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" podStartSLOduration=1.070874262 podStartE2EDuration="1.070874262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:59:11.070749159 +0000 UTC m=+1714.259350157" watchObservedRunningTime="2026-07-28 11:59:11.070874262 +0000 UTC m=+1714.259475261"
Jul 28 11:59:17.136369 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:17.136324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:59:20.619874 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:20.619847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:20.620241 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:20.619921    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:20.632221 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:20.632194    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:21.128297 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:21.128271    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 11:59:48.600340 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:48.600295    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 11:59:48.620993 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:48.620965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 11:59:50.149443 ip-10-0-142-146 kubenswrapper[2573]: I0728 11:59:50.149408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:00:03.619856 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.619795    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" podUID="547fabdf-8c61-4935-ab66-af7ab976a112" containerName="main" containerID="cri-o://fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c" gracePeriod=45
Jul 28 12:00:03.873159 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.873080    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 12:00:03.903697 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.903665    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.903875 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.903723    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.903875 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.903752    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.903875 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.903774    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.903875 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.903818    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.904091 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904021    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srg56\" (UniqueName: \"kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56\") pod \"547fabdf-8c61-4935-ab66-af7ab976a112\" (UID: \"547fabdf-8c61-4935-ab66-af7ab976a112\") "
Jul 28 12:00:03.904148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:00:03.904148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904035    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home" (OuterVolumeSpecName: "home") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:00:03.904148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904047    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache" (OuterVolumeSpecName: "model-cache") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:00:03.904544 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904520    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-home\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:03.904654 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904547    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-model-cache\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:03.904654 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.904563    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-tmp-dir\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:03.906050 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.906024    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:00:03.906141 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.906045    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56" (OuterVolumeSpecName: "kube-api-access-srg56") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "kube-api-access-srg56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:00:03.906141 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:03.906066    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm" (OuterVolumeSpecName: "dshm") pod "547fabdf-8c61-4935-ab66-af7ab976a112" (UID: "547fabdf-8c61-4935-ab66-af7ab976a112"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:00:04.005479 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.005443    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srg56\" (UniqueName: \"kubernetes.io/projected/547fabdf-8c61-4935-ab66-af7ab976a112-kube-api-access-srg56\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:04.005479 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.005474    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/547fabdf-8c61-4935-ab66-af7ab976a112-dshm\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:04.005479 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.005483    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/547fabdf-8c61-4935-ab66-af7ab976a112-tls-certs\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:00:04.367109 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.367020    2573 generic.go:356] "Generic (PLEG): container finished" podID="547fabdf-8c61-4935-ab66-af7ab976a112" containerID="fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c" exitCode=0
Jul 28 12:00:04.367109 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.367063    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"
Jul 28 12:00:04.367292 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.367109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" event={"ID":"547fabdf-8c61-4935-ab66-af7ab976a112","Type":"ContainerDied","Data":"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"}
Jul 28 12:00:04.367292 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.367154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84" event={"ID":"547fabdf-8c61-4935-ab66-af7ab976a112","Type":"ContainerDied","Data":"f272973526c1a634dde19a1c6242d6ab6a8886effa13d9fb00e5acf7ae5e53ce"}
Jul 28 12:00:04.367292 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.367172    2573 scope.go:117] "RemoveContainer" containerID="fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"
Jul 28 12:00:04.377027 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.377008    2573 scope.go:117] "RemoveContainer" containerID="fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"
Jul 28 12:00:04.377276 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:00:04.377256    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c\": container with ID starting with fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c not found: ID does not exist" containerID="fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"
Jul 28 12:00:04.377328 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.377284    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c"} err="failed to get container status \"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c\": rpc error: code = NotFound desc = could not find container \"fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c\": container with ID starting with fa93529dae6d9d96a8392334442a5142504cfb7fcfef81e0aec5a531b15cf18c not found: ID does not exist"
Jul 28 12:00:04.390423 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.390399    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 12:00:04.396632 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:04.396613    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-637c70a6-kserve-6c768ff4dc-w6p84"]
Jul 28 12:00:05.268937 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:05.268906    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="547fabdf-8c61-4935-ab66-af7ab976a112" path="/var/lib/kubelet/pods/547fabdf-8c61-4935-ab66-af7ab976a112/volumes"
Jul 28 12:00:07.955705 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:07.955668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:00:38.559315 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:38.559209    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:00:38.566652 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:00:38.563544    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:03:03.656447 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:03.656413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:05.487568 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:05.487528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:27.721820 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:27.721785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:31.534352 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:31.534261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:31.630760 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:31.630730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:32.061839 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:32.061799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:38.316759 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:38.316726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:38.383072 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:38.383007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:38.573714 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:38.573617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:38.935213 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:38.935180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:39.582737 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:39.582704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.034695 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.034655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.135770 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.135727    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:03:44.136485 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.136463    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547fabdf-8c61-4935-ab66-af7ab976a112" containerName="main"
Jul 28 12:03:44.136485 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.136486    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="547fabdf-8c61-4935-ab66-af7ab976a112" containerName="main"
Jul 28 12:03:44.136634 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.136565    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="547fabdf-8c61-4935-ab66-af7ab976a112" containerName="main"
Jul 28 12:03:44.137565 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.137540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.139702 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.139682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.142464 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.142447    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7e937708-serving-cert\""
Jul 28 12:03:44.151249 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.151224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:03:44.211938 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.211910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.212091 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.212001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.212091 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.212050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvts\" (UniqueName: \"kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.218795 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.218747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.312749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.312675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.312749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.312712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.312749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.312741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvts\" (UniqueName: \"kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.313006 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:03:44.312822    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-serving-cert: secret "maas-api-e2e-ait-7e937708-serving-cert" not found
Jul 28 12:03:44.313006 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:03:44.312907    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls podName:361003f2-b586-4362-8ce1-c38141bf2aa2 nodeName:}" failed. No retries permitted until 2026-07-28 12:03:44.812884575 +0000 UTC m=+1988.001485553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls") pod "maas-api-e2e-ait-7e937708-999cff494-cjn2r" (UID: "361003f2-b586-4362-8ce1-c38141bf2aa2") : secret "maas-api-e2e-ait-7e937708-serving-cert" not found
Jul 28 12:03:44.313538 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.313504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.322643 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.322614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvts\" (UniqueName: \"kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.496206 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.496141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.817977 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.817942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.820430 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.820399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") pod \"maas-api-e2e-ait-7e937708-999cff494-cjn2r\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:44.940479 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.940410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:44.985081 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.985052    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:03:44.988846 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.988826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:44.991420 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.991399    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7e937708\""
Jul 28 12:03:44.997139 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:44.997034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:03:45.027435 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.027402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:45.051712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.051684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:45.121323 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.121050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.121323 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.121190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp77p\" (UniqueName: \"kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.222293 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.222260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.222516 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.222367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp77p\" (UniqueName: \"kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.223044 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.223018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.231231 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.231196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp77p\" (UniqueName: \"kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p\") pod \"payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.301002 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.300979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.406812 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.406779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:03:45.415796 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:03:45.414645    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361003f2_b586_4362_8ce1_c38141bf2aa2.slice/crio-6b146c3b344a71ba6ab996784f149c20f0dea343c29f3be450340516a7351a8d WatchSource:0}: Error finding container 6b146c3b344a71ba6ab996784f149c20f0dea343c29f3be450340516a7351a8d: Status 404 returned error can't find the container with id 6b146c3b344a71ba6ab996784f149c20f0dea343c29f3be450340516a7351a8d
Jul 28 12:03:45.417512 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.417089    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:03:45.450535 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.450507    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:03:45.451772 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:03:45.451741    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb3d9ed_e3de_44f5_9c82_4d1abb03ec9e.slice/crio-e421197af70ee255456349619205d833bba4a81adf4641c02d17c04b699b1515 WatchSource:0}: Error finding container e421197af70ee255456349619205d833bba4a81adf4641c02d17c04b699b1515: Status 404 returned error can't find the container with id e421197af70ee255456349619205d833bba4a81adf4641c02d17c04b699b1515
Jul 28 12:03:45.680406 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.680287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" event={"ID":"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e","Type":"ContainerStarted","Data":"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"}
Jul 28 12:03:45.680406 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.680342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" event={"ID":"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e","Type":"ContainerStarted","Data":"e421197af70ee255456349619205d833bba4a81adf4641c02d17c04b699b1515"}
Jul 28 12:03:45.680630 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.680506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:03:45.681625 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.681599    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" event={"ID":"361003f2-b586-4362-8ce1-c38141bf2aa2","Type":"ContainerStarted","Data":"6b146c3b344a71ba6ab996784f149c20f0dea343c29f3be450340516a7351a8d"}
Jul 28 12:03:45.698598 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:45.698552    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" podStartSLOduration=1.698537017 podStartE2EDuration="1.698537017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:03:45.697526524 +0000 UTC m=+1988.886127522" watchObservedRunningTime="2026-07-28 12:03:45.698537017 +0000 UTC m=+1988.887138014"
Jul 28 12:03:46.375099 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:46.375066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:46.690070 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:46.689983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" event={"ID":"361003f2-b586-4362-8ce1-c38141bf2aa2","Type":"ContainerStarted","Data":"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"}
Jul 28 12:03:46.710466 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:46.710415    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" podStartSLOduration=2.058177318 podStartE2EDuration="2.710399715s" totalImagesPullingTime="652.222397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:03:46.708103505 +0000 UTC m=+1989.896704514" watchObservedRunningTime="2026-07-28 12:03:46.710399715 +0000 UTC m=+1989.899000703"
Jul 28 12:03:47.695865 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:47.695833    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:52.707313 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:52.707278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:03:53.706992 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:53.706966    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:03:56.692400 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:03:56.692345    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:04:20.331888 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.331851    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:04:20.332540 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.332064    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" podUID="361003f2-b586-4362-8ce1-c38141bf2aa2" containerName="maas-api" containerID="cri-o://c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1" gracePeriod=30
Jul 28 12:04:20.367517 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.367493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:20.405555 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.405520    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:04:20.405790 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.405761    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" podUID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" containerName="payload-pre-processing" containerID="cri-o://cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3" gracePeriod=30
Jul 28 12:04:20.462579 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.462548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:20.563572 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.563539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:20.672838 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.672810    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:04:20.694859 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.694832    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:04:20.756634 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.756600    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnvts\" (UniqueName: \"kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts\") pod \"361003f2-b586-4362-8ce1-c38141bf2aa2\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") "
Jul 28 12:04:20.756781 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.756695    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") pod \"361003f2-b586-4362-8ce1-c38141bf2aa2\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") "
Jul 28 12:04:20.756781 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.756717    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp77p\" (UniqueName: \"kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p\") pod \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") "
Jul 28 12:04:20.756781 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.756743    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca\") pod \"361003f2-b586-4362-8ce1-c38141bf2aa2\" (UID: \"361003f2-b586-4362-8ce1-c38141bf2aa2\") "
Jul 28 12:04:20.756895 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.756805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume\") pod \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\" (UID: \"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e\") "
Jul 28 12:04:20.757189 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.757158    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "361003f2-b586-4362-8ce1-c38141bf2aa2" (UID: "361003f2-b586-4362-8ce1-c38141bf2aa2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:04:20.757307 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.757255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" (UID: "1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:04:20.758910 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.758890    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p" (OuterVolumeSpecName: "kube-api-access-jp77p") pod "1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" (UID: "1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e"). InnerVolumeSpecName "kube-api-access-jp77p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:04:20.759280 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.759261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "361003f2-b586-4362-8ce1-c38141bf2aa2" (UID: "361003f2-b586-4362-8ce1-c38141bf2aa2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:04:20.759350 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.759261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts" (OuterVolumeSpecName: "kube-api-access-bnvts") pod "361003f2-b586-4362-8ce1-c38141bf2aa2" (UID: "361003f2-b586-4362-8ce1-c38141bf2aa2"). InnerVolumeSpecName "kube-api-access-bnvts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:04:20.858403 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.858355    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnvts\" (UniqueName: \"kubernetes.io/projected/361003f2-b586-4362-8ce1-c38141bf2aa2-kube-api-access-bnvts\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:04:20.858403 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.858378    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/361003f2-b586-4362-8ce1-c38141bf2aa2-maas-api-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:04:20.858403 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.858410    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp77p\" (UniqueName: \"kubernetes.io/projected/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-kube-api-access-jp77p\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:04:20.858615 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.858419    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/361003f2-b586-4362-8ce1-c38141bf2aa2-openshift-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:04:20.858615 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.858427    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e-plugins-config-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:04:20.910544 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.910451    2573 generic.go:356] "Generic (PLEG): container finished" podID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" containerID="cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3" exitCode=0
Jul 28 12:04:20.910544 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.910521    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"
Jul 28 12:04:20.910762 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.910539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" event={"ID":"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e","Type":"ContainerDied","Data":"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"}
Jul 28 12:04:20.910762 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.910610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz" event={"ID":"1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e","Type":"ContainerDied","Data":"e421197af70ee255456349619205d833bba4a81adf4641c02d17c04b699b1515"}
Jul 28 12:04:20.910762 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.910640    2573 scope.go:117] "RemoveContainer" containerID="cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"
Jul 28 12:04:20.912173 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.912146    2573 generic.go:356] "Generic (PLEG): container finished" podID="361003f2-b586-4362-8ce1-c38141bf2aa2" containerID="c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1" exitCode=0
Jul 28 12:04:20.912296 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.912186    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"
Jul 28 12:04:20.912296 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.912191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" event={"ID":"361003f2-b586-4362-8ce1-c38141bf2aa2","Type":"ContainerDied","Data":"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"}
Jul 28 12:04:20.912296 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.912255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r" event={"ID":"361003f2-b586-4362-8ce1-c38141bf2aa2","Type":"ContainerDied","Data":"6b146c3b344a71ba6ab996784f149c20f0dea343c29f3be450340516a7351a8d"}
Jul 28 12:04:20.920788 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.920777    2573 scope.go:117] "RemoveContainer" containerID="cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"
Jul 28 12:04:20.921023 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:04:20.921006    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3\": container with ID starting with cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3 not found: ID does not exist" containerID="cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"
Jul 28 12:04:20.921083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.921030    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3"} err="failed to get container status \"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3\": rpc error: code = NotFound desc = could not find container \"cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3\": container with ID starting with cb6da547c3f06c78dd7cf181a3a133d3e37ef8eda3b7280bf00799cbc4c57bf3 not found: ID does not exist"
Jul 28 12:04:20.921083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.921046    2573 scope.go:117] "RemoveContainer" containerID="c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"
Jul 28 12:04:20.929769 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.929754    2573 scope.go:117] "RemoveContainer" containerID="c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"
Jul 28 12:04:20.929998 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:04:20.929970    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1\": container with ID starting with c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1 not found: ID does not exist" containerID="c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"
Jul 28 12:04:20.930044 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.929997    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1"} err="failed to get container status \"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1\": rpc error: code = NotFound desc = could not find container \"c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1\": container with ID starting with c063bf9ae0e8689e7f0b925f67ae44b47e7b54ed6eaaa13e6a4adb2dd3600bf1 not found: ID does not exist"
Jul 28 12:04:20.936359 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.936340    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:04:20.942114 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.942090    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e937708-999cff494-cjn2r"]
Jul 28 12:04:20.952810 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.952787    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:04:20.956625 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:20.956603    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7e937708-6989d69d8d-znwgz"]
Jul 28 12:04:21.270298 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:21.270216    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" path="/var/lib/kubelet/pods/1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e/volumes"
Jul 28 12:04:21.270661 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:21.270648    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361003f2-b586-4362-8ce1-c38141bf2aa2" path="/var/lib/kubelet/pods/361003f2-b586-4362-8ce1-c38141bf2aa2/volumes"
Jul 28 12:04:24.821604 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:24.821576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:25.079712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:25.079629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:25.295121 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:25.295082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:25.624770 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:25.624737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:25.759134 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:25.759104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:26.025718 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:26.025636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:26.384354 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:26.384315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:27.633524 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:27.633486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:29.459594 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.459560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:29.565813 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.565784    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:04:29.566236 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566224    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361003f2-b586-4362-8ce1-c38141bf2aa2" containerName="maas-api"
Jul 28 12:04:29.566282 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566238    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="361003f2-b586-4362-8ce1-c38141bf2aa2" containerName="maas-api"
Jul 28 12:04:29.566282 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566261    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" containerName="payload-pre-processing"
Jul 28 12:04:29.566282 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566267    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" containerName="payload-pre-processing"
Jul 28 12:04:29.566377 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566332    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb3d9ed-e3de-44f5-9c82-4d1abb03ec9e" containerName="payload-pre-processing"
Jul 28 12:04:29.566377 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.566343    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="361003f2-b586-4362-8ce1-c38141bf2aa2" containerName="maas-api"
Jul 28 12:04:29.570811 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.570794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.573829 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.573805    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c98bc341-serving-cert\""
Jul 28 12:04:29.586169 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.586145    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:04:29.603619 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.603588    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:29.641389 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.641354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.641517 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.641420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kzp\" (UniqueName: \"kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.641583 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.641564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.742798 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.742725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.742798 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.742790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kzp\" (UniqueName: \"kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.742974 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.742864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.742974 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:04:29.742867    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-serving-cert: secret "maas-api-e2e-migrate-c98bc341-serving-cert" not found
Jul 28 12:04:29.743039 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:04:29.742973    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls podName:a6cf6b38-331f-4c91-9e8d-38b342d011f8 nodeName:}" failed. No retries permitted until 2026-07-28 12:04:30.242934053 +0000 UTC m=+2033.431535032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls") pod "maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" (UID: "a6cf6b38-331f-4c91-9e8d-38b342d011f8") : secret "maas-api-e2e-migrate-c98bc341-serving-cert" not found
Jul 28 12:04:29.743516 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.743496    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.754434 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.754402    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kzp\" (UniqueName: \"kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:29.919063 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:29.919026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:30.221542 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.221507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:30.248823 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.248796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:30.251499 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.251467    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") pod \"maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:30.334213 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.334168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:04:30.481039 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.480949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:30.843325 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.843302    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:04:30.845078 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:04:30.845047    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cf6b38_331f_4c91_9e8d_38b342d011f8.slice/crio-43524bf9d9f9e840839b5109780223fe2f6ee9dd8230f4da3762718d0bbda5bb WatchSource:0}: Error finding container 43524bf9d9f9e840839b5109780223fe2f6ee9dd8230f4da3762718d0bbda5bb: Status 404 returned error can't find the container with id 43524bf9d9f9e840839b5109780223fe2f6ee9dd8230f4da3762718d0bbda5bb
Jul 28 12:04:30.977391 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:30.977356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" event={"ID":"a6cf6b38-331f-4c91-9e8d-38b342d011f8","Type":"ContainerStarted","Data":"43524bf9d9f9e840839b5109780223fe2f6ee9dd8230f4da3762718d0bbda5bb"}
Jul 28 12:04:31.985205 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:31.985165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" event={"ID":"a6cf6b38-331f-4c91-9e8d-38b342d011f8","Type":"ContainerStarted","Data":"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"}
Jul 28 12:04:31.985666 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:31.985240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:32.008177 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:32.008125    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" podStartSLOduration=2.661417911 podStartE2EDuration="3.008110926s" totalImagesPullingTime="346.693015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:04:32.004484591 +0000 UTC m=+2035.193085609" watchObservedRunningTime="2026-07-28 12:04:32.008110926 +0000 UTC m=+2035.196711934"
Jul 28 12:04:37.997469 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:37.997439    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:04:54.716695 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.716660    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"]
Jul 28 12:04:54.720416 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.720376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:54.723778 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.723760    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:04:54.734334 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.734290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"]
Jul 28 12:04:54.779287 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.779255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr\" (UID: \"c14e6750-8207-4b92-8fc5-2fd92512aace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:54.880272 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.880235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr\" (UID: \"c14e6750-8207-4b92-8fc5-2fd92512aace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:54.880876 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:54.880855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr\" (UID: \"c14e6750-8207-4b92-8fc5-2fd92512aace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:55.030831 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:55.030751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:55.176357 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:55.176323    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"]
Jul 28 12:04:55.177717 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:04:55.177691    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14e6750_8207_4b92_8fc5_2fd92512aace.slice/crio-6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191 WatchSource:0}: Error finding container 6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191: Status 404 returned error can't find the container with id 6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191
Jul 28 12:04:56.124819 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:56.124786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr" event={"ID":"c14e6750-8207-4b92-8fc5-2fd92512aace","Type":"ContainerStarted","Data":"6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191"}
Jul 28 12:04:58.139046 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:58.139008    2573 generic.go:356] "Generic (PLEG): container finished" podID="c14e6750-8207-4b92-8fc5-2fd92512aace" containerID="44454bba4c05afd09bfb2619c62b030f339abd2120e620d6970bbbc57141b47b" exitCode=0
Jul 28 12:04:58.139402 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:58.139087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr" event={"ID":"c14e6750-8207-4b92-8fc5-2fd92512aace","Type":"ContainerDied","Data":"44454bba4c05afd09bfb2619c62b030f339abd2120e620d6970bbbc57141b47b"}
Jul 28 12:04:59.285861 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:59.285837    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:04:59.322859 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:59.322829    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca\") pod \"c14e6750-8207-4b92-8fc5-2fd92512aace\" (UID: \"c14e6750-8207-4b92-8fc5-2fd92512aace\") "
Jul 28 12:04:59.323161 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:59.323137    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c14e6750-8207-4b92-8fc5-2fd92512aace" (UID: "c14e6750-8207-4b92-8fc5-2fd92512aace"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:04:59.424612 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:04:59.424513    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14e6750-8207-4b92-8fc5-2fd92512aace-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:05:00.152747 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:00.152710    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"
Jul 28 12:05:00.152946 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:00.152714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr" event={"ID":"c14e6750-8207-4b92-8fc5-2fd92512aace","Type":"ContainerDied","Data":"6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191"}
Jul 28 12:05:00.152946 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:00.152847    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f86d96b8ad2f1ef6a649dfc19416f1fe0b8b0675753a279392c236b6083b191"
Jul 28 12:05:05.454659 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.454616    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:05:05.455435 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.454906    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" podUID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" containerName="maas-api" containerID="cri-o://cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c" gracePeriod=30
Jul 28 12:05:05.526453 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.526373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:05.663823 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.663789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:05.706302 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.706251    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:05:05.786537 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.786506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") pod \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") "
Jul 28 12:05:05.786745 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.786585    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca\") pod \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") "
Jul 28 12:05:05.786745 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.786607    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5kzp\" (UniqueName: \"kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp\") pod \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\" (UID: \"a6cf6b38-331f-4c91-9e8d-38b342d011f8\") "
Jul 28 12:05:05.786973 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.786945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6cf6b38-331f-4c91-9e8d-38b342d011f8" (UID: "a6cf6b38-331f-4c91-9e8d-38b342d011f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:05:05.788724 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.788698    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp" (OuterVolumeSpecName: "kube-api-access-v5kzp") pod "a6cf6b38-331f-4c91-9e8d-38b342d011f8" (UID: "a6cf6b38-331f-4c91-9e8d-38b342d011f8"). InnerVolumeSpecName "kube-api-access-v5kzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:05:05.788840 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.788773    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6cf6b38-331f-4c91-9e8d-38b342d011f8" (UID: "a6cf6b38-331f-4c91-9e8d-38b342d011f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:05:05.810041 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.810011    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:05.888281 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.888248    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6cf6b38-331f-4c91-9e8d-38b342d011f8-maas-api-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:05:05.888281 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.888275    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cf6b38-331f-4c91-9e8d-38b342d011f8-openshift-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:05:05.888281 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:05.888287    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5kzp\" (UniqueName: \"kubernetes.io/projected/a6cf6b38-331f-4c91-9e8d-38b342d011f8-kube-api-access-v5kzp\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:05:06.189914 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.189880    2573 generic.go:356] "Generic (PLEG): container finished" podID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" containerID="cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c" exitCode=0
Jul 28 12:05:06.190094 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.189924    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"
Jul 28 12:05:06.190094 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.189966    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" event={"ID":"a6cf6b38-331f-4c91-9e8d-38b342d011f8","Type":"ContainerDied","Data":"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"}
Jul 28 12:05:06.190094 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.190021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs" event={"ID":"a6cf6b38-331f-4c91-9e8d-38b342d011f8","Type":"ContainerDied","Data":"43524bf9d9f9e840839b5109780223fe2f6ee9dd8230f4da3762718d0bbda5bb"}
Jul 28 12:05:06.190094 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.190044    2573 scope.go:117] "RemoveContainer" containerID="cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"
Jul 28 12:05:06.199819 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.199807    2573 scope.go:117] "RemoveContainer" containerID="cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"
Jul 28 12:05:06.200075 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:05:06.200056    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c\": container with ID starting with cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c not found: ID does not exist" containerID="cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"
Jul 28 12:05:06.200119 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.200084    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c"} err="failed to get container status \"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c\": rpc error: code = NotFound desc = could not find container \"cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c\": container with ID starting with cc3594b5909ebbd7049ee7e2a8a1c51d4954ebda0ce5c37b34f0193b0757849c not found: ID does not exist"
Jul 28 12:05:06.216280 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.216259    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:05:06.224004 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:06.223982    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c98bc341-5945c5c88-gmvvs"]
Jul 28 12:05:07.267752 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:07.267712    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" path="/var/lib/kubelet/pods/a6cf6b38-331f-4c91-9e8d-38b342d011f8/volumes"
Jul 28 12:05:09.826166 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:09.826125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:09.827541 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:09.827515    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"]
Jul 28 12:05:09.830947 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:09.830925    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c98bc341-7bnxr"]
Jul 28 12:05:10.031338 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:10.031297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:10.271450 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:10.271420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:10.529437 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:10.529296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:10.898415 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:10.898365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:11.096117 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:11.096071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:11.268127 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:11.268048    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14e6750-8207-4b92-8fc5-2fd92512aace" path="/var/lib/kubelet/pods/c14e6750-8207-4b92-8fc5-2fd92512aace/volumes"
Jul 28 12:05:13.502196 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:13.502160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:13.610046 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:13.610014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:13.704136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:13.704104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:13.797120 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:13.797037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:14.340696 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:14.340668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:14.452124 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:14.452094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:38.605260 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:38.605135    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:05:38.613397 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:38.611375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:05:39.417668 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.417631    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"]
Jul 28 12:05:39.418148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418128    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" containerName="maas-api"
Jul 28 12:05:39.418256 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418149    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" containerName="maas-api"
Jul 28 12:05:39.418256 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418199    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14e6750-8207-4b92-8fc5-2fd92512aace" containerName="revoke-keys"
Jul 28 12:05:39.418256 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418209    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14e6750-8207-4b92-8fc5-2fd92512aace" containerName="revoke-keys"
Jul 28 12:05:39.418432 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418326    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14e6750-8207-4b92-8fc5-2fd92512aace" containerName="revoke-keys"
Jul 28 12:05:39.418432 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.418345    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6cf6b38-331f-4c91-9e8d-38b342d011f8" containerName="maas-api"
Jul 28 12:05:39.421618 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.421593    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:39.424368 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.424318    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:05:39.429285 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.429025    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"]
Jul 28 12:05:39.511694 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.511659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq\" (UID: \"5dee8518-47d5-428a-b7d0-b9762dd7fc6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:39.612638 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.612604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq\" (UID: \"5dee8518-47d5-428a-b7d0-b9762dd7fc6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:39.613179 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.613161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq\" (UID: \"5dee8518-47d5-428a-b7d0-b9762dd7fc6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:39.734505 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.734426    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:39.871423 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:39.871395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"]
Jul 28 12:05:39.874003 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:05:39.873975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dee8518_47d5_428a_b7d0_b9762dd7fc6f.slice/crio-72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4 WatchSource:0}: Error finding container 72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4: Status 404 returned error can't find the container with id 72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4
Jul 28 12:05:40.403896 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:40.403858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq" event={"ID":"5dee8518-47d5-428a-b7d0-b9762dd7fc6f","Type":"ContainerStarted","Data":"079bb1ab3db7eef0523c4ce2c9b5d28ef342cf2ab40ef4b3637c439b84e0614c"}
Jul 28 12:05:40.404069 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:40.403913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq" event={"ID":"5dee8518-47d5-428a-b7d0-b9762dd7fc6f","Type":"ContainerStarted","Data":"72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4"}
Jul 28 12:05:40.421966 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:40.421909    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq" podStartSLOduration=1.421895701 podStartE2EDuration="1.421895701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:05:40.419276987 +0000 UTC m=+2103.607878007" watchObservedRunningTime="2026-07-28 12:05:40.421895701 +0000 UTC m=+2103.610496699"
Jul 28 12:05:41.411068 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:41.411029    2573 generic.go:356] "Generic (PLEG): container finished" podID="5dee8518-47d5-428a-b7d0-b9762dd7fc6f" containerID="079bb1ab3db7eef0523c4ce2c9b5d28ef342cf2ab40ef4b3637c439b84e0614c" exitCode=0
Jul 28 12:05:41.411483 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:41.411075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq" event={"ID":"5dee8518-47d5-428a-b7d0-b9762dd7fc6f","Type":"ContainerDied","Data":"079bb1ab3db7eef0523c4ce2c9b5d28ef342cf2ab40ef4b3637c439b84e0614c"}
Jul 28 12:05:42.562228 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:42.562202    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:42.642034 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:42.642005    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca\") pod \"5dee8518-47d5-428a-b7d0-b9762dd7fc6f\" (UID: \"5dee8518-47d5-428a-b7d0-b9762dd7fc6f\") "
Jul 28 12:05:42.642437 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:42.642413    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5dee8518-47d5-428a-b7d0-b9762dd7fc6f" (UID: "5dee8518-47d5-428a-b7d0-b9762dd7fc6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:05:42.743063 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:42.742977    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dee8518-47d5-428a-b7d0-b9762dd7fc6f-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:05:43.423815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:43.423785    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"
Jul 28 12:05:43.423815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:43.423794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq" event={"ID":"5dee8518-47d5-428a-b7d0-b9762dd7fc6f","Type":"ContainerDied","Data":"72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4"}
Jul 28 12:05:43.424021 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:43.423843    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72aae6defafc177bff4f1f6d14da749c9ceb6f395041c653eba4a9de043416e4"
Jul 28 12:05:49.900620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:49.900587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:49.970537 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:49.970498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:50.040139 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:50.040105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:54.523840 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:54.523808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:54.536274 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:54.536246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"]
Jul 28 12:05:54.538764 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:54.538743    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ae7b06d1-zchdq"]
Jul 28 12:05:55.269490 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:55.269458    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dee8518-47d5-428a-b7d0-b9762dd7fc6f" path="/var/lib/kubelet/pods/5dee8518-47d5-428a-b7d0-b9762dd7fc6f/volumes"
Jul 28 12:05:55.802697 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:55.802667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:56.017642 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:56.017577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:56.258082 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:56.258024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:56.690904 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:56.690873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:56.873832 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:56.873801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:58.756966 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:58.756934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:58.856550 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:58.856519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:58.959574 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:58.959544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:59.358268 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:59.358231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:59.583648 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:59.583614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:05:59.683758 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:05:59.683724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:15.269941 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:15.269909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:34.032546 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:34.032508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:34.104613 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:34.104544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:34.223676 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:34.223638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:38.646479 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:38.646443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:38.817459 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:38.817424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:39.046878 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:39.046792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:39.531593 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:39.531558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:39.628607 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:39.628575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:39.729717 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:39.729688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:41.179003 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:41.178972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:47.684043 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:47.684003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:48.457361 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:48.457329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:06:48.557065 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:06:48.557029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:14.528171 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:14.528132    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:21.485999 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:21.485961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:21.598504 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:21.598471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:21.708229 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:21.708196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:37.657000 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:37.656964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:43.848700 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:43.848668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:43.913463 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:43.913431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:43.999085 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:43.999050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:44.117462 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:44.117366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:54.649358 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:54.649325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:07:55.499682 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:07:55.499647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:02.287809 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:02.287728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:02.401829 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:02.401794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:02.505576 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:02.505545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:02.596974 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:02.596901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:16.322078 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:16.322041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:18.137426 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:18.137369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:18.336786 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:18.336753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:26.449158 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:26.449114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:26.666377 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:26.666341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:32.421798 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:32.421762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:32.504199 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:32.504163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:32.680341 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:32.680248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:33.045551 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:33.045453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:33.247390 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:33.247348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:35.991956 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:35.991916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:36.091087 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:36.091056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:36.342282 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:36.342209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:36.866270 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:36.866229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:37.129539 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:37.129506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:37.217187 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:37.217139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:40.546968 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:40.546937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:41.255907 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:41.255878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:41.366942 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:41.366904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:41.692133 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:41.692102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:48.002290 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.002251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:48.084188 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.084152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:48.389625 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.389588    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"]
Jul 28 12:08:48.390085 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.390067    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dee8518-47d5-428a-b7d0-b9762dd7fc6f" containerName="revoke-keys"
Jul 28 12:08:48.390187 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.390088    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dee8518-47d5-428a-b7d0-b9762dd7fc6f" containerName="revoke-keys"
Jul 28 12:08:48.390246 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.390219    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dee8518-47d5-428a-b7d0-b9762dd7fc6f" containerName="revoke-keys"
Jul 28 12:08:48.393446 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.393427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:48.396729 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.396712    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:08:48.404874 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.404851    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"]
Jul 28 12:08:48.546549 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.546519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9055f75e-gk9px\" (UID: \"00743032-1441-4bd9-9fa4-cdcb33e48737\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:48.648054 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.647967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9055f75e-gk9px\" (UID: \"00743032-1441-4bd9-9fa4-cdcb33e48737\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:48.648568 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.648551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9055f75e-gk9px\" (UID: \"00743032-1441-4bd9-9fa4-cdcb33e48737\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:48.704862 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.704834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:48.841905 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:48.841879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"]
Jul 28 12:08:48.843911 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:08:48.843889    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00743032_1441_4bd9_9fa4_cdcb33e48737.slice/crio-d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a WatchSource:0}: Error finding container d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a: Status 404 returned error can't find the container with id d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a
Jul 28 12:08:49.531255 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:49.531220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px" event={"ID":"00743032-1441-4bd9-9fa4-cdcb33e48737","Type":"ContainerStarted","Data":"2bfd61aad7ddbc6a2952f09eb05443470d41839f678fb3449c5b129f74bf0a92"}
Jul 28 12:08:49.531651 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:49.531281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px" event={"ID":"00743032-1441-4bd9-9fa4-cdcb33e48737","Type":"ContainerStarted","Data":"d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a"}
Jul 28 12:08:49.549098 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:49.549042    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px" podStartSLOduration=1.549027307 podStartE2EDuration="1.549027307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:08:49.547283564 +0000 UTC m=+2292.735884579" watchObservedRunningTime="2026-07-28 12:08:49.549027307 +0000 UTC m=+2292.737628303"
Jul 28 12:08:50.538559 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:50.538521    2573 generic.go:356] "Generic (PLEG): container finished" podID="00743032-1441-4bd9-9fa4-cdcb33e48737" containerID="2bfd61aad7ddbc6a2952f09eb05443470d41839f678fb3449c5b129f74bf0a92" exitCode=0
Jul 28 12:08:50.538944 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:50.538609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px" event={"ID":"00743032-1441-4bd9-9fa4-cdcb33e48737","Type":"ContainerDied","Data":"2bfd61aad7ddbc6a2952f09eb05443470d41839f678fb3449c5b129f74bf0a92"}
Jul 28 12:08:51.681264 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:51.681241    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:51.777999 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:51.777967    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca\") pod \"00743032-1441-4bd9-9fa4-cdcb33e48737\" (UID: \"00743032-1441-4bd9-9fa4-cdcb33e48737\") "
Jul 28 12:08:51.778318 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:51.778294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00743032-1441-4bd9-9fa4-cdcb33e48737" (UID: "00743032-1441-4bd9-9fa4-cdcb33e48737"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:08:51.879693 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:51.879655    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00743032-1441-4bd9-9fa4-cdcb33e48737-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:08:52.553606 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:52.553561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px" event={"ID":"00743032-1441-4bd9-9fa4-cdcb33e48737","Type":"ContainerDied","Data":"d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a"}
Jul 28 12:08:52.553818 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:52.553669    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d71e143db231c2f331e8e06071d4fd3abb9bd5d7a5a1b719d53625d632c0b92a"
Jul 28 12:08:52.553818 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:52.553750    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"
Jul 28 12:08:58.938361 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:58.938326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:59.038873 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:59.038843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:08:59.139284 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:08:59.139245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:03.489099 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:03.489045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:03.504185 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:03.504155    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"]
Jul 28 12:09:03.508099 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:03.508077    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9055f75e-gk9px"]
Jul 28 12:09:03.952722 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:03.952693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:05.271556 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:05.269824    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00743032-1441-4bd9-9fa4-cdcb33e48737" path="/var/lib/kubelet/pods/00743032-1441-4bd9-9fa4-cdcb33e48737/volumes"
Jul 28 12:09:10.373165 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:10.373128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:10.475792 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:10.475754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:10.704061 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:10.703976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:10.957966 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:10.957884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:11.108991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:11.108956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:11.209145 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:11.209057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:11.353647 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:11.353612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:18.054429 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:18.054353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:18.162951 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:18.162914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:18.251405 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:18.251351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:18.429202 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:18.429159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:24.827074 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:24.827017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:24.926945 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:24.926916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:31.917579 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:31.917494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:32.220712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:32.220628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:32.472341 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:32.472259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:35.279684 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:35.279650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:35.380328 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:35.380296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:35.570339 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:35.570259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:35.832729 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:35.832642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:36.898803 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:36.898767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:37.013006 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:37.012969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:39.856917 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:39.856880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:09:46.338039 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:09:46.338003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:19.830657 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.830620    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"]
Jul 28 12:10:19.831139 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.831028    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00743032-1441-4bd9-9fa4-cdcb33e48737" containerName="revoke-keys"
Jul 28 12:10:19.831139 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.831039    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="00743032-1441-4bd9-9fa4-cdcb33e48737" containerName="revoke-keys"
Jul 28 12:10:19.831212 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.831142    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="00743032-1441-4bd9-9fa4-cdcb33e48737" containerName="revoke-keys"
Jul 28 12:10:19.834092 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.834075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:19.836733 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.836712    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:10:19.842057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:19.842035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"]
Jul 28 12:10:20.018285 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:20.018254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs\" (UID: \"18aeec33-60bc-489a-adee-c7d53f0e2585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:20.119791 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:20.119709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs\" (UID: \"18aeec33-60bc-489a-adee-c7d53f0e2585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:20.120356 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:20.120329    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs\" (UID: \"18aeec33-60bc-489a-adee-c7d53f0e2585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:20.146813 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:20.146788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:20.487869 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:20.487839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"]
Jul 28 12:10:20.489264 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:10:20.489221    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18aeec33_60bc_489a_adee_c7d53f0e2585.slice/crio-8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3 WatchSource:0}: Error finding container 8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3: Status 404 returned error can't find the container with id 8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3
Jul 28 12:10:21.071031 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:21.070947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs" event={"ID":"18aeec33-60bc-489a-adee-c7d53f0e2585","Type":"ContainerStarted","Data":"34040b4ee6a96912c2c230279a2be5a8dc06d846f54da9b041289373cd47a97b"}
Jul 28 12:10:21.071031 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:21.071004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs" event={"ID":"18aeec33-60bc-489a-adee-c7d53f0e2585","Type":"ContainerStarted","Data":"8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3"}
Jul 28 12:10:21.086427 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:21.086369    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs" podStartSLOduration=2.086354884 podStartE2EDuration="2.086354884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:10:21.086042165 +0000 UTC m=+2384.274643163" watchObservedRunningTime="2026-07-28 12:10:21.086354884 +0000 UTC m=+2384.274955883"
Jul 28 12:10:22.079565 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:22.079528    2573 generic.go:356] "Generic (PLEG): container finished" podID="18aeec33-60bc-489a-adee-c7d53f0e2585" containerID="34040b4ee6a96912c2c230279a2be5a8dc06d846f54da9b041289373cd47a97b" exitCode=0
Jul 28 12:10:22.079951 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:22.079610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs" event={"ID":"18aeec33-60bc-489a-adee-c7d53f0e2585","Type":"ContainerDied","Data":"34040b4ee6a96912c2c230279a2be5a8dc06d846f54da9b041289373cd47a97b"}
Jul 28 12:10:23.224036 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:23.224013    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:23.248971 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:23.248947    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca\") pod \"18aeec33-60bc-489a-adee-c7d53f0e2585\" (UID: \"18aeec33-60bc-489a-adee-c7d53f0e2585\") "
Jul 28 12:10:23.249315 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:23.249296    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18aeec33-60bc-489a-adee-c7d53f0e2585" (UID: "18aeec33-60bc-489a-adee-c7d53f0e2585"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:10:23.349807 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:23.349717    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18aeec33-60bc-489a-adee-c7d53f0e2585-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:10:24.092635 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:24.092610    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"
Jul 28 12:10:24.092804 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:24.092649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs" event={"ID":"18aeec33-60bc-489a-adee-c7d53f0e2585","Type":"ContainerDied","Data":"8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3"}
Jul 28 12:10:24.092804 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:24.092697    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8954289c2921454c5cf074cce8022487eabbc39f0e9f903a3a351b57135b61c3"
Jul 28 12:10:36.311157 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:36.311125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:36.411287 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:36.411254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:36.512721 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:36.512682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:38.646859 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:38.646833    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:10:38.653197 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:38.653177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:10:39.910182 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:39.910132    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:39.917245 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:39.917214    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"]
Jul 28 12:10:39.922993 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:39.922956    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7038fa7e-nmjzs"]
Jul 28 12:10:41.268196 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:41.268164    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18aeec33-60bc-489a-adee-c7d53f0e2585" path="/var/lib/kubelet/pods/18aeec33-60bc-489a-adee-c7d53f0e2585/volumes"
Jul 28 12:10:43.613117 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:43.613077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:10:48.702065 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:10:48.702028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:25.738587 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:25.738507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:26.262206 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:26.262173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:32.104584 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:32.104549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:32.200294 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:32.200262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:32.387188 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:32.387158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:32.627601 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:32.627563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:33.349829 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:33.349787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:33.449732 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:33.449700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:33.714836 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:33.714796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:33.806702 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:33.806661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:33.909160 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:33.909126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:34.653522 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:34.653489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:34.754468 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:34.754439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:34.856127 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:34.856089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:36.252994 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:36.252956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:37.556567 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:37.556527    2573 scope.go:117] "RemoveContainer" containerID="44454bba4c05afd09bfb2619c62b030f339abd2120e620d6970bbbc57141b47b"
Jul 28 12:11:40.464896 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:40.464858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:40.565987 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:40.565954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:42.949980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:42.949946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:43.051301 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:43.051272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:43.687932 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:43.687904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:50.420094 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:50.420047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:50.533542 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:50.533505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:11:50.623511 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:11:50.623478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:01.159813 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:01.159778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:01.500995 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:01.500910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:22.583594 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:22.583558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:29.039822 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:29.039707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:29.206027 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:29.205989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:29.421597 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:29.421558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:29.749417 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:29.749317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:29.915392 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:29.915355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:33.188691 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:33.188653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:33.278917 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:33.278883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:33.352315 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:33.352280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:33.844215 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:33.844171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:34.008394 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:34.008357    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:34.112400 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:34.112307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:35.690043 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:35.690012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:37.582095 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:37.582064    2573 scope.go:117] "RemoveContainer" containerID="079bb1ab3db7eef0523c4ce2c9b5d28ef342cf2ab40ef4b3637c439b84e0614c"
Jul 28 12:12:37.687736 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:37.687702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:38.160453 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:38.160410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:38.400419 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:38.400373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:38.543589 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:38.543514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:41.244903 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:41.244852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:41.341826 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:41.341790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:41.418915 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:41.418884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:41.951650 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:41.951622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:42.067816 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:42.067788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:42.245228 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:42.245134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:45.814744 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:45.814712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:12:49.221657 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:12:49.221621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:13:08.948092 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:13:08.948059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:13:15.033851 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:13:15.033798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:13:19.438184 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:13:19.438149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:13:42.178399 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:13:42.178361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:00.559347 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:00.559264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:01.525815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.525780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:01.619317 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.619283    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"]
Jul 28 12:14:01.619745 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.619731    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18aeec33-60bc-489a-adee-c7d53f0e2585" containerName="revoke-keys"
Jul 28 12:14:01.619789 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.619747    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="18aeec33-60bc-489a-adee-c7d53f0e2585" containerName="revoke-keys"
Jul 28 12:14:01.619837 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.619828    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="18aeec33-60bc-489a-adee-c7d53f0e2585" containerName="revoke-keys"
Jul 28 12:14:01.622826 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.622809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:01.625583 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.625562    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:14:01.631595 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.630047    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"]
Jul 28 12:14:01.669915 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.669889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21898b-vx855\" (UID: \"f94ce550-39c5-44e2-b7c1-37f406a48b4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:01.771405 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.771352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21898b-vx855\" (UID: \"f94ce550-39c5-44e2-b7c1-37f406a48b4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:01.771998 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.771973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21898b-vx855\" (UID: \"f94ce550-39c5-44e2-b7c1-37f406a48b4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:01.936813 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:01.936777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:02.076623 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:14:02.076592    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94ce550_39c5_44e2_b7c1_37f406a48b4e.slice/crio-529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e WatchSource:0}: Error finding container 529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e: Status 404 returned error can't find the container with id 529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e
Jul 28 12:14:02.077696 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:02.077666    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"]
Jul 28 12:14:02.408459 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:02.408421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855" event={"ID":"f94ce550-39c5-44e2-b7c1-37f406a48b4e","Type":"ContainerStarted","Data":"8af35ff6d03814a54e435de9fea680d30077053c82a210acca45e6451db9f3f0"}
Jul 28 12:14:02.408613 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:02.408484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855" event={"ID":"f94ce550-39c5-44e2-b7c1-37f406a48b4e","Type":"ContainerStarted","Data":"529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e"}
Jul 28 12:14:02.426350 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:02.426306    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855" podStartSLOduration=1.4262937 podStartE2EDuration="1.4262937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:14:02.424049079 +0000 UTC m=+2605.612650075" watchObservedRunningTime="2026-07-28 12:14:02.4262937 +0000 UTC m=+2605.614894703"
Jul 28 12:14:03.416274 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:03.416241    2573 generic.go:356] "Generic (PLEG): container finished" podID="f94ce550-39c5-44e2-b7c1-37f406a48b4e" containerID="8af35ff6d03814a54e435de9fea680d30077053c82a210acca45e6451db9f3f0" exitCode=0
Jul 28 12:14:03.416664 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:03.416313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855" event={"ID":"f94ce550-39c5-44e2-b7c1-37f406a48b4e","Type":"ContainerDied","Data":"8af35ff6d03814a54e435de9fea680d30077053c82a210acca45e6451db9f3f0"}
Jul 28 12:14:04.562915 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:04.562890    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:04.698074 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:04.697981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca\") pod \"f94ce550-39c5-44e2-b7c1-37f406a48b4e\" (UID: \"f94ce550-39c5-44e2-b7c1-37f406a48b4e\") "
Jul 28 12:14:04.698322 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:04.698300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f94ce550-39c5-44e2-b7c1-37f406a48b4e" (UID: "f94ce550-39c5-44e2-b7c1-37f406a48b4e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:14:04.799198 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:04.799169    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94ce550-39c5-44e2-b7c1-37f406a48b4e-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:14:05.429790 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:05.429757    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"
Jul 28 12:14:05.429954 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:05.429793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855" event={"ID":"f94ce550-39c5-44e2-b7c1-37f406a48b4e","Type":"ContainerDied","Data":"529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e"}
Jul 28 12:14:05.429954 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:05.429845    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="529d3445e9603d98f4ff2dc9d675bcc95e3396f2bd88f4a2ef1978eed1804e9e"
Jul 28 12:14:12.196350 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:12.196317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:12.296958 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:12.296926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:12.358215 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:12.358178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:16.706431 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:16.706350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:16.718692 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:16.718661    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"]
Jul 28 12:14:16.721184 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:16.721161    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21898b-vx855"]
Jul 28 12:14:17.134555 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:17.134517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:17.268342 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:17.268301    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94ce550-39c5-44e2-b7c1-37f406a48b4e" path="/var/lib/kubelet/pods/f94ce550-39c5-44e2-b7c1-37f406a48b4e/volumes"
Jul 28 12:14:23.409064 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:23.409033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:23.470433 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:23.470378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:23.764270 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:23.764175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:23.921884 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:23.921849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:34.545097 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:34.545062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:34.613909 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:34.613877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:34.714577 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:34.714545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:39.139721 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:39.139676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:39.532277 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:39.532165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:45.700196 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:45.700166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:45.799657 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:45.799622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:46.097266 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:46.097166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:46.316621 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:46.316578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:46.683328 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:46.683296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:47.053049 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:47.052965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:47.186722 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:47.186670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:49.804912 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:49.804853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:49.896888 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:49.896854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:49.971633 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:49.971600    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:50.312970 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:50.312932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:50.530532 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:50.530500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:50.624648 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:50.624620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:54.348798 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:54.348763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:54.889598 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:54.889562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:55.230258 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:55.230161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:55.417447 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:55.417409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:57.969535 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:57.969502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.042736 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.042690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.230000 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.229917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.331950 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.331910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.783181 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.783150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.878133 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.878094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:14:58.920207 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.920174    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:14:58.920652 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.920638    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94ce550-39c5-44e2-b7c1-37f406a48b4e" containerName="revoke-keys"
Jul 28 12:14:58.920652 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.920653    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94ce550-39c5-44e2-b7c1-37f406a48b4e" containerName="revoke-keys"
Jul 28 12:14:58.920748 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.920732    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94ce550-39c5-44e2-b7c1-37f406a48b4e" containerName="revoke-keys"
Jul 28 12:14:58.924071 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.924052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:58.926938 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.926915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-88898f\""
Jul 28 12:14:58.927049 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.926914    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-88898f-dockercfg-fdsbg\""
Jul 28 12:14:58.933721 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:58.933699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:14:59.026287 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.026252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5xt\" (UniqueName: \"kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.026712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.026341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.127579 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.127550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.127749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.127648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5xt\" (UniqueName: \"kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.128236 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.128218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.135945 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.135921    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5xt\" (UniqueName: \"kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt\") pod \"payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") " pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.235751 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.235718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.378211 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.378089    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:14:59.378877 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:14:59.378844    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd85162e_a8e7_4001_b510_99bd73df41ad.slice/crio-02b5d6ed4bf495a9d2adad37e3677d467a4079fb0bbc3320f071940623dfb08b WatchSource:0}: Error finding container 02b5d6ed4bf495a9d2adad37e3677d467a4079fb0bbc3320f071940623dfb08b: Status 404 returned error can't find the container with id 02b5d6ed4bf495a9d2adad37e3677d467a4079fb0bbc3320f071940623dfb08b
Jul 28 12:14:59.762815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.762722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" event={"ID":"cd85162e-a8e7-4001-b510-99bd73df41ad","Type":"ContainerStarted","Data":"955ce73b96b6a6b1e1f8a4f39a593245aa33802ea864a92fd28374a93dd4e43c"}
Jul 28 12:14:59.762815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.762779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" event={"ID":"cd85162e-a8e7-4001-b510-99bd73df41ad","Type":"ContainerStarted","Data":"02b5d6ed4bf495a9d2adad37e3677d467a4079fb0bbc3320f071940623dfb08b"}
Jul 28 12:14:59.762815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.762804    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:14:59.780280 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:14:59.780240    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" podStartSLOduration=1.780225525 podStartE2EDuration="1.780225525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:14:59.779709683 +0000 UTC m=+2662.968310701" watchObservedRunningTime="2026-07-28 12:14:59.780225525 +0000 UTC m=+2662.968826523"
Jul 28 12:15:00.135676 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.135643    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"]
Jul 28 12:15:00.139643 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.139625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"
Jul 28 12:15:00.143346 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.143319    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:15:00.146697 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.146613    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"]
Jul 28 12:15:00.150812 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.150778    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:00.151109 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.151088    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"
Jul 28 12:15:00.153376 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.153209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"
Jul 28 12:15:00.160202 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.160182    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"]
Jul 28 12:15:00.160455 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.160440    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"
Jul 28 12:15:00.166232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.162401    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:00.166232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.165587    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"]
Jul 28 12:15:00.175049 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.175022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"
Jul 28 12:15:00.222163 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.222131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"
Jul 28 12:15:00.401603 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.401581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:00.403704 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:15:00.403669    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf733e013_6a6f_405a_964a_9cff2769b718.slice/crio-a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc WatchSource:0}: Error finding container a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc: Status 404 returned error can't find the container with id a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc
Jul 28 12:15:00.552113 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.552090    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"]
Jul 28 12:15:00.558714 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:15:00.558683    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3725eaa_80e7_4a1e_ae99_51d42908206e.slice/crio-dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc WatchSource:0}: Error finding container dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc: Status 404 returned error can't find the container with id dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc
Jul 28 12:15:00.576436 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.576413    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"]
Jul 28 12:15:00.577495 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:15:00.577468    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc11461_7a2c_47b6_99ea_5304b44df01f.slice/crio-4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f WatchSource:0}: Error finding container 4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f: Status 404 returned error can't find the container with id 4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f
Jul 28 12:15:00.774448 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.774409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246" event={"ID":"0dc11461-7a2c-47b6-99ea-5304b44df01f","Type":"ContainerStarted","Data":"4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f"}
Jul 28 12:15:00.776070 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.776037    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerStarted","Data":"f73e36779f134d715a067d817b7b30b1e91371fc9514639b823390e716991d3f"}
Jul 28 12:15:00.776197 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.776090    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerStarted","Data":"a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc"}
Jul 28 12:15:00.777433 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.777410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl" event={"ID":"f3725eaa-80e7-4a1e-ae99-51d42908206e","Type":"ContainerStarted","Data":"dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc"}
Jul 28 12:15:00.796733 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:00.796676    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" podStartSLOduration=0.796658965 podStartE2EDuration="796.658965ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:15:00.793460888 +0000 UTC m=+2663.982061906" watchObservedRunningTime="2026-07-28 12:15:00.796658965 +0000 UTC m=+2663.985259962"
Jul 28 12:15:01.785313 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.785271    2573 generic.go:356] "Generic (PLEG): container finished" podID="f733e013-6a6f-405a-964a-9cff2769b718" containerID="f73e36779f134d715a067d817b7b30b1e91371fc9514639b823390e716991d3f" exitCode=7
Jul 28 12:15:01.785755 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.785362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerDied","Data":"f73e36779f134d715a067d817b7b30b1e91371fc9514639b823390e716991d3f"}
Jul 28 12:15:01.785755 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.785538    2573 scope.go:117] "RemoveContainer" containerID="f73e36779f134d715a067d817b7b30b1e91371fc9514639b823390e716991d3f"
Jul 28 12:15:01.787041 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.787017    2573 generic.go:356] "Generic (PLEG): container finished" podID="f3725eaa-80e7-4a1e-ae99-51d42908206e" containerID="c6b4ad2be93e53460d93b4636b03fbdc0c608ed8d2fb83f43b8598d0b63711c1" exitCode=0
Jul 28 12:15:01.787147 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.787103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl" event={"ID":"f3725eaa-80e7-4a1e-ae99-51d42908206e","Type":"ContainerDied","Data":"c6b4ad2be93e53460d93b4636b03fbdc0c608ed8d2fb83f43b8598d0b63711c1"}
Jul 28 12:15:01.788949 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.788920    2573 generic.go:356] "Generic (PLEG): container finished" podID="0dc11461-7a2c-47b6-99ea-5304b44df01f" containerID="9847b821a51e258ca84991705e9639b490a98c0fd71d921b114174765bd49c16" exitCode=0
Jul 28 12:15:01.789050 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:01.789020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246" event={"ID":"0dc11461-7a2c-47b6-99ea-5304b44df01f","Type":"ContainerDied","Data":"9847b821a51e258ca84991705e9639b490a98c0fd71d921b114174765bd49c16"}
Jul 28 12:15:02.621675 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.621641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:02.797002 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.796969    2573 generic.go:356] "Generic (PLEG): container finished" podID="f733e013-6a6f-405a-964a-9cff2769b718" containerID="8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3" exitCode=7
Jul 28 12:15:02.797470 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.797031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerDied","Data":"8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3"}
Jul 28 12:15:02.797470 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.797100    2573 scope.go:117] "RemoveContainer" containerID="f73e36779f134d715a067d817b7b30b1e91371fc9514639b823390e716991d3f"
Jul 28 12:15:02.797470 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.797250    2573 scope.go:117] "RemoveContainer" containerID="8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3"
Jul 28 12:15:02.798021 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:15:02.797553    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk_odh-ai-gateway-infra(f733e013-6a6f-405a-964a-9cff2769b718)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" podUID="f733e013-6a6f-405a-964a-9cff2769b718"
Jul 28 12:15:02.939575 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.939550    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"
Jul 28 12:15:02.987329 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:02.987300    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"
Jul 28 12:15:03.805269 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.805242    2573 scope.go:117] "RemoveContainer" containerID="8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3"
Jul 28 12:15:03.805723 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:15:03.805536    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk_odh-ai-gateway-infra(f733e013-6a6f-405a-964a-9cff2769b718)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" podUID="f733e013-6a6f-405a-964a-9cff2769b718"
Jul 28 12:15:03.806432 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.806414    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"
Jul 28 12:15:03.806498 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.806426    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl" event={"ID":"f3725eaa-80e7-4a1e-ae99-51d42908206e","Type":"ContainerDied","Data":"dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc"}
Jul 28 12:15:03.806498 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.806471    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc7a59ab6f815d24842ba73b61726baaae9ea8a05bd088f01f8de55c6b660ccc"
Jul 28 12:15:03.807811 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.807794    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246"
Jul 28 12:15:03.807931 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.807815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754015-6r246" event={"ID":"0dc11461-7a2c-47b6-99ea-5304b44df01f","Type":"ContainerDied","Data":"4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f"}
Jul 28 12:15:03.807931 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:03.807847    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bf29af22217d8ed36ba57ad44ff8ed04341da467867c8e9874ee7c42e4ec23f"
Jul 28 12:15:10.779169 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.779134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:15:10.876259 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876230    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"]
Jul 28 12:15:10.876695 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876681    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc11461-7a2c-47b6-99ea-5304b44df01f" containerName="cleanup"
Jul 28 12:15:10.876746 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876696    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc11461-7a2c-47b6-99ea-5304b44df01f" containerName="cleanup"
Jul 28 12:15:10.876746 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876708    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3725eaa-80e7-4a1e-ae99-51d42908206e" containerName="cleanup"
Jul 28 12:15:10.876746 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876713    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3725eaa-80e7-4a1e-ae99-51d42908206e" containerName="cleanup"
Jul 28 12:15:10.876843 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876780    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc11461-7a2c-47b6-99ea-5304b44df01f" containerName="cleanup"
Jul 28 12:15:10.876843 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.876790    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3725eaa-80e7-4a1e-ae99-51d42908206e" containerName="cleanup"
Jul 28 12:15:10.879496 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.879479    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:10.888323 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.888298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"]
Jul 28 12:15:10.937737 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:10.937708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-560abc-w68c7\" (UID: \"f0f3f542-e29a-4e24-9174-63167c786e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:11.039236 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.039152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-560abc-w68c7\" (UID: \"f0f3f542-e29a-4e24-9174-63167c786e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:11.039789 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.039767    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-560abc-w68c7\" (UID: \"f0f3f542-e29a-4e24-9174-63167c786e8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:11.193035 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.193003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:11.331534 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.331504    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"]
Jul 28 12:15:11.332365 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:15:11.332343    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f3f542_e29a_4e24_9174_63167c786e8e.slice/crio-6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86 WatchSource:0}: Error finding container 6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86: Status 404 returned error can't find the container with id 6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86
Jul 28 12:15:11.862047 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.862013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7" event={"ID":"f0f3f542-e29a-4e24-9174-63167c786e8e","Type":"ContainerStarted","Data":"b54a2feb3ed231f56aaef17c4439343ebe56b6be8aacece910f19392953feda9"}
Jul 28 12:15:11.862428 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.862063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7" event={"ID":"f0f3f542-e29a-4e24-9174-63167c786e8e","Type":"ContainerStarted","Data":"6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86"}
Jul 28 12:15:11.877741 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:11.877688    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7" podStartSLOduration=1.877672976 podStartE2EDuration="1.877672976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:15:11.876468741 +0000 UTC m=+2675.065069748" watchObservedRunningTime="2026-07-28 12:15:11.877672976 +0000 UTC m=+2675.066273973"
Jul 28 12:15:12.870269 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:12.870238    2573 generic.go:356] "Generic (PLEG): container finished" podID="f0f3f542-e29a-4e24-9174-63167c786e8e" containerID="b54a2feb3ed231f56aaef17c4439343ebe56b6be8aacece910f19392953feda9" exitCode=0
Jul 28 12:15:12.870676 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:12.870318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7" event={"ID":"f0f3f542-e29a-4e24-9174-63167c786e8e","Type":"ContainerDied","Data":"b54a2feb3ed231f56aaef17c4439343ebe56b6be8aacece910f19392953feda9"}
Jul 28 12:15:14.016423 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.016398    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:14.066460 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.066432    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca\") pod \"f0f3f542-e29a-4e24-9174-63167c786e8e\" (UID: \"f0f3f542-e29a-4e24-9174-63167c786e8e\") "
Jul 28 12:15:14.066760 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.066739    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0f3f542-e29a-4e24-9174-63167c786e8e" (UID: "f0f3f542-e29a-4e24-9174-63167c786e8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:15:14.167941 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.167859    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f3f542-e29a-4e24-9174-63167c786e8e-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:15:14.884336 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.884308    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"
Jul 28 12:15:14.884505 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.884308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7" event={"ID":"f0f3f542-e29a-4e24-9174-63167c786e8e","Type":"ContainerDied","Data":"6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86"}
Jul 28 12:15:14.884505 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:14.884436    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f9506da4febd09574c4fe6eb66e188c0548eda449c3626496baf499e7becc86"
Jul 28 12:15:18.261102 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:18.261072    2573 scope.go:117] "RemoveContainer" containerID="8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3"
Jul 28 12:15:18.911022 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:18.910989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerStarted","Data":"cdedb7a337b603ff92b4a62cc14f84a80bc423e3bbde1a76b00d52b0b8f209e0"}
Jul 28 12:15:19.919548 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:19.919510    2573 generic.go:356] "Generic (PLEG): container finished" podID="f733e013-6a6f-405a-964a-9cff2769b718" containerID="cdedb7a337b603ff92b4a62cc14f84a80bc423e3bbde1a76b00d52b0b8f209e0" exitCode=0
Jul 28 12:15:19.919959 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:19.919584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerDied","Data":"cdedb7a337b603ff92b4a62cc14f84a80bc423e3bbde1a76b00d52b0b8f209e0"}
Jul 28 12:15:19.919959 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:19.919643    2573 scope.go:117] "RemoveContainer" containerID="8bde537bbe309e5b8e3a43221e64b7c198d1a2b77ac4d06fbe9cbf0fca88e9c3"
Jul 28 12:15:19.941767 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:19.941743    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:21.091217 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.091193    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"
Jul 28 12:15:21.935642 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.935601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk" event={"ID":"f733e013-6a6f-405a-964a-9cff2769b718","Type":"ContainerDied","Data":"a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc"}
Jul 28 12:15:21.935642 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.935629    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"
Jul 28 12:15:21.935864 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.935654    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6868fbdbdaaee15f5a47d2df1b87d8765849da1e8e528f96ae1755419dc13dc"
Jul 28 12:15:21.962613 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.962588    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:21.968475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:21.968454    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-88898f-29754015-zzbrk"]
Jul 28 12:15:23.268511 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:23.268475    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f733e013-6a6f-405a-964a-9cff2769b718" path="/var/lib/kubelet/pods/f733e013-6a6f-405a-964a-9cff2769b718/volumes"
Jul 28 12:15:26.603664 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:26.603621    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"]
Jul 28 12:15:26.606112 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:26.606082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:26.606454 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:26.606433    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-560abc-29754015-6gzrl"]
Jul 28 12:15:26.705055 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:26.705018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:26.806656 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:26.806619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:27.270041 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:27.270000    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3725eaa-80e7-4a1e-ae99-51d42908206e" path="/var/lib/kubelet/pods/f3725eaa-80e7-4a1e-ae99-51d42908206e/volumes"
Jul 28 12:15:30.971616 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:30.971504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:30.972649 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:30.972625    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"]
Jul 28 12:15:30.975153 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:30.975131    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-560abc-w68c7"]
Jul 28 12:15:31.268207 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:31.268124    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f3f542-e29a-4e24-9174-63167c786e8e" path="/var/lib/kubelet/pods/f0f3f542-e29a-4e24-9174-63167c786e8e/volumes"
Jul 28 12:15:31.370619 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:31.370579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:37.621494 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:37.621456    2573 scope.go:117] "RemoveContainer" containerID="2bfd61aad7ddbc6a2952f09eb05443470d41839f678fb3449c5b129f74bf0a92"
Jul 28 12:15:37.632448 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:37.632350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:37.733743 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:37.733701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:37.938612 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:37.938536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:38.184121 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.184088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:38.325796 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.325715    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"]
Jul 28 12:15:38.326186 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326173    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.326230 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326187    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.326230 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326194    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.326230 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326200    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.326230 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f3f542-e29a-4e24-9174-63167c786e8e" containerName="revoke-keys"
Jul 28 12:15:38.326230 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326214    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f3f542-e29a-4e24-9174-63167c786e8e" containerName="revoke-keys"
Jul 28 12:15:38.326419 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326279    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.326419 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326288    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f3f542-e29a-4e24-9174-63167c786e8e" containerName="revoke-keys"
Jul 28 12:15:38.326419 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.326294    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:15:38.329497 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.329481    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:38.331884 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.331863    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:15:38.338214 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.337590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"]
Jul 28 12:15:38.495812 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.495777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-88898f-r5zw6\" (UID: \"8119dca6-49ff-4bb9-9a8b-76894fe85516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:38.597083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.597007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-88898f-r5zw6\" (UID: \"8119dca6-49ff-4bb9-9a8b-76894fe85516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:38.597713 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.597695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-88898f-r5zw6\" (UID: \"8119dca6-49ff-4bb9-9a8b-76894fe85516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:38.641976 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.641948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:38.695631 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.695603    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:15:38.700475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.700454    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:15:38.791262 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:38.791232    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"]
Jul 28 12:15:38.791571 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:15:38.791539    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8119dca6_49ff_4bb9_9a8b_76894fe85516.slice/crio-0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450 WatchSource:0}: Error finding container 0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450: Status 404 returned error can't find the container with id 0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450
Jul 28 12:15:39.044581 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:39.044550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6" event={"ID":"8119dca6-49ff-4bb9-9a8b-76894fe85516","Type":"ContainerStarted","Data":"0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450"}
Jul 28 12:15:40.052638 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:40.052603    2573 generic.go:356] "Generic (PLEG): container finished" podID="8119dca6-49ff-4bb9-9a8b-76894fe85516" containerID="a068d4690f9fbbccc8746a6f6bc83e7c4e8736f40da6f2ad50f68247637d6301" exitCode=0
Jul 28 12:15:40.053007 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:40.052647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6" event={"ID":"8119dca6-49ff-4bb9-9a8b-76894fe85516","Type":"ContainerDied","Data":"a068d4690f9fbbccc8746a6f6bc83e7c4e8736f40da6f2ad50f68247637d6301"}
Jul 28 12:15:41.200191 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:41.200165    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:41.322505 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:41.322431    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca\") pod \"8119dca6-49ff-4bb9-9a8b-76894fe85516\" (UID: \"8119dca6-49ff-4bb9-9a8b-76894fe85516\") "
Jul 28 12:15:41.322761 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:41.322739    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8119dca6-49ff-4bb9-9a8b-76894fe85516" (UID: "8119dca6-49ff-4bb9-9a8b-76894fe85516"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:15:41.423794 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:41.423762    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8119dca6-49ff-4bb9-9a8b-76894fe85516-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:15:42.067117 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:42.067089    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"
Jul 28 12:15:42.067289 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:42.067088    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6" event={"ID":"8119dca6-49ff-4bb9-9a8b-76894fe85516","Type":"ContainerDied","Data":"0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450"}
Jul 28 12:15:42.067289 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:42.067214    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b86577fd5f0c96bda882fe50aa86d50f6a4f7ea363fb2c54cbc781bc54a9450"
Jul 28 12:15:53.917292 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:53.917256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:53.949738 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:53.949532    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:15:53.949934 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:53.949809    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" podUID="cd85162e-a8e7-4001-b510-99bd73df41ad" containerName="payload-processing" containerID="cri-o://955ce73b96b6a6b1e1f8a4f39a593245aa33802ea864a92fd28374a93dd4e43c" gracePeriod=30
Jul 28 12:15:54.015134 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.015103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:54.116364 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.116330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:54.139906 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.139876    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd85162e-a8e7-4001-b510-99bd73df41ad" containerID="955ce73b96b6a6b1e1f8a4f39a593245aa33802ea864a92fd28374a93dd4e43c" exitCode=0
Jul 28 12:15:54.140038 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.139950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" event={"ID":"cd85162e-a8e7-4001-b510-99bd73df41ad","Type":"ContainerDied","Data":"955ce73b96b6a6b1e1f8a4f39a593245aa33802ea864a92fd28374a93dd4e43c"}
Jul 28 12:15:54.218126 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.218096    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:15:54.237655 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.237628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d5xt\" (UniqueName: \"kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt\") pod \"cd85162e-a8e7-4001-b510-99bd73df41ad\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") "
Jul 28 12:15:54.237826 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.237679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume\") pod \"cd85162e-a8e7-4001-b510-99bd73df41ad\" (UID: \"cd85162e-a8e7-4001-b510-99bd73df41ad\") "
Jul 28 12:15:54.238178 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.238150    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd85162e-a8e7-4001-b510-99bd73df41ad" (UID: "cd85162e-a8e7-4001-b510-99bd73df41ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:15:54.240780 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.240713    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt" (OuterVolumeSpecName: "kube-api-access-2d5xt") pod "cd85162e-a8e7-4001-b510-99bd73df41ad" (UID: "cd85162e-a8e7-4001-b510-99bd73df41ad"). InnerVolumeSpecName "kube-api-access-2d5xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:15:54.338855 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.338812    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d5xt\" (UniqueName: \"kubernetes.io/projected/cd85162e-a8e7-4001-b510-99bd73df41ad-kube-api-access-2d5xt\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:15:54.338855 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:54.338839    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd85162e-a8e7-4001-b510-99bd73df41ad-plugins-config-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:15:55.146907 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.146874    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"
Jul 28 12:15:55.147427 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.146906    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7" event={"ID":"cd85162e-a8e7-4001-b510-99bd73df41ad","Type":"ContainerDied","Data":"02b5d6ed4bf495a9d2adad37e3677d467a4079fb0bbc3320f071940623dfb08b"}
Jul 28 12:15:55.147427 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.146970    2573 scope.go:117] "RemoveContainer" containerID="955ce73b96b6a6b1e1f8a4f39a593245aa33802ea864a92fd28374a93dd4e43c"
Jul 28 12:15:55.170842 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.170813    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:15:55.174959 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.174937    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-88898f-7898bd7d4-ckdq7"]
Jul 28 12:15:55.268311 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:55.268276    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd85162e-a8e7-4001-b510-99bd73df41ad" path="/var/lib/kubelet/pods/cd85162e-a8e7-4001-b510-99bd73df41ad/volumes"
Jul 28 12:15:58.408605 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:58.408574    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"]
Jul 28 12:15:58.411337 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:58.411308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:58.412868 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:58.412849    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-88898f-r5zw6"]
Jul 28 12:15:58.817596 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:58.817492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:15:59.275033 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:15:59.274991    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8119dca6-49ff-4bb9-9a8b-76894fe85516" path="/var/lib/kubelet/pods/8119dca6-49ff-4bb9-9a8b-76894fe85516/volumes"
Jul 28 12:16:04.890569 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:04.890531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:04.995683 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:04.995648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:05.266173 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:05.266084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:05.482286 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:05.482251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:05.863446 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:05.863410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:06.227250 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:06.227206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:06.299035 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:06.299003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:09.290076 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:09.290036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:09.369497 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:09.369459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:09.469788 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:09.469751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:09.696691 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:09.696649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:09.986685 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:09.986605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:10.082360 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:10.082329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:13.728040 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:13.728002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:14.090920 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:14.090827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:14.443878 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:14.443847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:14.760434 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:14.760327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:17.451062 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:17.451011    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:17.551128 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:17.551085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:17.656581 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:17.656545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:17.964922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:17.964888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:18.285316 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:18.285232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:18.380825 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:18.380793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:21.922990 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:21.922954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:16:37.645692 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:37.645662    2573 scope.go:117] "RemoveContainer" containerID="34040b4ee6a96912c2c230279a2be5a8dc06d846f54da9b041289373cd47a97b"
Jul 28 12:16:42.885582 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:16:42.885546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:17:04.179263 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:17:04.179186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:17:32.455181 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:17:32.455143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:17:32.554680 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:17:32.554647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:19:22.332640 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:19:22.332606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:20:20.214924 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:20:20.214847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:20:20.269510 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:20:20.269475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:20:37.701410 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:20:37.701363    2573 scope.go:117] "RemoveContainer" containerID="8af35ff6d03814a54e435de9fea680d30077053c82a210acca45e6451db9f3f0"
Jul 28 12:20:38.740593 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:20:38.740469    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:20:38.752735 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:20:38.752712    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:21:10.952789 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:10.952746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:21:15.201945 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:15.201910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:21:16.131908 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:16.131877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:21:28.432596 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:28.432551    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:21:37.723651 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:37.723614    2573 scope.go:117] "RemoveContainer" containerID="c6b4ad2be93e53460d93b4636b03fbdc0c608ed8d2fb83f43b8598d0b63711c1"
Jul 28 12:21:37.732621 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:37.732599    2573 scope.go:117] "RemoveContainer" containerID="b54a2feb3ed231f56aaef17c4439343ebe56b6be8aacece910f19392953feda9"
Jul 28 12:21:37.741018 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:37.741000    2573 scope.go:117] "RemoveContainer" containerID="cdedb7a337b603ff92b4a62cc14f84a80bc423e3bbde1a76b00d52b0b8f209e0"
Jul 28 12:21:40.277623 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:40.277589    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:21:49.723885 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:21:49.723835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:22:37.773160 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:22:37.773127    2573 scope.go:117] "RemoveContainer" containerID="a068d4690f9fbbccc8746a6f6bc83e7c4e8736f40da6f2ad50f68247637d6301"
Jul 28 12:23:09.185624 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:23:09.185547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:23:10.005201 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:23:10.005165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:23:18.466283 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:23:18.466251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:23:42.543201 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:23:42.543168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:24:19.715665 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:19.715627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:24:29.115961 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:29.115879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:24:54.689182 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:54.689145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:24:54.806507 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:54.806479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:24:55.949955 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.949918    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481362908080"]
Jul 28 12:24:55.950378 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950363    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:24:55.950378 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950393    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:24:55.950475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950414    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd85162e-a8e7-4001-b510-99bd73df41ad" containerName="payload-processing"
Jul 28 12:24:55.950475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950422    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd85162e-a8e7-4001-b510-99bd73df41ad" containerName="payload-processing"
Jul 28 12:24:55.950475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950437    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8119dca6-49ff-4bb9-9a8b-76894fe85516" containerName="revoke-keys"
Jul 28 12:24:55.950475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950442    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8119dca6-49ff-4bb9-9a8b-76894fe85516" containerName="revoke-keys"
Jul 28 12:24:55.950599 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950526    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8119dca6-49ff-4bb9-9a8b-76894fe85516" containerName="revoke-keys"
Jul 28 12:24:55.950599 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950535    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd85162e-a8e7-4001-b510-99bd73df41ad" containerName="payload-processing"
Jul 28 12:24:55.950599 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.950542    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f733e013-6a6f-405a-964a-9cff2769b718" containerName="cleanup"
Jul 28 12:24:55.953685 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.953669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:55.956442 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.956417    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tnzgv\""
Jul 28 12:24:55.959527 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:55.959500    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362908080"]
Jul 28 12:24:56.085112 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.085077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c552x\" (UniqueName: \"kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x\") pod \"test-curl-7055-140481362908080\" (UID: \"a59bc844-1842-4672-82c2-dd236725034d\") " pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:56.185717 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.185682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c552x\" (UniqueName: \"kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x\") pod \"test-curl-7055-140481362908080\" (UID: \"a59bc844-1842-4672-82c2-dd236725034d\") " pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:56.194145 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.194119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c552x\" (UniqueName: \"kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x\") pod \"test-curl-7055-140481362908080\" (UID: \"a59bc844-1842-4672-82c2-dd236725034d\") " pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:56.263814 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.263753    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:56.401908 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.401881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362908080"]
Jul 28 12:24:56.403779 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:24:56.403755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda59bc844_1842_4672_82c2_dd236725034d.slice/crio-2d11a3989d22505544a49b77ab96f611cf4d27a23c86a721e9ea911a65d5f895 WatchSource:0}: Error finding container 2d11a3989d22505544a49b77ab96f611cf4d27a23c86a721e9ea911a65d5f895: Status 404 returned error can't find the container with id 2d11a3989d22505544a49b77ab96f611cf4d27a23c86a721e9ea911a65d5f895
Jul 28 12:24:56.405180 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.405160    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:24:56.450160 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:56.450133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362908080" event={"ID":"a59bc844-1842-4672-82c2-dd236725034d","Type":"ContainerStarted","Data":"2d11a3989d22505544a49b77ab96f611cf4d27a23c86a721e9ea911a65d5f895"}
Jul 28 12:24:57.457330 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:57.457299    2573 generic.go:356] "Generic (PLEG): container finished" podID="a59bc844-1842-4672-82c2-dd236725034d" containerID="5dcaccaa50335604c5084c7904c3149394dd0810226b562553144b7018dc73c0" exitCode=0
Jul 28 12:24:57.457741 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:57.457416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362908080" event={"ID":"a59bc844-1842-4672-82c2-dd236725034d","Type":"ContainerDied","Data":"5dcaccaa50335604c5084c7904c3149394dd0810226b562553144b7018dc73c0"}
Jul 28 12:24:58.602032 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.602006    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:58.622150 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.622128    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481362908080_a59bc844-1842-4672-82c2-dd236725034d/test-curl-7055-140481362908080/0.log"
Jul 28 12:24:58.648143 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.648111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481362908080"]
Jul 28 12:24:58.653710 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.653688    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481362908080"]
Jul 28 12:24:58.717811 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.717747    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c552x\" (UniqueName: \"kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x\") pod \"a59bc844-1842-4672-82c2-dd236725034d\" (UID: \"a59bc844-1842-4672-82c2-dd236725034d\") "
Jul 28 12:24:58.719791 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.719758    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x" (OuterVolumeSpecName: "kube-api-access-c552x") pod "a59bc844-1842-4672-82c2-dd236725034d" (UID: "a59bc844-1842-4672-82c2-dd236725034d"). InnerVolumeSpecName "kube-api-access-c552x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:24:58.791114 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.791087    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481362768560"]
Jul 28 12:24:58.791610 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.791591    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59bc844-1842-4672-82c2-dd236725034d" containerName="test-curl-7055-140481362908080"
Jul 28 12:24:58.791707 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.791612    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59bc844-1842-4672-82c2-dd236725034d" containerName="test-curl-7055-140481362908080"
Jul 28 12:24:58.791765 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.791749    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59bc844-1842-4672-82c2-dd236725034d" containerName="test-curl-7055-140481362908080"
Jul 28 12:24:58.794808 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.794790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:24:58.801987 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.801958    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362768560"]
Jul 28 12:24:58.819062 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.819031    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c552x\" (UniqueName: \"kubernetes.io/projected/a59bc844-1842-4672-82c2-dd236725034d-kube-api-access-c552x\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:24:58.920276 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:58.920239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59prv\" (UniqueName: \"kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv\") pod \"test-curl-7055-140481362768560\" (UID: \"f8287122-3113-442c-a6dd-438009a838fa\") " pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:24:59.021590 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.021518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59prv\" (UniqueName: \"kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv\") pod \"test-curl-7055-140481362768560\" (UID: \"f8287122-3113-442c-a6dd-438009a838fa\") " pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:24:59.030102 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.030074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59prv\" (UniqueName: \"kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv\") pod \"test-curl-7055-140481362768560\" (UID: \"f8287122-3113-442c-a6dd-438009a838fa\") " pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:24:59.105949 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.105917    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:24:59.239137 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.239109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362768560"]
Jul 28 12:24:59.239960 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:24:59.239936    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8287122_3113_442c_a6dd_438009a838fa.slice/crio-6a9e0bcddf13caa3bf2d7eb282fa13e57a1cc6681a3592c2e441b1d421d96649 WatchSource:0}: Error finding container 6a9e0bcddf13caa3bf2d7eb282fa13e57a1cc6681a3592c2e441b1d421d96649: Status 404 returned error can't find the container with id 6a9e0bcddf13caa3bf2d7eb282fa13e57a1cc6681a3592c2e441b1d421d96649
Jul 28 12:24:59.268903 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.268873    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59bc844-1842-4672-82c2-dd236725034d" path="/var/lib/kubelet/pods/a59bc844-1842-4672-82c2-dd236725034d/volumes"
Jul 28 12:24:59.469794 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.469753    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362908080"
Jul 28 12:24:59.469794 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.469771    2573 scope.go:117] "RemoveContainer" containerID="5dcaccaa50335604c5084c7904c3149394dd0810226b562553144b7018dc73c0"
Jul 28 12:24:59.471232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:24:59.471206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362768560" event={"ID":"f8287122-3113-442c-a6dd-438009a838fa","Type":"ContainerStarted","Data":"6a9e0bcddf13caa3bf2d7eb282fa13e57a1cc6681a3592c2e441b1d421d96649"}
Jul 28 12:25:00.482264 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:00.482231    2573 generic.go:356] "Generic (PLEG): container finished" podID="f8287122-3113-442c-a6dd-438009a838fa" containerID="536ada4c3895016589b132b19d0b4d4c710ca0dce8f3049bc055d15fc50f2849" exitCode=0
Jul 28 12:25:00.482655 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:00.482286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362768560" event={"ID":"f8287122-3113-442c-a6dd-438009a838fa","Type":"ContainerDied","Data":"536ada4c3895016589b132b19d0b4d4c710ca0dce8f3049bc055d15fc50f2849"}
Jul 28 12:25:01.629008 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.628987    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:25:01.649417 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.649376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481362768560_f8287122-3113-442c-a6dd-438009a838fa/test-curl-7055-140481362768560/0.log"
Jul 28 12:25:01.676242 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.676215    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481362768560"]
Jul 28 12:25:01.679282 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.679256    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481362768560"]
Jul 28 12:25:01.747688 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.747606    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59prv\" (UniqueName: \"kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv\") pod \"f8287122-3113-442c-a6dd-438009a838fa\" (UID: \"f8287122-3113-442c-a6dd-438009a838fa\") "
Jul 28 12:25:01.749508 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.749487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv" (OuterVolumeSpecName: "kube-api-access-59prv") pod "f8287122-3113-442c-a6dd-438009a838fa" (UID: "f8287122-3113-442c-a6dd-438009a838fa"). InnerVolumeSpecName "kube-api-access-59prv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:25:01.843311 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.843284    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:01.843760 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.843745    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8287122-3113-442c-a6dd-438009a838fa" containerName="test-curl-7055-140481362768560"
Jul 28 12:25:01.843808 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.843762    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8287122-3113-442c-a6dd-438009a838fa" containerName="test-curl-7055-140481362768560"
Jul 28 12:25:01.843845 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.843833    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8287122-3113-442c-a6dd-438009a838fa" containerName="test-curl-7055-140481362768560"
Jul 28 12:25:01.847124 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.847102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:01.848984 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.848957    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59prv\" (UniqueName: \"kubernetes.io/projected/f8287122-3113-442c-a6dd-438009a838fa-kube-api-access-59prv\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:25:01.851437 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.851371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:01.950205 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:01.950177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v\") pod \"test-curl-7055-140481363726032\" (UID: \"1d5f2449-f28c-4446-ae0f-cb51df79a375\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:02.051560 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.051469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v\") pod \"test-curl-7055-140481363726032\" (UID: \"1d5f2449-f28c-4446-ae0f-cb51df79a375\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:02.060093 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.060065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v\") pod \"test-curl-7055-140481363726032\" (UID: \"1d5f2449-f28c-4446-ae0f-cb51df79a375\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:02.158112 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.158084    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:02.297747 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.296781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:02.500185 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.500155    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:25:02.500185 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.500185    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a9e0bcddf13caa3bf2d7eb282fa13e57a1cc6681a3592c2e441b1d421d96649"
Jul 28 12:25:02.501350 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:02.501320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481363726032" event={"ID":"1d5f2449-f28c-4446-ae0f-cb51df79a375","Type":"ContainerStarted","Data":"80aa2a7a6e63d4eba5fec1a2bb1870f8a56d5992e4507da85f9743ab98709dcb"}
Jul 28 12:25:02.511041 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:25:02.511015    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7055-140481362768560\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="f8287122-3113-442c-a6dd-438009a838fa" pod="opendatahub/test-curl-7055-140481362768560"
Jul 28 12:25:03.268764 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:03.268730    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8287122-3113-442c-a6dd-438009a838fa" path="/var/lib/kubelet/pods/f8287122-3113-442c-a6dd-438009a838fa/volumes"
Jul 28 12:25:03.508393 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:03.508359    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d5f2449-f28c-4446-ae0f-cb51df79a375" containerID="73850f179b8d89132dc3f4430ca6ef919bfac9317bafb43ba3fdbbcd3f60f21e" exitCode=0
Jul 28 12:25:03.508579 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:03.508436    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481363726032" event={"ID":"1d5f2449-f28c-4446-ae0f-cb51df79a375","Type":"ContainerDied","Data":"73850f179b8d89132dc3f4430ca6ef919bfac9317bafb43ba3fdbbcd3f60f21e"}
Jul 28 12:25:04.654300 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.654277    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:04.673753 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.673728    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481363726032_1d5f2449-f28c-4446-ae0f-cb51df79a375/test-curl-7055-140481363726032/0.log"
Jul 28 12:25:04.699024 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.698991    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:04.701607 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.701586    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:04.781078 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.780990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v\") pod \"1d5f2449-f28c-4446-ae0f-cb51df79a375\" (UID: \"1d5f2449-f28c-4446-ae0f-cb51df79a375\") "
Jul 28 12:25:04.783117 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.783089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v" (OuterVolumeSpecName: "kube-api-access-9gt5v") pod "1d5f2449-f28c-4446-ae0f-cb51df79a375" (UID: "1d5f2449-f28c-4446-ae0f-cb51df79a375"). InnerVolumeSpecName "kube-api-access-9gt5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:25:04.826334 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.826310    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:04.826784 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.826769    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5f2449-f28c-4446-ae0f-cb51df79a375" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:04.826834 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.826786    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5f2449-f28c-4446-ae0f-cb51df79a375" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:04.826891 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.826882    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5f2449-f28c-4446-ae0f-cb51df79a375" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:04.829929 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.829916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:04.836801 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.836731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:04.882019 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.881994    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/1d5f2449-f28c-4446-ae0f-cb51df79a375-kube-api-access-9gt5v\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:25:04.983377 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:04.983343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cklg\" (UniqueName: \"kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg\") pod \"test-curl-7055-140481363726032\" (UID: \"127a9887-0a27-445a-ba90-9d6103f8d6c7\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:05.084985 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.084891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cklg\" (UniqueName: \"kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg\") pod \"test-curl-7055-140481363726032\" (UID: \"127a9887-0a27-445a-ba90-9d6103f8d6c7\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:05.092875 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.092846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cklg\" (UniqueName: \"kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg\") pod \"test-curl-7055-140481363726032\" (UID: \"127a9887-0a27-445a-ba90-9d6103f8d6c7\") " pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:05.141073 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.141047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:05.267954 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.267921    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5f2449-f28c-4446-ae0f-cb51df79a375" path="/var/lib/kubelet/pods/1d5f2449-f28c-4446-ae0f-cb51df79a375/volumes"
Jul 28 12:25:05.273235 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.273213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:05.275302 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:25:05.275277    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod127a9887_0a27_445a_ba90_9d6103f8d6c7.slice/crio-8e0d2f904abbf2acd6ff07578435798dcba6d29b06f83f0399785f7789c9818f WatchSource:0}: Error finding container 8e0d2f904abbf2acd6ff07578435798dcba6d29b06f83f0399785f7789c9818f: Status 404 returned error can't find the container with id 8e0d2f904abbf2acd6ff07578435798dcba6d29b06f83f0399785f7789c9818f
Jul 28 12:25:05.523168 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.523132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481363726032" event={"ID":"127a9887-0a27-445a-ba90-9d6103f8d6c7","Type":"ContainerStarted","Data":"8e0d2f904abbf2acd6ff07578435798dcba6d29b06f83f0399785f7789c9818f"}
Jul 28 12:25:05.524541 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.524519    2573 scope.go:117] "RemoveContainer" containerID="73850f179b8d89132dc3f4430ca6ef919bfac9317bafb43ba3fdbbcd3f60f21e"
Jul 28 12:25:05.524541 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:05.524535    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:06.532300 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:06.532271    2573 generic.go:356] "Generic (PLEG): container finished" podID="127a9887-0a27-445a-ba90-9d6103f8d6c7" containerID="18a5d3188037d02106c5f97aa5baf50c4a467c56b37c24f1e8d139e1e419bdad" exitCode=0
Jul 28 12:25:06.532718 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:06.532370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481363726032" event={"ID":"127a9887-0a27-445a-ba90-9d6103f8d6c7","Type":"ContainerDied","Data":"18a5d3188037d02106c5f97aa5baf50c4a467c56b37c24f1e8d139e1e419bdad"}
Jul 28 12:25:07.680313 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.680289    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:07.702119 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.702096    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481363726032_127a9887-0a27-445a-ba90-9d6103f8d6c7/test-curl-7055-140481363726032/0.log"
Jul 28 12:25:07.725416 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.725366    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:07.729645 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.729622    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481363726032"]
Jul 28 12:25:07.811200 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.811129    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cklg\" (UniqueName: \"kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg\") pod \"127a9887-0a27-445a-ba90-9d6103f8d6c7\" (UID: \"127a9887-0a27-445a-ba90-9d6103f8d6c7\") "
Jul 28 12:25:07.813132 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.813107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg" (OuterVolumeSpecName: "kube-api-access-8cklg") pod "127a9887-0a27-445a-ba90-9d6103f8d6c7" (UID: "127a9887-0a27-445a-ba90-9d6103f8d6c7"). InnerVolumeSpecName "kube-api-access-8cklg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:25:07.847161 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.847129    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:07.847649 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.847630    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127a9887-0a27-445a-ba90-9d6103f8d6c7" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:07.847649 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.847650    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="127a9887-0a27-445a-ba90-9d6103f8d6c7" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:07.847814 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.847801    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="127a9887-0a27-445a-ba90-9d6103f8d6c7" containerName="test-curl-7055-140481363726032"
Jul 28 12:25:07.850972 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.850953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:07.854368 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.854346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:07.912648 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:07.912621    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cklg\" (UniqueName: \"kubernetes.io/projected/127a9887-0a27-445a-ba90-9d6103f8d6c7-kube-api-access-8cklg\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:25:08.013328 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.013293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpx5g\" (UniqueName: \"kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g\") pod \"test-curl-7055-140481362805936\" (UID: \"f1dce61d-442a-4936-bd00-c8b1a08a1d33\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:08.114203 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.114129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpx5g\" (UniqueName: \"kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g\") pod \"test-curl-7055-140481362805936\" (UID: \"f1dce61d-442a-4936-bd00-c8b1a08a1d33\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:08.122660 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.122633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpx5g\" (UniqueName: \"kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g\") pod \"test-curl-7055-140481362805936\" (UID: \"f1dce61d-442a-4936-bd00-c8b1a08a1d33\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:08.163249 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.163222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:08.304683 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.304655    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:08.305459 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:25:08.305438    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1dce61d_442a_4936_bd00_c8b1a08a1d33.slice/crio-ccccc70d4d255bf0179e3b682cb30afc4893b276a2fb9a1ee716fddbd1c38246 WatchSource:0}: Error finding container ccccc70d4d255bf0179e3b682cb30afc4893b276a2fb9a1ee716fddbd1c38246: Status 404 returned error can't find the container with id ccccc70d4d255bf0179e3b682cb30afc4893b276a2fb9a1ee716fddbd1c38246
Jul 28 12:25:08.545354 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.545319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362805936" event={"ID":"f1dce61d-442a-4936-bd00-c8b1a08a1d33","Type":"ContainerStarted","Data":"ccccc70d4d255bf0179e3b682cb30afc4893b276a2fb9a1ee716fddbd1c38246"}
Jul 28 12:25:08.546656 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.546636    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:08.546656 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:08.546654    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e0d2f904abbf2acd6ff07578435798dcba6d29b06f83f0399785f7789c9818f"
Jul 28 12:25:08.557464 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:25:08.557436    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7055-140481363726032\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="127a9887-0a27-445a-ba90-9d6103f8d6c7" pod="opendatahub/test-curl-7055-140481363726032"
Jul 28 12:25:09.268401 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:09.268348    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127a9887-0a27-445a-ba90-9d6103f8d6c7" path="/var/lib/kubelet/pods/127a9887-0a27-445a-ba90-9d6103f8d6c7/volumes"
Jul 28 12:25:09.554110 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:09.554021    2573 generic.go:356] "Generic (PLEG): container finished" podID="f1dce61d-442a-4936-bd00-c8b1a08a1d33" containerID="fc2a038eb3c7372df46f3a36a81b25208df32fed53a5ecacdfc2a3a0539135d3" exitCode=0
Jul 28 12:25:09.554110 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:09.554099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362805936" event={"ID":"f1dce61d-442a-4936-bd00-c8b1a08a1d33","Type":"ContainerDied","Data":"fc2a038eb3c7372df46f3a36a81b25208df32fed53a5ecacdfc2a3a0539135d3"}
Jul 28 12:25:10.700275 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.700249    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:10.718602 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.718552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481362805936_f1dce61d-442a-4936-bd00-c8b1a08a1d33/test-curl-7055-140481362805936/0.log"
Jul 28 12:25:10.736889 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.736860    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpx5g\" (UniqueName: \"kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g\") pod \"f1dce61d-442a-4936-bd00-c8b1a08a1d33\" (UID: \"f1dce61d-442a-4936-bd00-c8b1a08a1d33\") "
Jul 28 12:25:10.739245 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.739211    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g" (OuterVolumeSpecName: "kube-api-access-fpx5g") pod "f1dce61d-442a-4936-bd00-c8b1a08a1d33" (UID: "f1dce61d-442a-4936-bd00-c8b1a08a1d33"). InnerVolumeSpecName "kube-api-access-fpx5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:25:10.740983 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.740962    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:10.744634 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.744611    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:10.838703 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.838629    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpx5g\" (UniqueName: \"kubernetes.io/projected/f1dce61d-442a-4936-bd00-c8b1a08a1d33-kube-api-access-fpx5g\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:25:10.860097 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.860063    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:10.860569 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.860552    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dce61d-442a-4936-bd00-c8b1a08a1d33" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:10.860670 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.860571    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dce61d-442a-4936-bd00-c8b1a08a1d33" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:10.860729 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.860707    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1dce61d-442a-4936-bd00-c8b1a08a1d33" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:10.871550 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.871518    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:10.872277 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.872254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:10.939934 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:10.939899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvxb\" (UniqueName: \"kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb\") pod \"test-curl-7055-140481362805936\" (UID: \"27d5c4bf-9642-4037-86f2-a126910a833d\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:11.041106 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.041068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvxb\" (UniqueName: \"kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb\") pod \"test-curl-7055-140481362805936\" (UID: \"27d5c4bf-9642-4037-86f2-a126910a833d\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:11.048833 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.048805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvxb\" (UniqueName: \"kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb\") pod \"test-curl-7055-140481362805936\" (UID: \"27d5c4bf-9642-4037-86f2-a126910a833d\") " pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:11.182174 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.182143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:11.267847 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.267809    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1dce61d-442a-4936-bd00-c8b1a08a1d33" path="/var/lib/kubelet/pods/f1dce61d-442a-4936-bd00-c8b1a08a1d33/volumes"
Jul 28 12:25:11.317978 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.317951    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:11.318821 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:25:11.318798    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27d5c4bf_9642_4037_86f2_a126910a833d.slice/crio-6521f49592c9a19834d9af11bd4779ae1125100dd7189ef8e123f837b318b329 WatchSource:0}: Error finding container 6521f49592c9a19834d9af11bd4779ae1125100dd7189ef8e123f837b318b329: Status 404 returned error can't find the container with id 6521f49592c9a19834d9af11bd4779ae1125100dd7189ef8e123f837b318b329
Jul 28 12:25:11.567704 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.567625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362805936" event={"ID":"27d5c4bf-9642-4037-86f2-a126910a833d","Type":"ContainerStarted","Data":"6521f49592c9a19834d9af11bd4779ae1125100dd7189ef8e123f837b318b329"}
Jul 28 12:25:11.568821 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.568799    2573 scope.go:117] "RemoveContainer" containerID="fc2a038eb3c7372df46f3a36a81b25208df32fed53a5ecacdfc2a3a0539135d3"
Jul 28 12:25:11.568905 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:11.568807    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:12.576464 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:12.576426    2573 generic.go:356] "Generic (PLEG): container finished" podID="27d5c4bf-9642-4037-86f2-a126910a833d" containerID="fdf7ab70a771b45f912213b996e66fee5789b8abeae9b54ebdeb6941f8548e8e" exitCode=0
Jul 28 12:25:12.576883 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:12.576515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7055-140481362805936" event={"ID":"27d5c4bf-9642-4037-86f2-a126910a833d","Type":"ContainerDied","Data":"fdf7ab70a771b45f912213b996e66fee5789b8abeae9b54ebdeb6941f8548e8e"}
Jul 28 12:25:13.721877 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.721856    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:13.742356 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.742330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7055-140481362805936_27d5c4bf-9642-4037-86f2-a126910a833d/test-curl-7055-140481362805936/0.log"
Jul 28 12:25:13.764815 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.764787    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:13.767554 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.767527    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7055-140481362805936"]
Jul 28 12:25:13.767944 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.767919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkvxb\" (UniqueName: \"kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb\") pod \"27d5c4bf-9642-4037-86f2-a126910a833d\" (UID: \"27d5c4bf-9642-4037-86f2-a126910a833d\") "
Jul 28 12:25:13.769847 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.769824    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb" (OuterVolumeSpecName: "kube-api-access-xkvxb") pod "27d5c4bf-9642-4037-86f2-a126910a833d" (UID: "27d5c4bf-9642-4037-86f2-a126910a833d"). InnerVolumeSpecName "kube-api-access-xkvxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:25:13.869475 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:13.869407    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkvxb\" (UniqueName: \"kubernetes.io/projected/27d5c4bf-9642-4037-86f2-a126910a833d-kube-api-access-xkvxb\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:25:14.288535 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:14.288495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:14.591666 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:14.591581    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:14.591666 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:14.591622    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6521f49592c9a19834d9af11bd4779ae1125100dd7189ef8e123f837b318b329"
Jul 28 12:25:14.602045 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:25:14.602015    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7055-140481362805936\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="27d5c4bf-9642-4037-86f2-a126910a833d" pod="opendatahub/test-curl-7055-140481362805936"
Jul 28 12:25:14.707712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:14.707678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:14.934770 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:14.934739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:15.268554 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:15.268475    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d5c4bf-9642-4037-86f2-a126910a833d" path="/var/lib/kubelet/pods/27d5c4bf-9642-4037-86f2-a126910a833d/volumes"
Jul 28 12:25:17.892117 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.892081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:17.979285 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.979222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:17.990492 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.990462    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:25:17.991008 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.990986    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d5c4bf-9642-4037-86f2-a126910a833d" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:17.991008 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.991006    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d5c4bf-9642-4037-86f2-a126910a833d" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:17.991169 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.991081    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d5c4bf-9642-4037-86f2-a126910a833d" containerName="test-curl-7055-140481362805936"
Jul 28 12:25:17.994566 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.994545    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:17.997247 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:17.997225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-ba0125-serving-cert\""
Jul 28 12:25:18.007752 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.007734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:25:18.078706 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.078679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:18.113366 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.113332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.113565 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.113426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjrw\" (UniqueName: \"kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.113565 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.113459    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.200014 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.199929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:18.213996 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.213960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.214125 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.214029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjrw\" (UniqueName: \"kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.214125 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.214063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.214874 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.214853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.216940 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.216914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.223422 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.223377    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjrw\" (UniqueName: \"kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw\") pod \"maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.305891 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.305863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:18.655609 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.655581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:18.667991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.667964    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:25:18.756232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:18.756187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:19.623238 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:19.623205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" event={"ID":"f46c3f4f-03be-4374-bd2e-a364e2dad9c6","Type":"ContainerStarted","Data":"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"}
Jul 28 12:25:19.623673 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:19.623254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" event={"ID":"f46c3f4f-03be-4374-bd2e-a364e2dad9c6","Type":"ContainerStarted","Data":"b2b298ecf20c8aa7fa0cc9556b415e2eb0872b284ef0b35fb8e230fbce5e65ce"}
Jul 28 12:25:19.623673 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:19.623351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:19.640931 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:19.640881    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" podStartSLOduration=2.225248729 podStartE2EDuration="2.640869242s" totalImagesPullingTime="415.620513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:25:19.638942086 +0000 UTC m=+3282.827543107" watchObservedRunningTime="2026-07-28 12:25:19.640869242 +0000 UTC m=+3282.829470249"
Jul 28 12:25:22.435796 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:22.435761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:25.635251 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:25.635225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:25:33.423239 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.423208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:33.730923 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.730842    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:25:33.736542 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.736523    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.739327 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.739307    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a4d289-openshift-default-dockercfg-wjcnr\""
Jul 28 12:25:33.748904 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.748880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:25:33.762510 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.762478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:33.870760 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.870760 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.870983 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.870983 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.870983 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.870983 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr68z\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.871136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.870999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.871136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.871022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.871136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.871089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.881659 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.881634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:33.971880 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.971850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.971880 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.971884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.971904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.971953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972083 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr68z\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972289 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972289 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972289 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972486 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972550 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972610 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972587    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972663 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.972765 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.972747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.974540 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.974522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.974784 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.974764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.979604 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.979581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:33.981685 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:33.981632    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr68z\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z\") pod \"e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") " pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:34.048835 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.048797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:34.190066 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.190035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:25:34.190905 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:25:34.190881    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011b7653_2947_4c9d_8370_fcd90432bd8d.slice/crio-dd1418d13914c11718a587c55c04c0690f965128418a21197600a137e4e6d292 WatchSource:0}: Error finding container dd1418d13914c11718a587c55c04c0690f965128418a21197600a137e4e6d292: Status 404 returned error can't find the container with id dd1418d13914c11718a587c55c04c0690f965128418a21197600a137e4e6d292
Jul 28 12:25:34.192928 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.192898    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:34.193017 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.192959    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:34.193017 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.192988    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:34.719450 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.719418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerStarted","Data":"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"}
Jul 28 12:25:34.719851 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.719468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerStarted","Data":"dd1418d13914c11718a587c55c04c0690f965128418a21197600a137e4e6d292"}
Jul 28 12:25:34.745713 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:34.745653    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podStartSLOduration=1.745633169 podStartE2EDuration="1.745633169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:25:34.74156518 +0000 UTC m=+3297.930166236" watchObservedRunningTime="2026-07-28 12:25:34.745633169 +0000 UTC m=+3297.934234171"
Jul 28 12:25:35.050005 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:35.049929    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:35.055052 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:35.055027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:35.725704 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:35.725673    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:35.726716 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:35.726692    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:36.752604 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:36.752575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:36.859547 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:36.859517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:36.952630 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:36.952598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:37.051520 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.051419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:37.707517 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.707482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:37.805949 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.805912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:37.821996 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.821970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:25:37.827201 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.827183    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:37.829717 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.829696    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a4d289\""
Jul 28 12:25:37.829816 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.829696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a4d289-dockercfg-9ckbg\""
Jul 28 12:25:37.835022 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.834999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:25:37.914234 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.914200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:37.914415 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:37.914341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdqw\" (UniqueName: \"kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.015367 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.015281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdqw\" (UniqueName: \"kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.015367 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.015367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.016065 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.016044    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.023187 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.023157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdqw\" (UniqueName: \"kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw\") pod \"payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.139893 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.139859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.490862 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.490828    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:25:38.491835 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:25:38.491813    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf452b153_8a50_4447_aadf_6510cca21f9d.slice/crio-7377b0a970ce04b9515006fee41460005dba40d50d471f554f173e52aabfa969 WatchSource:0}: Error finding container 7377b0a970ce04b9515006fee41460005dba40d50d471f554f173e52aabfa969: Status 404 returned error can't find the container with id 7377b0a970ce04b9515006fee41460005dba40d50d471f554f173e52aabfa969
Jul 28 12:25:38.745596 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.745411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" event={"ID":"f452b153-8a50-4447-aadf-6510cca21f9d","Type":"ContainerStarted","Data":"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"}
Jul 28 12:25:38.745596 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.745476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" event={"ID":"f452b153-8a50-4447-aadf-6510cca21f9d","Type":"ContainerStarted","Data":"7377b0a970ce04b9515006fee41460005dba40d50d471f554f173e52aabfa969"}
Jul 28 12:25:38.745596 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.745507    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:38.763523 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.763472    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" podStartSLOduration=1.763452852 podStartE2EDuration="1.763452852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:25:38.761849237 +0000 UTC m=+3301.950450248" watchObservedRunningTime="2026-07-28 12:25:38.763452852 +0000 UTC m=+3301.952053854"
Jul 28 12:25:38.788467 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.788441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:25:38.797893 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:38.797871    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:25:41.320291 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:41.320258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:25:49.753076 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:49.753049    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:25:51.766609 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:51.766553    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 12:25:51.767019 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:51.766659    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 12:25:52.835888 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.835805    2573 generic.go:356] "Generic (PLEG): container finished" podID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerID="cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688" exitCode=0
Jul 28 12:25:52.836300 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.835886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerDied","Data":"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"}
Jul 28 12:25:52.836353 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.836308    2573 scope.go:117] "RemoveContainer" containerID="cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"
Jul 28 12:25:52.837440 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.837416    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:52.837498 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.837480    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:52.837537 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:52.837512    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 12:25:53.843357 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:53.843324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerStarted","Data":"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"}
Jul 28 12:25:54.050098 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:54.050054    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:54.050313 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:54.050104    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 28 12:25:54.050313 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:54.050146    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 28 12:25:55.049731 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:55.049688    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 28 12:25:55.050232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:55.049765    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 28 12:25:56.049979 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:56.049933    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 28 12:25:56.050528 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:56.050001    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 28 12:25:57.049564 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:57.049522    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 28 12:25:57.049986 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:57.049953    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 28 12:25:58.053503 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:58.053469    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:58.053882 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:58.053740    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:58.054563 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:58.054548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:25:58.837660 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:58.837630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:25:58.961305 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:25:58.961275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676_f452b153-8a50-4447-aadf-6510cca21f9d/payload-processing/0.log"
Jul 28 12:26:05.230608 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:05.230573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:49.264012 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:49.263981    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:26:49.401848 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:49.401816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676_f452b153-8a50-4447-aadf-6510cca21f9d/payload-processing/0.log"
Jul 28 12:26:49.700148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:49.700113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:50.061752 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:50.061675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:50.311843 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:50.311759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:53.312767 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.312731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:53.416095 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.416052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:53.418246 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.418219    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:26:53.421949 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.421933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.424931 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.424913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-0f3ba4-serving-cert\""
Jul 28 12:26:53.432572 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.432550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:26:53.487687 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.487653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:53.553846 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.553798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.554036 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.553928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ltrd\" (UniqueName: \"kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.554036 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.554006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.655588 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.655547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.655778 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.655661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ltrd\" (UniqueName: \"kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.655778 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.655755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.656244 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.656223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.658178 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.658155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.665101 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.665072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:53.666298 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.666272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ltrd\" (UniqueName: \"kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd\") pod \"maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.734363 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.734330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:53.874445 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:53.874412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:26:53.875895 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:26:53.875867    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d86aa2_8ead_422f_8034_744ded2d2a12.slice/crio-917b57f887d31318f5a75dc3b2ba219a81c41e83b049fb342edcd86b5a2761ab WatchSource:0}: Error finding container 917b57f887d31318f5a75dc3b2ba219a81c41e83b049fb342edcd86b5a2761ab: Status 404 returned error can't find the container with id 917b57f887d31318f5a75dc3b2ba219a81c41e83b049fb342edcd86b5a2761ab
Jul 28 12:26:54.095600 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.095503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:54.194663 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.194624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:26:54.232831 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.232808    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:26:54.237540 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.237520    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.239976 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.239945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-0f3ba4\""
Jul 28 12:26:54.240075 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.240022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-0f3ba4-dockercfg-8tjjx\""
Jul 28 12:26:54.246589 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.246561    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:26:54.256807 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.256778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" event={"ID":"63d86aa2-8ead-422f-8034-744ded2d2a12","Type":"ContainerStarted","Data":"917b57f887d31318f5a75dc3b2ba219a81c41e83b049fb342edcd86b5a2761ab"}
Jul 28 12:26:54.362972 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.362888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.363504 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.363013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rntj\" (UniqueName: \"kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.463691 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.463652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.463850 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.463750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rntj\" (UniqueName: \"kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.464465 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.464444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.472668 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.472647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rntj\" (UniqueName: \"kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj\") pod \"payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.560070 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.559913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:54.703414 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:54.703361    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:26:54.703568 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:26:54.703358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda038fe6e_1f07_4641_9438_7cc9ceed98ea.slice/crio-2246cc8de95384947abc24f2ca2592c341c52b5f3ed8e0508fdeca769ff4e819 WatchSource:0}: Error finding container 2246cc8de95384947abc24f2ca2592c341c52b5f3ed8e0508fdeca769ff4e819: Status 404 returned error can't find the container with id 2246cc8de95384947abc24f2ca2592c341c52b5f3ed8e0508fdeca769ff4e819
Jul 28 12:26:55.277922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.270337    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:26:55.277922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.270437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:26:55.277922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.270477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" event={"ID":"63d86aa2-8ead-422f-8034-744ded2d2a12","Type":"ContainerStarted","Data":"1246d2a962105fe56a4bf60baf55f35ff6fde61a03336f201406b57290698ff8"}
Jul 28 12:26:55.277922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.270515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" event={"ID":"a038fe6e-1f07-4641-9438-7cc9ceed98ea","Type":"ContainerStarted","Data":"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"}
Jul 28 12:26:55.277922 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.270539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" event={"ID":"a038fe6e-1f07-4641-9438-7cc9ceed98ea","Type":"ContainerStarted","Data":"2246cc8de95384947abc24f2ca2592c341c52b5f3ed8e0508fdeca769ff4e819"}
Jul 28 12:26:55.284715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.284657    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" podStartSLOduration=1.959303776 podStartE2EDuration="2.284640239s" totalImagesPullingTime="325.336463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:26:55.284275972 +0000 UTC m=+3378.472876989" watchObservedRunningTime="2026-07-28 12:26:55.284640239 +0000 UTC m=+3378.473241247"
Jul 28 12:26:55.302366 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:55.302312    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" podStartSLOduration=1.302298335 podStartE2EDuration="1.302298335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:26:55.300796289 +0000 UTC m=+3378.489397302" watchObservedRunningTime="2026-07-28 12:26:55.302298335 +0000 UTC m=+3378.490899332"
Jul 28 12:26:57.848866 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:26:57.848832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:01.280616 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:01.280581    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:27:06.276774 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:06.276743    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:27:08.821114 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:08.821076    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"]
Jul 28 12:27:08.825607 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:08.825589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:08.828001 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:08.827982    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:27:08.832873 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:08.832846    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"]
Jul 28 12:27:08.909870 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:08.909831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt\" (UID: \"d22ba75c-1d85-4e92-8f48-cdef11f31be2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:09.011112 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.011071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt\" (UID: \"d22ba75c-1d85-4e92-8f48-cdef11f31be2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:09.011749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.011729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt\" (UID: \"d22ba75c-1d85-4e92-8f48-cdef11f31be2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:09.139080 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.139044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:09.310206 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.310174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"]
Jul 28 12:27:09.311178 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:27:09.311152    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22ba75c_1d85_4e92_8f48_cdef11f31be2.slice/crio-945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2 WatchSource:0}: Error finding container 945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2: Status 404 returned error can't find the container with id 945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2
Jul 28 12:27:09.355556 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.355518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt" event={"ID":"d22ba75c-1d85-4e92-8f48-cdef11f31be2","Type":"ContainerStarted","Data":"945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2"}
Jul 28 12:27:09.370211 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.370176    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:09.374920 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.374901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:09.383709 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.383321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:09.416987 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.416900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4999m\" (UniqueName: \"kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m\") pod \"kuadrant-operator-catalog-g687q\" (UID: \"9558ff76-553f-49f0-ba9d-1ad74347836e\") " pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:09.518309 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.518269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4999m\" (UniqueName: \"kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m\") pod \"kuadrant-operator-catalog-g687q\" (UID: \"9558ff76-553f-49f0-ba9d-1ad74347836e\") " pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:09.526242 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.526211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4999m\" (UniqueName: \"kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m\") pod \"kuadrant-operator-catalog-g687q\" (UID: \"9558ff76-553f-49f0-ba9d-1ad74347836e\") " pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:09.687017 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.686928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:09.830203 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:27:09.830170    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9558ff76_553f_49f0_ba9d_1ad74347836e.slice/crio-8fbcf798b0b02b694969fcaf0dc769ca6ada0069217be4501547025cca4bf632 WatchSource:0}: Error finding container 8fbcf798b0b02b694969fcaf0dc769ca6ada0069217be4501547025cca4bf632: Status 404 returned error can't find the container with id 8fbcf798b0b02b694969fcaf0dc769ca6ada0069217be4501547025cca4bf632
Jul 28 12:27:09.830732 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:09.830703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:10.363275 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:10.363178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g687q" event={"ID":"9558ff76-553f-49f0-ba9d-1ad74347836e","Type":"ContainerStarted","Data":"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"}
Jul 28 12:27:10.363275 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:10.363236    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g687q" event={"ID":"9558ff76-553f-49f0-ba9d-1ad74347836e","Type":"ContainerStarted","Data":"8fbcf798b0b02b694969fcaf0dc769ca6ada0069217be4501547025cca4bf632"}
Jul 28 12:27:10.364774 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:10.364746    2573 generic.go:356] "Generic (PLEG): container finished" podID="d22ba75c-1d85-4e92-8f48-cdef11f31be2" containerID="42130d904f3d63758eab5e1d0346ae915a4b3660ede151b521d9140d41e18f84" exitCode=0
Jul 28 12:27:10.364882 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:10.364826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt" event={"ID":"d22ba75c-1d85-4e92-8f48-cdef11f31be2","Type":"ContainerDied","Data":"42130d904f3d63758eab5e1d0346ae915a4b3660ede151b521d9140d41e18f84"}
Jul 28 12:27:10.378391 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:10.378342    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g687q" podStartSLOduration=1.020899536 podStartE2EDuration="1.378327569s" totalImagesPullingTime="357.428033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:27:10.377540972 +0000 UTC m=+3393.566141992" watchObservedRunningTime="2026-07-28 12:27:10.378327569 +0000 UTC m=+3393.566928606"
Jul 28 12:27:11.523348 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:11.523321    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:11.637370 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:11.637270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca\") pod \"d22ba75c-1d85-4e92-8f48-cdef11f31be2\" (UID: \"d22ba75c-1d85-4e92-8f48-cdef11f31be2\") "
Jul 28 12:27:11.637736 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:11.637630    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d22ba75c-1d85-4e92-8f48-cdef11f31be2" (UID: "d22ba75c-1d85-4e92-8f48-cdef11f31be2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:27:11.739128 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:11.739097    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d22ba75c-1d85-4e92-8f48-cdef11f31be2-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:12.379439 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:12.379372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt" event={"ID":"d22ba75c-1d85-4e92-8f48-cdef11f31be2","Type":"ContainerDied","Data":"945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2"}
Jul 28 12:27:12.379439 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:12.379424    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"
Jul 28 12:27:12.379439 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:12.379451    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="945f738cc5325030c33bf59fc70b7b5da87166b24071b852dfedc4254a5e78b2"
Jul 28 12:27:19.256327 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.256292    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:27:19.256959 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.256924    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" podUID="63d86aa2-8ead-422f-8034-744ded2d2a12" containerName="maas-api" containerID="cri-o://1246d2a962105fe56a4bf60baf55f35ff6fde61a03336f201406b57290698ff8" gracePeriod=30
Jul 28 12:27:19.279625 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.279599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:19.312915 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.312884    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:27:19.313148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.313117    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" podUID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" containerName="payload-processing" containerID="cri-o://ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2" gracePeriod=30
Jul 28 12:27:19.348980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.348943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:19.427550 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.427524    2573 generic.go:356] "Generic (PLEG): container finished" podID="63d86aa2-8ead-422f-8034-744ded2d2a12" containerID="1246d2a962105fe56a4bf60baf55f35ff6fde61a03336f201406b57290698ff8" exitCode=0
Jul 28 12:27:19.427647 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.427600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" event={"ID":"63d86aa2-8ead-422f-8034-744ded2d2a12","Type":"ContainerDied","Data":"1246d2a962105fe56a4bf60baf55f35ff6fde61a03336f201406b57290698ff8"}
Jul 28 12:27:19.449858 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.449821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:19.593759 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.593721    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:27:19.619334 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.619309    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:27:19.687542 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.687510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:19.687709 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.687562    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:19.709930 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.709903    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:19.719738 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.719710    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls\") pod \"63d86aa2-8ead-422f-8034-744ded2d2a12\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") "
Jul 28 12:27:19.719903 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.719770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ltrd\" (UniqueName: \"kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd\") pod \"63d86aa2-8ead-422f-8034-744ded2d2a12\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") "
Jul 28 12:27:19.719903 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.719807    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rntj\" (UniqueName: \"kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj\") pod \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") "
Jul 28 12:27:19.719903 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.719874    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca\") pod \"63d86aa2-8ead-422f-8034-744ded2d2a12\" (UID: \"63d86aa2-8ead-422f-8034-744ded2d2a12\") "
Jul 28 12:27:19.720088 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.719935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume\") pod \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\" (UID: \"a038fe6e-1f07-4641-9438-7cc9ceed98ea\") "
Jul 28 12:27:19.720359 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.720332    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63d86aa2-8ead-422f-8034-744ded2d2a12" (UID: "63d86aa2-8ead-422f-8034-744ded2d2a12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:27:19.721122 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.721059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a038fe6e-1f07-4641-9438-7cc9ceed98ea" (UID: "a038fe6e-1f07-4641-9438-7cc9ceed98ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:27:19.722193 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.722169    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63d86aa2-8ead-422f-8034-744ded2d2a12" (UID: "63d86aa2-8ead-422f-8034-744ded2d2a12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:27:19.722471 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.722447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj" (OuterVolumeSpecName: "kube-api-access-9rntj") pod "a038fe6e-1f07-4641-9438-7cc9ceed98ea" (UID: "a038fe6e-1f07-4641-9438-7cc9ceed98ea"). InnerVolumeSpecName "kube-api-access-9rntj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:27:19.722626 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.722610    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd" (OuterVolumeSpecName: "kube-api-access-9ltrd") pod "63d86aa2-8ead-422f-8034-744ded2d2a12" (UID: "63d86aa2-8ead-422f-8034-744ded2d2a12"). InnerVolumeSpecName "kube-api-access-9ltrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:27:19.820980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.820892    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d86aa2-8ead-422f-8034-744ded2d2a12-openshift-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:19.820980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.820922    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a038fe6e-1f07-4641-9438-7cc9ceed98ea-plugins-config-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:19.820980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.820932    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63d86aa2-8ead-422f-8034-744ded2d2a12-maas-api-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:19.820980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.820941    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ltrd\" (UniqueName: \"kubernetes.io/projected/63d86aa2-8ead-422f-8034-744ded2d2a12-kube-api-access-9ltrd\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:19.820980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:19.820950    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rntj\" (UniqueName: \"kubernetes.io/projected/a038fe6e-1f07-4641-9438-7cc9ceed98ea-kube-api-access-9rntj\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:20.436126 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.436097    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"
Jul 28 12:27:20.436651 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.436138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm" event={"ID":"63d86aa2-8ead-422f-8034-744ded2d2a12","Type":"ContainerDied","Data":"917b57f887d31318f5a75dc3b2ba219a81c41e83b049fb342edcd86b5a2761ab"}
Jul 28 12:27:20.436651 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.436206    2573 scope.go:117] "RemoveContainer" containerID="1246d2a962105fe56a4bf60baf55f35ff6fde61a03336f201406b57290698ff8"
Jul 28 12:27:20.437644 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.437547    2573 generic.go:356] "Generic (PLEG): container finished" podID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" containerID="ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2" exitCode=0
Jul 28 12:27:20.437644 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.437578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" event={"ID":"a038fe6e-1f07-4641-9438-7cc9ceed98ea","Type":"ContainerDied","Data":"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"}
Jul 28 12:27:20.437644 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.437607    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"
Jul 28 12:27:20.437818 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.437679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7" event={"ID":"a038fe6e-1f07-4641-9438-7cc9ceed98ea","Type":"ContainerDied","Data":"2246cc8de95384947abc24f2ca2592c341c52b5f3ed8e0508fdeca769ff4e819"}
Jul 28 12:27:20.448494 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.448430    2573 scope.go:117] "RemoveContainer" containerID="ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"
Jul 28 12:27:20.457587 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.457570    2573 scope.go:117] "RemoveContainer" containerID="ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"
Jul 28 12:27:20.457852 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:27:20.457832    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2\": container with ID starting with ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2 not found: ID does not exist" containerID="ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"
Jul 28 12:27:20.457914 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.457861    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2"} err="failed to get container status \"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2\": rpc error: code = NotFound desc = could not find container \"ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2\": container with ID starting with ab117f047a2bfeaa7c05d43b724428bbbecc56e2af0f75d610ebdf32082519c2 not found: ID does not exist"
Jul 28 12:27:20.462198 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.462175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:20.463717 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.463697    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:27:20.467273 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.467252    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0f3ba4-5dc7df9888-6cqx7"]
Jul 28 12:27:20.477232 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.477210    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:27:20.482542 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.482520    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-0f3ba4-bb65b4b5d-lxcmm"]
Jul 28 12:27:20.515591 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:20.515564    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:21.268765 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:21.268731    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d86aa2-8ead-422f-8034-744ded2d2a12" path="/var/lib/kubelet/pods/63d86aa2-8ead-422f-8034-744ded2d2a12/volumes"
Jul 28 12:27:21.269104 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:21.269090    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" path="/var/lib/kubelet/pods/a038fe6e-1f07-4641-9438-7cc9ceed98ea/volumes"
Jul 28 12:27:22.452443 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:22.452398    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g687q" podUID="9558ff76-553f-49f0-ba9d-1ad74347836e" containerName="registry-server" containerID="cri-o://53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a" gracePeriod=2
Jul 28 12:27:22.712540 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:22.712479    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:22.851938 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:22.851904    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4999m\" (UniqueName: \"kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m\") pod \"9558ff76-553f-49f0-ba9d-1ad74347836e\" (UID: \"9558ff76-553f-49f0-ba9d-1ad74347836e\") "
Jul 28 12:27:22.853996 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:22.853969    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m" (OuterVolumeSpecName: "kube-api-access-4999m") pod "9558ff76-553f-49f0-ba9d-1ad74347836e" (UID: "9558ff76-553f-49f0-ba9d-1ad74347836e"). InnerVolumeSpecName "kube-api-access-4999m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:27:22.953143 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:22.953108    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4999m\" (UniqueName: \"kubernetes.io/projected/9558ff76-553f-49f0-ba9d-1ad74347836e-kube-api-access-4999m\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:23.460085 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.460047    2573 generic.go:356] "Generic (PLEG): container finished" podID="9558ff76-553f-49f0-ba9d-1ad74347836e" containerID="53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a" exitCode=0
Jul 28 12:27:23.460549 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.460100    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g687q"
Jul 28 12:27:23.460549 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.460133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g687q" event={"ID":"9558ff76-553f-49f0-ba9d-1ad74347836e","Type":"ContainerDied","Data":"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"}
Jul 28 12:27:23.460549 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.460186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g687q" event={"ID":"9558ff76-553f-49f0-ba9d-1ad74347836e","Type":"ContainerDied","Data":"8fbcf798b0b02b694969fcaf0dc769ca6ada0069217be4501547025cca4bf632"}
Jul 28 12:27:23.460549 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.460205    2573 scope.go:117] "RemoveContainer" containerID="53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"
Jul 28 12:27:23.470205 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.470185    2573 scope.go:117] "RemoveContainer" containerID="53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"
Jul 28 12:27:23.470512 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:27:23.470492    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a\": container with ID starting with 53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a not found: ID does not exist" containerID="53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"
Jul 28 12:27:23.470578 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.470523    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a"} err="failed to get container status \"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a\": rpc error: code = NotFound desc = could not find container \"53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a\": container with ID starting with 53267efedf0f34966f12c6498ea404ef862812e497c3fa777d4c564ba89c492a not found: ID does not exist"
Jul 28 12:27:23.477165 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.477143    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:23.480890 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.480871    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g687q"]
Jul 28 12:27:23.907866 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.907837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:23.919135 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.919107    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"]
Jul 28 12:27:23.922535 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:23.922508    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0f3ba4-lb7pt"]
Jul 28 12:27:24.289736 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:24.289644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:25.267862 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:25.267828    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9558ff76-553f-49f0-ba9d-1ad74347836e" path="/var/lib/kubelet/pods/9558ff76-553f-49f0-ba9d-1ad74347836e/volumes"
Jul 28 12:27:25.268349 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:25.268327    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22ba75c-1d85-4e92-8f48-cdef11f31be2" path="/var/lib/kubelet/pods/d22ba75c-1d85-4e92-8f48-cdef11f31be2/volumes"
Jul 28 12:27:30.912782 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:30.912706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:31.013272 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:31.013243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:31.236418 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:31.236302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:31.487920 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:31.487836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:35.308904 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.308865    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"]
Jul 28 12:27:35.309330 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309316    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d86aa2-8ead-422f-8034-744ded2d2a12" containerName="maas-api"
Jul 28 12:27:35.309376 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309331    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d86aa2-8ead-422f-8034-744ded2d2a12" containerName="maas-api"
Jul 28 12:27:35.309376 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309345    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" containerName="payload-processing"
Jul 28 12:27:35.309376 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309351    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" containerName="payload-processing"
Jul 28 12:27:35.309499 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309407    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9558ff76-553f-49f0-ba9d-1ad74347836e" containerName="registry-server"
Jul 28 12:27:35.309499 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309414    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9558ff76-553f-49f0-ba9d-1ad74347836e" containerName="registry-server"
Jul 28 12:27:35.309499 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309428    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22ba75c-1d85-4e92-8f48-cdef11f31be2" containerName="revoke-keys"
Jul 28 12:27:35.309499 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309434    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22ba75c-1d85-4e92-8f48-cdef11f31be2" containerName="revoke-keys"
Jul 28 12:27:35.309620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309507    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9558ff76-553f-49f0-ba9d-1ad74347836e" containerName="registry-server"
Jul 28 12:27:35.309620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309516    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a038fe6e-1f07-4641-9438-7cc9ceed98ea" containerName="payload-processing"
Jul 28 12:27:35.309620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309523    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22ba75c-1d85-4e92-8f48-cdef11f31be2" containerName="revoke-keys"
Jul 28 12:27:35.309620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.309531    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d86aa2-8ead-422f-8034-744ded2d2a12" containerName="maas-api"
Jul 28 12:27:35.313840 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.313824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:35.316725 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.316702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:27:35.319440 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.319412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"]
Jul 28 12:27:35.480279 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.480249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997\" (UID: \"e4772be2-ffd0-4018-930c-ed2a4a1d4db6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:35.581964 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.581870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997\" (UID: \"e4772be2-ffd0-4018-930c-ed2a4a1d4db6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:35.582516 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.582499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997\" (UID: \"e4772be2-ffd0-4018-930c-ed2a4a1d4db6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:35.627541 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.627514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:35.768727 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:35.768699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"]
Jul 28 12:27:35.769889 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:27:35.769865    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4772be2_ffd0_4018_930c_ed2a4a1d4db6.slice/crio-6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf WatchSource:0}: Error finding container 6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf: Status 404 returned error can't find the container with id 6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf
Jul 28 12:27:36.543933 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:36.543897    2573 generic.go:356] "Generic (PLEG): container finished" podID="e4772be2-ffd0-4018-930c-ed2a4a1d4db6" containerID="de7346d084535c010260b9c010b26226ff70f09bae346a2f73b097fc894b1567" exitCode=0
Jul 28 12:27:36.544341 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:36.543941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997" event={"ID":"e4772be2-ffd0-4018-930c-ed2a4a1d4db6","Type":"ContainerDied","Data":"de7346d084535c010260b9c010b26226ff70f09bae346a2f73b097fc894b1567"}
Jul 28 12:27:36.544341 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:36.544000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997" event={"ID":"e4772be2-ffd0-4018-930c-ed2a4a1d4db6","Type":"ContainerStarted","Data":"6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf"}
Jul 28 12:27:37.687948 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:37.687924    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:37.703748 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:37.703725    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca\") pod \"e4772be2-ffd0-4018-930c-ed2a4a1d4db6\" (UID: \"e4772be2-ffd0-4018-930c-ed2a4a1d4db6\") "
Jul 28 12:27:37.704120 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:37.704084    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4772be2-ffd0-4018-930c-ed2a4a1d4db6" (UID: "e4772be2-ffd0-4018-930c-ed2a4a1d4db6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:27:37.704226 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:37.704214    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4772be2-ffd0-4018-930c-ed2a4a1d4db6-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:38.558337 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:38.558306    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"
Jul 28 12:27:38.558337 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:38.558309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997" event={"ID":"e4772be2-ffd0-4018-930c-ed2a4a1d4db6","Type":"ContainerDied","Data":"6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf"}
Jul 28 12:27:38.558578 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:38.558364    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bcdced9225d0c87b4866a19585e16f65bb560ec5425339cbd8fc95038595ecf"
Jul 28 12:27:50.850044 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:50.850001    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:27:50.850484 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:50.850281    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" podUID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" containerName="maas-api" containerID="cri-o://8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965" gracePeriod=30
Jul 28 12:27:50.859273 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:50.859249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:50.936757 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:50.936723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:50.998066 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:50.998033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:51.098939 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.098918    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:27:51.131162 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.131135    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqjrw\" (UniqueName: \"kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw\") pod \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") "
Jul 28 12:27:51.131318 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.131197    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls\") pod \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") "
Jul 28 12:27:51.131318 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.131290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca\") pod \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\" (UID: \"f46c3f4f-03be-4374-bd2e-a364e2dad9c6\") "
Jul 28 12:27:51.131674 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.131655    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f46c3f4f-03be-4374-bd2e-a364e2dad9c6" (UID: "f46c3f4f-03be-4374-bd2e-a364e2dad9c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:27:51.133774 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.133754    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f46c3f4f-03be-4374-bd2e-a364e2dad9c6" (UID: "f46c3f4f-03be-4374-bd2e-a364e2dad9c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:27:51.133774 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.133764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw" (OuterVolumeSpecName: "kube-api-access-hqjrw") pod "f46c3f4f-03be-4374-bd2e-a364e2dad9c6" (UID: "f46c3f4f-03be-4374-bd2e-a364e2dad9c6"). InnerVolumeSpecName "kube-api-access-hqjrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:27:51.232220 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.232193    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-openshift-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:51.232220 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.232218    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqjrw\" (UniqueName: \"kubernetes.io/projected/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-kube-api-access-hqjrw\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:51.232428 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.232227    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f46c3f4f-03be-4374-bd2e-a364e2dad9c6-maas-api-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:27:51.640119 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.640084    2573 generic.go:356] "Generic (PLEG): container finished" podID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" containerID="8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965" exitCode=0
Jul 28 12:27:51.640363 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.640127    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"
Jul 28 12:27:51.640363 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.640171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" event={"ID":"f46c3f4f-03be-4374-bd2e-a364e2dad9c6","Type":"ContainerDied","Data":"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"}
Jul 28 12:27:51.640363 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.640228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb" event={"ID":"f46c3f4f-03be-4374-bd2e-a364e2dad9c6","Type":"ContainerDied","Data":"b2b298ecf20c8aa7fa0cc9556b415e2eb0872b284ef0b35fb8e230fbce5e65ce"}
Jul 28 12:27:51.640363 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.640255    2573 scope.go:117] "RemoveContainer" containerID="8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"
Jul 28 12:27:51.650976 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.650954    2573 scope.go:117] "RemoveContainer" containerID="8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"
Jul 28 12:27:51.651240 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:27:51.651222    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965\": container with ID starting with 8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965 not found: ID does not exist" containerID="8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"
Jul 28 12:27:51.651303 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.651250    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965"} err="failed to get container status \"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965\": rpc error: code = NotFound desc = could not find container \"8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965\": container with ID starting with 8b8d44584038c125570f183a9624e33f670b4748af7021bd297b58cf0ba38965 not found: ID does not exist"
Jul 28 12:27:51.661530 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.661502    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:27:51.665397 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:51.665360    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba0125-66b64c9d86-jcdnb"]
Jul 28 12:27:53.268295 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:53.268263    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" path="/var/lib/kubelet/pods/f46c3f4f-03be-4374-bd2e-a364e2dad9c6/volumes"
Jul 28 12:27:55.379757 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:55.379725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:55.411102 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:55.411074    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"]
Jul 28 12:27:55.413733 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:55.413713    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ba0125-vw997"]
Jul 28 12:27:55.787437 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:55.787328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:27:57.274466 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:27:57.274433    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4772be2-ffd0-4018-930c-ed2a4a1d4db6" path="/var/lib/kubelet/pods/e4772be2-ffd0-4018-930c-ed2a4a1d4db6/volumes"
Jul 28 12:28:00.876226 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:00.876192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:37.968706 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:37.968672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:38.089575 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:38.089542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:39.010944 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:39.010908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:45.213400 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.213348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:45.314516 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.314483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:45.571731 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.571649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:45.820357 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.820327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:45.942714 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.942683    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"]
Jul 28 12:28:45.943154 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943139    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" containerName="maas-api"
Jul 28 12:28:45.943154 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943155    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" containerName="maas-api"
Jul 28 12:28:45.943245 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943175    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4772be2-ffd0-4018-930c-ed2a4a1d4db6" containerName="revoke-keys"
Jul 28 12:28:45.943245 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943181    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4772be2-ffd0-4018-930c-ed2a4a1d4db6" containerName="revoke-keys"
Jul 28 12:28:45.943314 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943246    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f46c3f4f-03be-4374-bd2e-a364e2dad9c6" containerName="maas-api"
Jul 28 12:28:45.943314 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.943254    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4772be2-ffd0-4018-930c-ed2a4a1d4db6" containerName="revoke-keys"
Jul 28 12:28:45.947830 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.947813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:45.950367 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.950340    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:28:45.956301 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:45.956065    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"]
Jul 28 12:28:46.063672 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.063635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8\" (UID: \"08f55ba5-6324-4956-9c71-124f8325197c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:46.164740 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.164711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8\" (UID: \"08f55ba5-6324-4956-9c71-124f8325197c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:46.165369 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.165345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8\" (UID: \"08f55ba5-6324-4956-9c71-124f8325197c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:46.259783 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.259688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:46.415959 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.415929    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"]
Jul 28 12:28:46.417251 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:28:46.417218    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f55ba5_6324_4956_9c71_124f8325197c.slice/crio-d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74 WatchSource:0}: Error finding container d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74: Status 404 returned error can't find the container with id d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74
Jul 28 12:28:46.981222 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.981172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8" event={"ID":"08f55ba5-6324-4956-9c71-124f8325197c","Type":"ContainerStarted","Data":"0d14ba091a83b60de4cea5f70e4f0e97bd17edd09ef0d48ac1dd77f2bac9d6a4"}
Jul 28 12:28:46.981439 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:46.981243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8" event={"ID":"08f55ba5-6324-4956-9c71-124f8325197c","Type":"ContainerStarted","Data":"d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74"}
Jul 28 12:28:47.988783 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:47.988750    2573 generic.go:356] "Generic (PLEG): container finished" podID="08f55ba5-6324-4956-9c71-124f8325197c" containerID="0d14ba091a83b60de4cea5f70e4f0e97bd17edd09ef0d48ac1dd77f2bac9d6a4" exitCode=0
Jul 28 12:28:47.989223 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:47.988818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8" event={"ID":"08f55ba5-6324-4956-9c71-124f8325197c","Type":"ContainerDied","Data":"0d14ba091a83b60de4cea5f70e4f0e97bd17edd09ef0d48ac1dd77f2bac9d6a4"}
Jul 28 12:28:49.140394 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:49.140361    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:49.294344 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:49.294253    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca\") pod \"08f55ba5-6324-4956-9c71-124f8325197c\" (UID: \"08f55ba5-6324-4956-9c71-124f8325197c\") "
Jul 28 12:28:49.294694 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:49.294673    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08f55ba5-6324-4956-9c71-124f8325197c" (UID: "08f55ba5-6324-4956-9c71-124f8325197c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:28:49.396099 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:49.396067    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08f55ba5-6324-4956-9c71-124f8325197c-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:28:50.002603 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:50.002575    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"
Jul 28 12:28:50.002778 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:50.002609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8" event={"ID":"08f55ba5-6324-4956-9c71-124f8325197c","Type":"ContainerDied","Data":"d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74"}
Jul 28 12:28:50.002778 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:50.002659    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7a2c3f401a871ea344e612b26e85e3309ea52ca9a4433b22f6db8a8f4c24f74"
Jul 28 12:28:56.925147 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:56.925101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:56.985480 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:56.985449    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:28:56.985699 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:56.985674    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" podUID="f452b153-8a50-4447-aadf-6510cca21f9d" containerName="payload-processing" containerID="cri-o://ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2" gracePeriod=30
Jul 28 12:28:57.066236 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.066199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:57.177146 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.177059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:28:57.253893 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.253869    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:28:57.377033 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.376998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume\") pod \"f452b153-8a50-4447-aadf-6510cca21f9d\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") "
Jul 28 12:28:57.377225 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.377043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wdqw\" (UniqueName: \"kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw\") pod \"f452b153-8a50-4447-aadf-6510cca21f9d\" (UID: \"f452b153-8a50-4447-aadf-6510cca21f9d\") "
Jul 28 12:28:57.377530 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.377500    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f452b153-8a50-4447-aadf-6510cca21f9d" (UID: "f452b153-8a50-4447-aadf-6510cca21f9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:28:57.379163 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.379144    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw" (OuterVolumeSpecName: "kube-api-access-5wdqw") pod "f452b153-8a50-4447-aadf-6510cca21f9d" (UID: "f452b153-8a50-4447-aadf-6510cca21f9d"). InnerVolumeSpecName "kube-api-access-5wdqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:28:57.478134 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.478044    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f452b153-8a50-4447-aadf-6510cca21f9d-plugins-config-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:28:57.478134 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:57.478077    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wdqw\" (UniqueName: \"kubernetes.io/projected/f452b153-8a50-4447-aadf-6510cca21f9d-kube-api-access-5wdqw\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:28:58.051650 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.051616    2573 generic.go:356] "Generic (PLEG): container finished" podID="f452b153-8a50-4447-aadf-6510cca21f9d" containerID="ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2" exitCode=0
Jul 28 12:28:58.052148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.051660    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"
Jul 28 12:28:58.052148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.051704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" event={"ID":"f452b153-8a50-4447-aadf-6510cca21f9d","Type":"ContainerDied","Data":"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"}
Jul 28 12:28:58.052148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.051762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676" event={"ID":"f452b153-8a50-4447-aadf-6510cca21f9d","Type":"ContainerDied","Data":"7377b0a970ce04b9515006fee41460005dba40d50d471f554f173e52aabfa969"}
Jul 28 12:28:58.052148 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.051795    2573 scope.go:117] "RemoveContainer" containerID="ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"
Jul 28 12:28:58.062091 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.062072    2573 scope.go:117] "RemoveContainer" containerID="ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"
Jul 28 12:28:58.062358 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:28:58.062336    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2\": container with ID starting with ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2 not found: ID does not exist" containerID="ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"
Jul 28 12:28:58.062429 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.062372    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2"} err="failed to get container status \"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2\": rpc error: code = NotFound desc = could not find container \"ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2\": container with ID starting with ecda1431b3b3448f19a6ea99412f7e4b6d7d79fa2aaff15f2aca3056726f1df2 not found: ID does not exist"
Jul 28 12:28:58.077836 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.077802    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:28:58.087078 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:58.087051    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a4d289-7fd68ff4f6-6l676"]
Jul 28 12:28:59.268136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:28:59.268056    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f452b153-8a50-4447-aadf-6510cca21f9d" path="/var/lib/kubelet/pods/f452b153-8a50-4447-aadf-6510cca21f9d/volumes"
Jul 28 12:29:01.051986 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:01.051950    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"]
Jul 28 12:29:01.054769 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:01.054748    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a4d289-xcsr8"]
Jul 28 12:29:01.055932 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:01.055907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:01.268675 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:01.268643    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f55ba5-6324-4956-9c71-124f8325197c" path="/var/lib/kubelet/pods/08f55ba5-6324-4956-9c71-124f8325197c/volumes"
Jul 28 12:29:01.441535 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:01.441504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:07.867265 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:07.867226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:07.971133 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:07.971102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:08.153100 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.153061    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:29:08.153342 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.153314    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" containerID="cri-o://07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe" gracePeriod=30
Jul 28 12:29:08.176558 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.176530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:08.423585 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.423508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:08.587880 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.587852    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"]
Jul 28 12:29:08.588359 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588341    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f55ba5-6324-4956-9c71-124f8325197c" containerName="revoke-keys"
Jul 28 12:29:08.588428 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588361    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f55ba5-6324-4956-9c71-124f8325197c" containerName="revoke-keys"
Jul 28 12:29:08.588428 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588393    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f452b153-8a50-4447-aadf-6510cca21f9d" containerName="payload-processing"
Jul 28 12:29:08.588428 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588402    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f452b153-8a50-4447-aadf-6510cca21f9d" containerName="payload-processing"
Jul 28 12:29:08.588538 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588504    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f55ba5-6324-4956-9c71-124f8325197c" containerName="revoke-keys"
Jul 28 12:29:08.588538 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.588516    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f452b153-8a50-4447-aadf-6510cca21f9d" containerName="payload-processing"
Jul 28 12:29:08.592742 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.592725    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:08.596676 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.596656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ts4x9\""
Jul 28 12:29:08.605332 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.605304    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"]
Jul 28 12:29:08.679007 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.678929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx\" (UID: \"7f14556d-a976-4f5b-82fb-a898c107064a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:08.780448 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.780353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx\" (UID: \"7f14556d-a976-4f5b-82fb-a898c107064a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:08.780941 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.780915    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx\" (UID: \"7f14556d-a976-4f5b-82fb-a898c107064a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:08.907098 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:08.907066    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:09.264436 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:29:09.264373    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f14556d_a976_4f5b_82fb_a898c107064a.slice/crio-6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98 WatchSource:0}: Error finding container 6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98: Status 404 returned error can't find the container with id 6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98
Jul 28 12:29:09.270899 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:09.270878    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"]
Jul 28 12:29:10.130353 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:10.130320    2573 generic.go:356] "Generic (PLEG): container finished" podID="7f14556d-a976-4f5b-82fb-a898c107064a" containerID="4d57c7e5b4a7b80d91487aaf4286dd54d3a26da8f536176ec718d4d9f1afb128" exitCode=0
Jul 28 12:29:10.130353 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:10.130356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx" event={"ID":"7f14556d-a976-4f5b-82fb-a898c107064a","Type":"ContainerDied","Data":"4d57c7e5b4a7b80d91487aaf4286dd54d3a26da8f536176ec718d4d9f1afb128"}
Jul 28 12:29:10.130794 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:10.130420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx" event={"ID":"7f14556d-a976-4f5b-82fb-a898c107064a","Type":"ContainerStarted","Data":"6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98"}
Jul 28 12:29:11.280334 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:11.280309    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:11.306675 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:11.306652    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca\") pod \"7f14556d-a976-4f5b-82fb-a898c107064a\" (UID: \"7f14556d-a976-4f5b-82fb-a898c107064a\") "
Jul 28 12:29:11.307046 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:11.307018    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f14556d-a976-4f5b-82fb-a898c107064a" (UID: "7f14556d-a976-4f5b-82fb-a898c107064a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:29:11.307171 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:11.307107    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f14556d-a976-4f5b-82fb-a898c107064a-maas-api-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:12.143784 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:12.143758    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"
Jul 28 12:29:12.143958 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:12.143801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx" event={"ID":"7f14556d-a976-4f5b-82fb-a898c107064a","Type":"ContainerDied","Data":"6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98"}
Jul 28 12:29:12.143958 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:12.143846    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a111d7b3ebf960a5bfb7c3670899afe7b09b8ae81f34ad9332fd902d6093f98"
Jul 28 12:29:13.056852 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.056814    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 12:29:13.057249 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.056870    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 12:29:13.410448 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.410417    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:29:13.529698 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529651    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.529900 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529752    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.529900 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529781    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr68z\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.529900 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.529900 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529829    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.529900 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.530164 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.530164 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.529946    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.530164 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530034    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket\") pod \"011b7653-2947-4c9d-8370-fcd90432bd8d\" (UID: \"011b7653-2947-4c9d-8370-fcd90432bd8d\") "
Jul 28 12:29:13.530315 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:29:13.530443 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530423    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-certs\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.530602 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530564    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:29:13.530689 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530601    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:29:13.530749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530722    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:29:13.530807 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.530761    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:29:13.532147 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.532118    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:29:13.532147 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.532128    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z" (OuterVolumeSpecName: "kube-api-access-pr68z") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "kube-api-access-pr68z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:29:13.532448 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.532425    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:29:13.532501 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.532460    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "011b7653-2947-4c9d-8370-fcd90432bd8d" (UID: "011b7653-2947-4c9d-8370-fcd90432bd8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 12:29:13.631460 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631413    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-workload-socket\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631460 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631457    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011b7653-2947-4c9d-8370-fcd90432bd8d-istiod-ca-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631460 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631471    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-credential-socket\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631484    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-data\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631497    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr68z\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-kube-api-access-pr68z\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631508    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-envoy\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631519    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-token\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:13.631715 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:13.631529    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011b7653-2947-4c9d-8370-fcd90432bd8d-istio-podinfo\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\""
Jul 28 12:29:14.157580 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.157548    2573 generic.go:356] "Generic (PLEG): container finished" podID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerID="07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe" exitCode=0
Jul 28 12:29:14.157991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.157595    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"
Jul 28 12:29:14.157991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.157634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerDied","Data":"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"}
Jul 28 12:29:14.157991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.157692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck" event={"ID":"011b7653-2947-4c9d-8370-fcd90432bd8d","Type":"ContainerDied","Data":"dd1418d13914c11718a587c55c04c0690f965128418a21197600a137e4e6d292"}
Jul 28 12:29:14.157991 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.157715    2573 scope.go:117] "RemoveContainer" containerID="07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"
Jul 28 12:29:14.173303 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.173278    2573 scope.go:117] "RemoveContainer" containerID="cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"
Jul 28 12:29:14.182576 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.182541    2573 scope.go:117] "RemoveContainer" containerID="07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"
Jul 28 12:29:14.183038 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:29:14.183005    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe\": container with ID starting with 07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe not found: ID does not exist" containerID="07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"
Jul 28 12:29:14.183136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.183076    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe"} err="failed to get container status \"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe\": rpc error: code = NotFound desc = could not find container \"07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe\": container with ID starting with 07d501afebff17ccbc4516607587ef6f6bc1420e7fe1366515b689bbd166a4fe not found: ID does not exist"
Jul 28 12:29:14.183202 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.183141    2573 scope.go:117] "RemoveContainer" containerID="cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"
Jul 28 12:29:14.183561 ip-10-0-142-146 kubenswrapper[2573]: E0728 12:29:14.183538    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688\": container with ID starting with cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688 not found: ID does not exist" containerID="cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"
Jul 28 12:29:14.183624 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.183570    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688"} err="failed to get container status \"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688\": rpc error: code = NotFound desc = could not find container \"cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688\": container with ID starting with cea8da2e354dffe813028f266fc4e54c48c4fd36decf9141155fa65492f3c688 not found: ID does not exist"
Jul 28 12:29:14.193798 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.193775    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:29:14.201701 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:14.201677    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4d289-openshift-default-5484bc5548-v9bck"]
Jul 28 12:29:15.268601 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:15.268570    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" path="/var/lib/kubelet/pods/011b7653-2947-4c9d-8370-fcd90432bd8d/volumes"
Jul 28 12:29:19.263106 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:19.263067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:19.378136 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:19.378101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:19.477523 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:19.477482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:23.688617 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:23.688587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:23.698758 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:23.698724    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"]
Jul 28 12:29:23.701942 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:23.701919    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4d5cfe-n6xqx"]
Jul 28 12:29:24.112023 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:24.111948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:25.267768 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:25.267738    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f14556d-a976-4f5b-82fb-a898c107064a" path="/var/lib/kubelet/pods/7f14556d-a976-4f5b-82fb-a898c107064a/volumes"
Jul 28 12:29:30.528585 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:30.528546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:32.301268 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:32.301240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:41.759955 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:41.759923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:41.860963 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:41.860918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:41.961466 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:41.961422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:46.340074 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:46.340035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:46.772368 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:46.772334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:53.001984 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:53.001951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:53.105503 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:53.105468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:53.333910 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:53.333799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:53.590453 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:53.590310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:29:54.033985 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:29:54.033933    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5848d5b577-k6nm8_50e36a13-128b-4e01-9489-4580e0d468f4/authorino/0.log"
Jul 28 12:30:00.097774 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:00.097742    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-d7ttm_165ca687-c546-49cd-af1d-f2923b89b29f/manager/0.log"
Jul 28 12:30:00.364507 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:00.364421    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l64pl_7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4/server/0.log"
Jul 28 12:30:00.483130 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:00.483095    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ww8jd_a7b552ce-918a-4627-8139-c9a07dc6981e/manager/0.log"
Jul 28 12:30:00.744175 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:00.744147    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6755d7577-bxlnb_48b8ca5d-9ffa-47ac-afff-5e2771a27ae6/copy-manifests/0.log"
Jul 28 12:30:00.752054 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:00.752019    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6755d7577-bxlnb_48b8ca5d-9ffa-47ac-afff-5e2771a27ae6/manager/0.log"
Jul 28 12:30:01.266689 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:01.266635    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8649546779-d67nh_05bd3e1b-c046-4238-a413-d0c105c64080/maas-api/0.log"
Jul 28 12:30:01.525754 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:01.525671    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754015-6r246_0dc11461-7a2c-47b6-99ea-5304b44df01f/cleanup/0.log"
Jul 28 12:30:01.795277 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:01.795169    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hhblq_d1d7ff37-a755-4f34-8b2c-2794231282aa/postgres/0.log"
Jul 28 12:30:02.664191 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.664164    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/util/0.log"
Jul 28 12:30:02.672443 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.672420    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/pull/0.log"
Jul 28 12:30:02.679988 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.679974    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/extract/0.log"
Jul 28 12:30:02.819257 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.819222    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/util/0.log"
Jul 28 12:30:02.826110 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.826048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/pull/0.log"
Jul 28 12:30:02.832179 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.832159    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/extract/0.log"
Jul 28 12:30:02.942748 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.942676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/util/0.log"
Jul 28 12:30:02.948844 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.948820    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/pull/0.log"
Jul 28 12:30:02.955070 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:02.955050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/extract/0.log"
Jul 28 12:30:03.080550 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.080523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/extract/0.log"
Jul 28 12:30:03.087243 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.087219    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/util/0.log"
Jul 28 12:30:03.094105 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.094086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/pull/0.log"
Jul 28 12:30:03.216656 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.216582    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5848d5b577-k6nm8_50e36a13-128b-4e01-9489-4580e0d468f4/authorino/0.log"
Jul 28 12:30:03.339973 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.339947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksms2_0bf16519-53c3-4d3a-8d36-c03e2be44e38/manager/0.log"
Jul 28 12:30:03.470602 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.470526    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7xct5_12e8ef80-2bf9-47d1-9d4d-214d3b131957/manager/0.log"
Jul 28 12:30:03.722891 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:03.722816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r7bbr_2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf/registry-server/0.log"
Jul 28 12:30:04.125286 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:04.125258    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bbk6n_2299de78-e7c5-4903-a7f1-c3092e2c4e23/manager/0.log"
Jul 28 12:30:04.511346 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:04.511268    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfzj88_aef183d4-c493-4d11-942b-57f77c204cff/istio-proxy/0.log"
Jul 28 12:30:04.764367 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:04.764294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489dc4db9-dsm9r_84b4ebbe-a1f9-4b27-9a77-835538103775/kube-auth-proxy/0.log"
Jul 28 12:30:05.049603 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.049496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/1.log"
Jul 28 12:30:05.173972 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.173928    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bhjjt_2ef2bab4-bbb9-43bc-9ff8-11d65d240af6/payload-pre-processing/0.log"
Jul 28 12:30:05.296199 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.296172    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:30:05.417450 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.417419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6794959d8f-8pwds_ff4e6854-9326-451e-b4a3-3f836fe513cc/router/0.log"
Jul 28 12:30:05.824028 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.823952    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tvcw4_9c82ab5c-67d9-40dd-8e2c-3b06e40cedcf/main/0.log"
Jul 28 12:30:05.951952 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:05.951923    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x9xfl_527cf7ff-ca91-4869-aa6d-58d257018199/main/0.log"
Jul 28 12:30:06.226665 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:06.226638    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnzp9j_ebab8fc2-93b3-4ad7-b1cf-5ab91aaa1e8f/main/0.log"
Jul 28 12:30:06.478081 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:06.478000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-llgcc_6a4c8b00-af42-4ad0-affe-558f15e59306/main/0.log"
Jul 28 12:30:12.491919 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:12.491886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:12.587868 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:12.587838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:15.391602 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:15.391577    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bbhww_212221fa-9df5-464c-84c9-63794ff84767/global-pull-secret-syncer/0.log"
Jul 28 12:30:15.551928 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:15.551895    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log"
Jul 28 12:30:15.671799 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:15.671722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mdn6s_8f47aed4-fbad-49c5-8c28-4fac69d6ff28/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:15.719735 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:15.719708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-146.ec2.internal_93041afa6a72f232924f93ead32451d3/haproxy/0.log"
Jul 28 12:30:19.365722 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.365690    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/extract/0.log"
Jul 28 12:30:19.390077 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.390049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/util/0.log"
Jul 28 12:30:19.433921 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.433900    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596z2v7_5ac32d02-e26f-464a-9996-30890d9f4e1b/pull/0.log"
Jul 28 12:30:19.465241 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.465220    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/extract/0.log"
Jul 28 12:30:19.493561 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.493542    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/util/0.log"
Jul 28 12:30:19.518603 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.518583    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbvs4_2e4ba2cc-080c-4663-b5d2-e685d3ace874/pull/0.log"
Jul 28 12:30:19.549039 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.549022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/extract/0.log"
Jul 28 12:30:19.574358 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.574334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/util/0.log"
Jul 28 12:30:19.604537 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.604518    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtckn_58f35a47-bd7d-42e0-b835-98970ddb36cb/pull/0.log"
Jul 28 12:30:19.674996 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.674975    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/extract/0.log"
Jul 28 12:30:19.703732 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.703715    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/util/0.log"
Jul 28 12:30:19.732573 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:19.732553    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18v9c2_45428e3a-88a6-43ca-80a0-918885efb3b1/pull/0.log"
Jul 28 12:30:20.110442 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:20.110336    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5848d5b577-k6nm8_50e36a13-128b-4e01-9489-4580e0d468f4/authorino/0.log"
Jul 28 12:30:20.138681 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:20.138651    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksms2_0bf16519-53c3-4d3a-8d36-c03e2be44e38/manager/0.log"
Jul 28 12:30:20.168304 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:20.168284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7xct5_12e8ef80-2bf9-47d1-9d4d-214d3b131957/manager/0.log"
Jul 28 12:30:20.246251 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:20.246223    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r7bbr_2fe23fea-eb9a-4660-a4b8-6b4f452e4bdf/registry-server/0.log"
Jul 28 12:30:20.512972 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:20.512944    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bbk6n_2299de78-e7c5-4903-a7f1-c3092e2c4e23/manager/0.log"
Jul 28 12:30:22.208212 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.208184    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-drc29_e11755dd-608c-44e0-82aa-6cebfc824d79/cluster-monitoring-operator/0.log"
Jul 28 12:30:22.273326 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.273299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8xvp4_0c151e9c-2a30-4c90-86c1-04ab97991023/kube-state-metrics/0.log"
Jul 28 12:30:22.295869 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.295846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8xvp4_0c151e9c-2a30-4c90-86c1-04ab97991023/kube-rbac-proxy-main/0.log"
Jul 28 12:30:22.322647 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.322625    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8xvp4_0c151e9c-2a30-4c90-86c1-04ab97991023/kube-rbac-proxy-self/0.log"
Jul 28 12:30:22.466541 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.466479    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lss9j_0a852c30-e878-427a-9638-2a2341f1436d/node-exporter/0.log"
Jul 28 12:30:22.506710 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.506686    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lss9j_0a852c30-e878-427a-9638-2a2341f1436d/kube-rbac-proxy/0.log"
Jul 28 12:30:22.542980 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.542957    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lss9j_0a852c30-e878-427a-9638-2a2341f1436d/init-textfile/0.log"
Jul 28 12:30:22.768539 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.768464    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-487pb_eef83e59-87e2-4e28-9038-f4a4ab07767d/kube-rbac-proxy-main/0.log"
Jul 28 12:30:22.796229 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.796205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-487pb_eef83e59-87e2-4e28-9038-f4a4ab07767d/kube-rbac-proxy-self/0.log"
Jul 28 12:30:22.820931 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:22.820904    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-487pb_eef83e59-87e2-4e28-9038-f4a4ab07767d/openshift-state-metrics/0.log"
Jul 28 12:30:23.071758 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:23.071676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vsp64_379bc22e-2534-4d7d-bf2f-07f34701be1c/prometheus-operator/0.log"
Jul 28 12:30:23.094838 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:23.094793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vsp64_379bc22e-2534-4d7d-bf2f-07f34701be1c/kube-rbac-proxy/0.log"
Jul 28 12:30:25.319014 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.318985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:30:25.323784 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.323765    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/3.log"
Jul 28 12:30:25.469606 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.469531    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"]
Jul 28 12:30:25.469964 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.469951    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy"
Jul 28 12:30:25.470011 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.469965    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy"
Jul 28 12:30:25.470011 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.469980    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f14556d-a976-4f5b-82fb-a898c107064a" containerName="revoke-keys"
Jul 28 12:30:25.470011 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.469985    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f14556d-a976-4f5b-82fb-a898c107064a" containerName="revoke-keys"
Jul 28 12:30:25.470167 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.470103    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy"
Jul 28 12:30:25.470167 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.470115    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f14556d-a976-4f5b-82fb-a898c107064a" containerName="revoke-keys"
Jul 28 12:30:25.470167 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.470127    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b7653-2947-4c9d-8370-fcd90432bd8d" containerName="istio-proxy"
Jul 28 12:30:25.473489 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.473465    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.476564 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.476546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwgdc\"/\"openshift-service-ca.crt\""
Jul 28 12:30:25.477680 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.477659    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwgdc\"/\"kube-root-ca.crt\""
Jul 28 12:30:25.477779 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.477706    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dwgdc\"/\"default-dockercfg-6rr66\""
Jul 28 12:30:25.489742 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.489719    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"]
Jul 28 12:30:25.510738 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.510713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28fz\" (UniqueName: \"kubernetes.io/projected/198da616-97d9-4795-b416-b0f0e1e9ba59-kube-api-access-s28fz\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.510832 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.510747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-lib-modules\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.510832 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.510816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-proc\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.510910 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.510885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-podres\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.510948 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.510927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-sys\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.611911 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.611884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-proc\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.611934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-podres\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.611964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-sys\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.611998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28fz\" (UniqueName: \"kubernetes.io/projected/198da616-97d9-4795-b416-b0f0e1e9ba59-kube-api-access-s28fz\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.612016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-lib-modules\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612057 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.612012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-proc\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612321 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.612078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-sys\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612321 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.612116    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-podres\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.612321 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.612137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/198da616-97d9-4795-b416-b0f0e1e9ba59-lib-modules\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.621003 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.620982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28fz\" (UniqueName: \"kubernetes.io/projected/198da616-97d9-4795-b416-b0f0e1e9ba59-kube-api-access-s28fz\") pod \"perf-node-gather-daemonset-559bd\" (UID: \"198da616-97d9-4795-b416-b0f0e1e9ba59\") " pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.784159 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.784063    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:25.921719 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.921689    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"]
Jul 28 12:30:25.922502 ip-10-0-142-146 kubenswrapper[2573]: W0728 12:30:25.922470    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod198da616_97d9_4795_b416_b0f0e1e9ba59.slice/crio-9a6f779db1a16329838e4ceeb100fd6ff451494b72419d1cd7ba724e17be804d WatchSource:0}: Error finding container 9a6f779db1a16329838e4ceeb100fd6ff451494b72419d1cd7ba724e17be804d: Status 404 returned error can't find the container with id 9a6f779db1a16329838e4ceeb100fd6ff451494b72419d1cd7ba724e17be804d
Jul 28 12:30:25.950181 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.950152    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55995b4956-xhlgf_7dde145e-59c1-4ea2-ae81-09d8d8b95334/console/0.log"
Jul 28 12:30:25.993999 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:25.993971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-prhh2_c714a46e-2233-4287-acbe-c73bc7fbf23a/download-server/0.log"
Jul 28 12:30:26.606040 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:26.606004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd" event={"ID":"198da616-97d9-4795-b416-b0f0e1e9ba59","Type":"ContainerStarted","Data":"a220cab02088dcb1be6474f96eacf12a6d64968f58a7c4c58ce03906b751e156"}
Jul 28 12:30:26.606438 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:26.606065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd" event={"ID":"198da616-97d9-4795-b416-b0f0e1e9ba59","Type":"ContainerStarted","Data":"9a6f779db1a16329838e4ceeb100fd6ff451494b72419d1cd7ba724e17be804d"}
Jul 28 12:30:26.606438 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:26.606103    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:26.625240 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:26.625193    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd" podStartSLOduration=1.625169454 podStartE2EDuration="1.625169454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:26.624507465 +0000 UTC m=+3589.813108459" watchObservedRunningTime="2026-07-28 12:30:26.625169454 +0000 UTC m=+3589.813770485"
Jul 28 12:30:26.658547 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:26.658522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-sxc2h_519df90f-62e8-4274-ba19-47dbdc2285a1/volume-data-source-validator/0.log"
Jul 28 12:30:27.731219 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:27.731194    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gt9s_a0c8fa60-4714-4402-b58d-bf7e0cf980ec/dns/0.log"
Jul 28 12:30:27.756956 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:27.756935    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gt9s_a0c8fa60-4714-4402-b58d-bf7e0cf980ec/kube-rbac-proxy/0.log"
Jul 28 12:30:27.931457 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:27.931427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9vx9_ac18fcef-78da-49a3-82cb-fa297e53794b/dns-node-resolver/0.log"
Jul 28 12:30:28.504668 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:28.504638    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs5rx_32a4e0a5-c9f1-4ed8-b32f-43fc47e96164/node-ca/0.log"
Jul 28 12:30:29.516137 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.516050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfzj88_aef183d4-c493-4d11-942b-57f77c204cff/istio-proxy/0.log"
Jul 28 12:30:29.736165 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.736140    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489dc4db9-dsm9r_84b4ebbe-a1f9-4b27-9a77-835538103775/kube-auth-proxy/0.log"
Jul 28 12:30:29.795635 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.795564    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/0.log"
Jul 28 12:30:29.822538 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.822510    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/1.log"
Jul 28 12:30:29.856174 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.856146    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bhjjt_2ef2bab4-bbb9-43bc-9ff8-11d65d240af6/payload-pre-processing/0.log"
Jul 28 12:30:29.885476 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.885454    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:30:29.910112 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:29.910089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6794959d8f-8pwds_ff4e6854-9326-451e-b4a3-3f836fe513cc/router/0.log"
Jul 28 12:30:30.738469 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:30.738439    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-25n7w_b8c45d7d-8dfa-4c18-a6a6-ccaf46eceb6e/serve-healthcheck-canary/0.log"
Jul 28 12:30:31.278209 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:31.278167    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-5f8lp_d56b9553-c0ad-4572-926a-f9ce45d9aa83/insights-operator/0.log"
Jul 28 12:30:31.278749 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:31.278732    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-5f8lp_d56b9553-c0ad-4572-926a-f9ce45d9aa83/insights-operator/1.log"
Jul 28 12:30:31.301279 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:31.301256    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6pcm5_49f7bad9-b06e-4fb1-9938-88e3babe32ef/kube-rbac-proxy/0.log"
Jul 28 12:30:31.327728 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:31.327702    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6pcm5_49f7bad9-b06e-4fb1-9938-88e3babe32ef/exporter/0.log"
Jul 28 12:30:31.367794 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:31.367767    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6pcm5_49f7bad9-b06e-4fb1-9938-88e3babe32ef/extractor/0.log"
Jul 28 12:30:32.622712 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:32.622684    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dwgdc/perf-node-gather-daemonset-559bd"
Jul 28 12:30:34.016105 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:34.016079    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-d7ttm_165ca687-c546-49cd-af1d-f2923b89b29f/manager/0.log"
Jul 28 12:30:34.222422 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:34.222394    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l64pl_7c0d8a3e-2ca5-453a-9b1f-c5a3617372d4/server/0.log"
Jul 28 12:30:34.300432 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:34.300345    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ww8jd_a7b552ce-918a-4627-8139-c9a07dc6981e/manager/0.log"
Jul 28 12:30:34.387936 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:34.387910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6755d7577-bxlnb_48b8ca5d-9ffa-47ac-afff-5e2771a27ae6/manager/0.log"
Jul 28 12:30:34.418258 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:34.418231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6755d7577-bxlnb_48b8ca5d-9ffa-47ac-afff-5e2771a27ae6/copy-manifests/0.log"
Jul 28 12:30:35.961434 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:35.961406    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfzj88_aef183d4-c493-4d11-942b-57f77c204cff/istio-proxy/0.log"
Jul 28 12:30:36.062341 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.062315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hl9sz_0a534a16-f108-4d4d-a5e1-2865cfcbe1e4/openshift-lws-operator/0.log"
Jul 28 12:30:36.171601 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.171574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489dc4db9-dsm9r_84b4ebbe-a1f9-4b27-9a77-835538103775/kube-auth-proxy/0.log"
Jul 28 12:30:36.213120 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.213032    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/0.log"
Jul 28 12:30:36.239647 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.239621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/1.log"
Jul 28 12:30:36.261984 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.261964    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bhjjt_2ef2bab4-bbb9-43bc-9ff8-11d65d240af6/payload-pre-processing/0.log"
Jul 28 12:30:36.287616 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.287592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:30:36.312589 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:36.312562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6794959d8f-8pwds_ff4e6854-9326-451e-b4a3-3f836fe513cc/router/0.log"
Jul 28 12:30:37.709967 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:37.709932    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfzj88_aef183d4-c493-4d11-942b-57f77c204cff/istio-proxy/0.log"
Jul 28 12:30:37.919620 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:37.919575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489dc4db9-dsm9r_84b4ebbe-a1f9-4b27-9a77-835538103775/kube-auth-proxy/0.log"
Jul 28 12:30:37.960653 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:37.960572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/0.log"
Jul 28 12:30:37.987904 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:37.987876    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dg67k_dcdbfee6-e977-4a87-a4ba-58abc4faee7e/istio-proxy/1.log"
Jul 28 12:30:38.011487 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:38.011462    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bhjjt_2ef2bab4-bbb9-43bc-9ff8-11d65d240af6/payload-pre-processing/0.log"
Jul 28 12:30:38.035020 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:38.034998    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-lhx87_52b12ed1-f161-4ce6-b2d7-e7e3a9192f72/payload-processing/0.log"
Jul 28 12:30:38.053624 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:38.053604    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6794959d8f-8pwds_ff4e6854-9326-451e-b4a3-3f836fe513cc/router/0.log"
Jul 28 12:30:38.844665 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:38.844631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:30:38.858194 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:38.858175    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-57f6s_b1fcf5f3-38d3-4ea7-822f-53bbdf1d1ed5/console-operator/2.log"
Jul 28 12:30:42.763958 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.763931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/kube-multus-additional-cni-plugins/0.log"
Jul 28 12:30:42.786474 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.786452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/egress-router-binary-copy/0.log"
Jul 28 12:30:42.809298 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.809280    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/cni-plugins/0.log"
Jul 28 12:30:42.831640 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.831617    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/bond-cni-plugin/0.log"
Jul 28 12:30:42.854017 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.853997    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/routeoverride-cni/0.log"
Jul 28 12:30:42.878705 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.878688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/whereabouts-cni-bincopy/0.log"
Jul 28 12:30:42.901733 ip-10-0-142-146 kubenswrapper[2573]: I0728 12:30:42.901709    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vv2gc_43df24c6-6e6e-48f5-b00a-25e44f7b866f/whereabouts-cni/0.log"