Jul 27 17:25:04.012474 ip-10-0-143-96 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 17:25:04.387366 ip-10-0-143-96 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:04.387366 ip-10-0-143-96 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 17:25:04.387366 ip-10-0-143-96 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:04.387366 ip-10-0-143-96 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 17:25:04.387366 ip-10-0-143-96 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:04.388052 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.387430    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 17:25:04.390843 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390827    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.390843 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390842    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390846    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390851    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390854    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390858    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390861    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390864    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390866    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390875    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390878    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390881    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390883    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390886    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390888    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390891    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390894    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390896    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390900    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390904    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390908    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.390909 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390910    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390913    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390916    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390919    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390922    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390925    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390927    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390930    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390932    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390935    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390938    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390940    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390943    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390946    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390948    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390951    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390953    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390956    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390958    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.391410 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390961    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390963    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390966    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390968    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390970    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390973    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390976    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390979    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390981    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390984    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390986    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390988    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390991    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390994    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390996    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.390999    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391002    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391005    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391008    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.392080 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391010    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391014    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391016    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391019    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391021    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391023    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391026    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391028    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391032    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391036    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391039    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391042    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391045    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391048    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391051    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391053    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391056    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391058    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391061    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.392678 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391064    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391066    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391069    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391072    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391075    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391077    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391080    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391083    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391085    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391089    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391092    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391094    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391098    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391102    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391104    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391107    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391110    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391113    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391116    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391119    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.393160 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.391122    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.394266 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394246    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.394266 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394263    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.394266 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394269    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.394266 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394273    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394278    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394282    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394288    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394293    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394297    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394301    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394305    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394319    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394323    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394327    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394335    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394339    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394343    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394347    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394351    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394355    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394358    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.394515 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394362    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394366    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394370    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394374    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394378    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394382    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394386    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394390    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394394    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394398    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394403    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394408    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394412    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394416    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394420    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394425    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394429    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394434    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394438    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394442    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.395332 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394447    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394451    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394455    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394459    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394464    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394468    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394472    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394476    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394480    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394484    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394488    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394492    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394497    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394501    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394505    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394509    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394513    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394518    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394522    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394526    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.396209 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394531    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394537    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394545    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394551    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394557    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394562    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394567    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394572    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394576    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394581    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394587    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394591    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394595    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394599    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394604    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394608    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394612    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394616    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394621    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.397085 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394625    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394629    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394635    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394639    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394643    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394647    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394651    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394655    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394660    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394663    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394668    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394672    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394677    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394681    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394685    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394689    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394694    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.394698    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395310    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395320    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395325    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.397723 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395333    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395337    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395341    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395345    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395349    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395353    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395357    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395361    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395365    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395370    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395374    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395378    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395383    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395388    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395393    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395397    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395401    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395405    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395409    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395413    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.398334 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395418    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395423    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395428    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395433    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395438    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395442    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395446    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395450    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395454    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395458    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395463    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395467    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395472    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395476    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395480    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395487    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395492    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395496    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395501    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.398987 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395505    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395510    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395514    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395518    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395523    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395527    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395531    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395536    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395540    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395544    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395548    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395553    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395558    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395562    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395567    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395571    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395577    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395581    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395585    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395590    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.399636 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395594    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395598    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395602    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395607    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395612    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395616    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395620    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395624    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395628    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395632    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395636    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395641    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395645    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395649    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395653    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395657    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395666    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395672    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395677    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.400155 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395682    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395688    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395693    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395697    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395701    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395705    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395709    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395714    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395718    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395724    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395731    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395735    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395740    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395744    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395748    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395752    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395756    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.395764    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395870    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395881    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 17:25:04.400638 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395891    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395897    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395904    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395909    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395915    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395922    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395927    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395932    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395938    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395944    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395949    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395954    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395959    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395964    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395969    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395974    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395982    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395987    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395992    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.395997    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396003    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396015    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396020    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 17:25:04.401233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396025    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396050    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396057    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396062    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396067    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396072    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396080    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396087    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396091    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396096    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396101    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396106    2564 flags.go:64] FLAG: --enable-server="true"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396110    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396117    2564 flags.go:64] FLAG: --event-burst="100"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396123    2564 flags.go:64] FLAG: --event-qps="50"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396127    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396132    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396137    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396143    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396148    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396153    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396158    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396163    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396167    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396174    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 17:25:04.401821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396194    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396200    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396204    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396209    2564 flags.go:64] FLAG: --feature-gates=""
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396215    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396220    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396225    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396229    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396234    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396239    2564 flags.go:64] FLAG: --help="false"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396243    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396249    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396253    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396260    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396265    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396271    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396275    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396280    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396284    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396289    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396293    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396298    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396303    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396309    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 17:25:04.402505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396313    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396319    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396323    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396328    2564 flags.go:64] FLAG: --lock-file=""
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396333    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396337    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396342    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396352    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396357    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396362    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396367    2564 flags.go:64] FLAG: --logging-format="text"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396373    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396379    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396383    2564 flags.go:64] FLAG: --manifest-url=""
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396388    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396395    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396400    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396406    2564 flags.go:64] FLAG: --max-pods="110"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396411    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396416    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396420    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396426    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396431    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396436    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396441    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 17:25:04.403092 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396453    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396457    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396462    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396467    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396471    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396481    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396485    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396490    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396495    2564 flags.go:64] FLAG: --port="10250"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396499    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396504    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0256a5707aad2b9e3"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396509    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396514    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396519    2564 flags.go:64] FLAG: --register-node="true"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396523    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396529    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396535    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396540    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396546    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396552    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396557    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396563    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396567    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396572    2564 flags.go:64] FLAG: --runonce="false"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396576    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 17:25:04.403724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396581    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396586    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396590    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396595    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396601    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396606    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396611    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396616    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396620    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396625    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396629    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396634    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396639    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396643    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396652    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396657    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396661    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396668    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396672    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396677    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396681    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396686    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396691    2564 flags.go:64] FLAG: --v="2"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396697    2564 flags.go:64] FLAG: --version="false"
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396705    2564 flags.go:64] FLAG: --vmodule=""
Jul 27 17:25:04.404432 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396713    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.396718    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396936    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396944    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396949    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396954    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396958    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396963    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396967    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396971    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396976    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396981    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396986    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396990    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396994    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.396998    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397002    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397007    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397011    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397015    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397019    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.405042 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397023    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397028    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397032    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397036    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397042    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397048    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397053    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397058    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397062    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397067    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397071    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397077    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397081    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397086    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397089    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397093    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397097    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397101    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397105    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.405600 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397109    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397113    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397117    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397126    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397131    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397136    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397140    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397145    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397149    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397153    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397158    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397162    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397167    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397171    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397175    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397195    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397199    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397203    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397207    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.406065 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397212    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397216    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397222    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397228    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397233    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397239    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397244    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397249    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397253    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397257    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397262    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397266    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397270    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397274    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397278    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397283    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397289    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397293    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397297    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.406558 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397301    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397305    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397310    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397314    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397318    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397322    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397326    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397331    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397335    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397339    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397344    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397348    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397352    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397356    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397360    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397364    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397369    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397373    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397379    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397383    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.407019 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397388    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397393    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.397397    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.398010    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.405470    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.405485    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.405506    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.405512    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405571    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405576    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405579    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405582    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405585    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405588    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405591    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.407522 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405593    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405596    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405598    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405601    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405604    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405607    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405610    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405612    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405615    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405618    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405621    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405623    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405626    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405629    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405631    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405634    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405636    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405638    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405641    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405643    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.407896 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405646    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405648    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405653    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405656    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405658    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405661    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405663    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405666    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405669    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405671    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405674    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405676    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405679    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405681    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405684    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405686    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405689    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405691    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405693    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405696    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.408494 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405699    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405701    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405704    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405706    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405709    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405712    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405714    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405716    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405719    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405721    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405724    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405726    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405730    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405734    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405738    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405741    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405744    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405746    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405749    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.408974 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405752    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405754    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405757    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405759    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405762    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405765    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405769    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405772    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405775    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405778    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405780    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405783    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405785    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405788    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405790    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405793    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405795    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405798    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405800    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.409452 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405802    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405805    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405808    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405810    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405812    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405815    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405817    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405820    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405823    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405826    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405829    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405831    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405835    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405839    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.405844    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:04.409901 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405979    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405986    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405989    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405992    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405996    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.405999    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406002    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406005    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406008    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406010    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406013    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406016    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406018    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406021    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406024    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406026    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406029    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406031    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406034    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406036    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:04.410435 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406039    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406041    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406044    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406046    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406049    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406052    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406055    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406059    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406063    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406066    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406069    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406072    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406075    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406077    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406080    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406083    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406085    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406087    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406090    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406092    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:04.410918 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406095    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406097    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406101    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406105    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406108    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406110    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406113    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406116    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406119    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406121    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406124    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406127    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406129    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406131    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406134    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406136    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406139    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406142    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406144    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:04.411431 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406147    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406150    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406153    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406155    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406158    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406160    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406163    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406165    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406168    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406170    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406173    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406175    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406191    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406193    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406196    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406198    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406201    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406203    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406206    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:04.411882 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406208    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406212    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406215    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406218    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406221    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406223    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406226    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406229    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406232    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406235    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406238    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406241    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406246    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406249    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406251    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406254    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406265    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406268    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406270    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:04.412392 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406273    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:04.406275    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.406280    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.406419    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.408474    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.409919    2564 server.go:1019] "Starting client certificate rotation"
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.410028    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.410064    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:25:04.412850 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.412219    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:25:04.413732 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.413673    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:25:04.427704 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.427681    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 27 17:25:04.431509 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.431491    2564 log.go:25] "Validated CRI v1 image API"
Jul 27 17:25:04.432268 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.432246    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 17:25:04.434532 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.434513    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87622943-da0b-4317-ab51-5e96b94e2593:/dev/nvme0n1p3 f6ebcc58-d7c4-4a67-901c-016672e4026a:/dev/nvme0n1p4]
Jul 27 17:25:04.434592 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.434531    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 17:25:04.439307 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.439288    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:25:04.439833 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.439723    2564 manager.go:216] Machine: {Timestamp:2026-07-27 17:25:04.438576856 +0000 UTC m=+0.315778051 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100744 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ed175ca2acb7f56cf55c34c124b4 SystemUUID:ec28ed17-5ca2-acb7-f56c-f55c34c124b4 BootID:f2aaff2e-4164-466e-8404-74d8bd25f62e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:f1:f9:fd:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:f1:f9:fd:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:20:0e:2b:4b:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 17:25:04.439833 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.439827    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 17:25:04.439944 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.439904    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 17:25:04.443014 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.442982    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 17:25:04.443149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.443018    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 17:25:04.443754 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.443743    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 17:25:04.443784 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.443756    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 17:25:04.443784 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.443764    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:25:04.444397 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.444387    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:25:04.445152 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.445143    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 17:25:04.446720 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446709    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:25:04.446840 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446831    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 17:25:04.446872 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446858    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 17:25:04.446872 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446868    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 17:25:04.446926 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446882    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 17:25:04.446926 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446891    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 27 17:25:04.446926 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.446900    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 17:25:04.447242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.447230    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:25:04.447279 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.447251    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:25:04.449348 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.449330    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 17:25:04.451066 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.451053    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 17:25:04.451111 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.451083    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 17:25:04.452382 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452371    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452387    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452393    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452399    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452408    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452413    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 17:25:04.452420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452422    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 17:25:04.452585 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452427    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 17:25:04.452585 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452433    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 17:25:04.452585 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452445    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 17:25:04.452585 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452457    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 17:25:04.452585 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.452462    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 17:25:04.453169 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.453159    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 17:25:04.453212 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.453169    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 17:25:04.455878 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.455852    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 17:25:04.456014 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.456000    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 17:25:04.456081 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.456011    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 17:25:04.456647 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.456636    2564 server.go:1268] "Started kubelet"
Jul 27 17:25:04.456718 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.456691    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 17:25:04.456884 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.456712    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 17:25:04.456938 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.456911    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 17:25:04.457493 ip-10-0-143-96 systemd[1]: Started Kubernetes Kubelet.
Jul 27 17:25:04.458379 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.458366    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 17:25:04.459434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.459420    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 17:25:04.461356 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.461334    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ksxpp"
Jul 27 17:25:04.461513 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.461487    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 17:25:04.462206 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.461229    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-96.ec2.internal.18c6357af1b79ced  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-96.ec2.internal,UID:ip-10-0-143-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-96.ec2.internal,},FirstTimestamp:2026-07-27 17:25:04.456604909 +0000 UTC m=+0.333806103,LastTimestamp:2026-07-27 17:25:04.456604909 +0000 UTC m=+0.333806103,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-96.ec2.internal,}"
Jul 27 17:25:04.464922 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.464903    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 17:25:04.464922 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.464911    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 17:25:04.465077 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.465003    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.466274 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.466255    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 17:25:04.466274 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.466275    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 17:25:04.466406 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.466288    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 17:25:04.466444 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.466433    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 17:25:04.466444 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.466441    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 17:25:04.467230 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467213    2564 factory.go:55] Registering systemd factory
Jul 27 17:25:04.467368 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467356    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 27 17:25:04.467668 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467645    2564 factory.go:153] Registering CRI-O factory
Jul 27 17:25:04.467753 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467672    2564 factory.go:223] Registration of the crio container factory successfully
Jul 27 17:25:04.467753 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467742    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 17:25:04.467865 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467774    2564 factory.go:103] Registering Raw factory
Jul 27 17:25:04.467865 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.467789    2564 manager.go:1196] Started watching for new ooms in manager
Jul 27 17:25:04.468483 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.468458    2564 manager.go:349] Starting recovery of all containers
Jul 27 17:25:04.469321 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.469296    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ksxpp"
Jul 27 17:25:04.476925 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.476896    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:04.479377 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.479355    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-96.ec2.internal\" not found" node="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.480202 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.480175    2564 manager.go:354] Recovery completed
Jul 27 17:25:04.483997 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.483984    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.485688 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.485673    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.485738 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.485700    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.485738 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.485709    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.486210 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486193    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 17:25:04.486210 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486209    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 17:25:04.486336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486220    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.486336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486244    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:25:04.486928 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486900    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.487004 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486930    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.487004 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.486946    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.488059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.488045    2564 policy_none.go:49] "None policy: Start"
Jul 27 17:25:04.488117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.488062    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 17:25:04.488117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.488072    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 17:25:04.489059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.489049    2564 policy_none.go:47] "Start"
Jul 27 17:25:04.527836 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.527691    2564 manager.go:337] "Starting Device Plugin manager"
Jul 27 17:25:04.527917 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.527873    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 17:25:04.527917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.527887    2564 server.go:87] "Starting device plugin registration server"
Jul 27 17:25:04.528084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.528073    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 17:25:04.528154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.528131    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 17:25:04.528246 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.528228    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 17:25:04.528365 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.528354    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 17:25:04.528418 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.528368    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 17:25:04.528910 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.528893    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 17:25:04.528974 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.528950    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.628428 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.628385    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.629503 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.629405    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.629503 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.629432    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.629503 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.629442    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.629503 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.629468    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.634817 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.634800    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.634867 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.634824    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-96.ec2.internal\": node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.648609 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.648563    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.660425 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.660395    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 17:25:04.661681 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.661666    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 17:25:04.661760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.661701    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 17:25:04.661760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.661721    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 17:25:04.661860 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.661761    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 17:25:04.664332 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.664311    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:04.748973 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.748931    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.762111 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.762087    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"]
Jul 27 17:25:04.762165 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.762150    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.763120 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.763106    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.763228 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.763135    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.763228 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.763145    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.764394 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.764380    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.764568 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.764553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.764632 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.764606    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.765243 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765228    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.765319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765255    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.765319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765286    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.765319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765302    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.765319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765259    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.765438 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.765344    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.766650 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.766631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.766735 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.766658    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.767656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767636    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.767736 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767670    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.767736 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767684    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.767851 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f14f156ce10e05bbdf20bfb209f82c0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"7f14f156ce10e05bbdf20bfb209f82c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.767887 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.767887 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.767874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.781747 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.781728    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-96.ec2.internal\" not found" node="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.786940 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.786923    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-96.ec2.internal\" not found" node="ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.849907 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.849885    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:04.869005 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.868987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.869071 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.869015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f14f156ce10e05bbdf20bfb209f82c0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"7f14f156ce10e05bbdf20bfb209f82c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.869071 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.869032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.869145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.869074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.869145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.869099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f14f156ce10e05bbdf20bfb209f82c0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"7f14f156ce10e05bbdf20bfb209f82c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.869145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:04.869104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23275bb73041f25395a19eaa32e3d155-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"23275bb73041f25395a19eaa32e3d155\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:04.950303 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:04.950225    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:05.056886 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.056838    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:05.084312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.084286    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:05.090549 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.090531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:05.158124 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.158087    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:05.258629 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.258542    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found"
Jul 27 17:25:05.282887 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.282859    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:05.365110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.365090    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:05.376334 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.376311    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:25:05.378108 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.378095    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal"
Jul 27 17:25:05.388433 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.388410    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:25:05.410147 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.410124    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 17:25:05.410272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.410254    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:25:05.410339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.410280    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:25:05.410339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.410291    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:25:05.449295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.449271    2564 apiserver.go:52] "Watching apiserver"
Jul 27 17:25:05.465875 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.465856    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 17:25:05.472471 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.472453    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 17:25:05.473446 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.473423    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 17:20:05 +0000 UTC" deadline="2028-04-17 14:44:15.517528882 +0000 UTC"
Jul 27 17:25:05.473508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.473447    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15117h19m10.044085663s"
Jul 27 17:25:05.474210 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.474190    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5rbbv","kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bgwv9","openshift-dns/node-resolver-q6vkg","openshift-image-registry/node-ca-gvhk5","openshift-multus/multus-fhz5q","openshift-multus/network-metrics-daemon-qpxwg","openshift-network-diagnostics/network-check-target-6fzx8","kube-system/konnectivity-agent-29b9z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-kvwfc","openshift-network-operator/iptables-alerter-vh7kr","openshift-ovn-kubernetes/ovnkube-node-wm9d9"]
Jul 27 17:25:05.475992 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.475974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.476084 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.476054    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:05.477406 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.477389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.477743 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.477720    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:25:05.478980 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.478960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.480141 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.480122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcrzv\""
Jul 27 17:25:05.480233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.480127    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.480356 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.480341    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.480606 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.480587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 17:25:05.480734 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.480650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.481811 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.481791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.481917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.481816    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-695n9\""
Jul 27 17:25:05.481917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.481855    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.482336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.482322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.483462 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.483444    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.483551 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.483471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fs5dv\""
Jul 27 17:25:05.483551 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.483538    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.484170 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.484154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.484950 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.484936    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 17:25:05.485114 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.485098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.485319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.485305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrwf2\""
Jul 27 17:25:05.485385 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.485341    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.486769 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.486752    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6jhmf\""
Jul 27 17:25:05.486824 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.486790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.486890 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.486864    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 17:25:05.487137 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.487118    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.487247 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.487164    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.487247 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.487218    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 17:25:05.488829 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.488815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.488898 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.488863    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:05.489502 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.489486    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 17:25:05.489603 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.489580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 17:25:05.489684 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.489667    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9hw\""
Jul 27 17:25:05.490923 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.490903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.493846 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.493824    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 17:25:05.494768 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.494110    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.495361 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.495469 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495433    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 17:25:05.495764 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495748    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 17:25:05.495824 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495804    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.495880 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495824    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 17:25:05.495880 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.495846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4fgj\""
Jul 27 17:25:05.497706 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.497690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:05.497798 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.497767    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:05.497910 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.497892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 17:25:05.497971 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.497917    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2rvkz\""
Jul 27 17:25:05.498124 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.498109    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.498281 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.498239    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.500047 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.500031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.503149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.503135    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 17:25:05.503353 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.503340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxttk\""
Jul 27 17:25:05.503576 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.503564    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 17:25:05.505716 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.505696    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gwbr4"
Jul 27 17:25:05.514314 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.514288    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gwbr4"
Jul 27 17:25:05.568275 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.568242    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 17:25:05.572161 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysconfig\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.572270 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-var-lib-kubelet\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.572270 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-tuned\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.572270 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-conf-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.572408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95d9h\" (UniqueName: \"kubernetes.io/projected/8c8d5e98-89f9-48c7-82ba-5890a826d740-kube-api-access-95d9h\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.572408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-konnectivity-ca\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.572408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-netd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.572408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-multus\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-system-cni-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-multus-certs\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-cnibin\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.572575 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngjpb\" (UniqueName: \"kubernetes.io/projected/c19de51b-a214-4368-80f8-73fa2212b9c2-kube-api-access-ngjpb\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-systemd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-registration-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-device-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-var-lib-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-etc-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-bin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.572787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-sys-fs\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-host\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-cni-binary-copy\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmh9k\" (UniqueName: \"kubernetes.io/projected/53991793-28a1-4a6e-bca6-1681274b65f9-kube-api-access-tmh9k\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-conf\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-sys\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-host\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c95930a-e283-48c8-a484-bb99194ab7ee-hosts-file\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.572996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-kubelet-config\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-node-log\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.573051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-log-socket\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-bin\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-tmp\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6sf\" (UniqueName: \"kubernetes.io/projected/1c95930a-e283-48c8-a484-bb99194ab7ee-kube-api-access-rk6sf\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-run\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gf4x\" (UniqueName: \"kubernetes.io/projected/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-kube-api-access-2gf4x\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-netns\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-system-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-socket-dir-parent\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-config\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.573495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-env-overrides\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-serviceca\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-os-release\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-os-release\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-agent-certs\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-ovn\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-script-lib\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53991793-28a1-4a6e-bca6-1681274b65f9-iptables-alerter-script\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-lib-modules\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-slash\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.573936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-systemd\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvg4v\" (UniqueName: \"kubernetes.io/projected/8fd50371-320e-451a-ad62-66bfac5dded0-kube-api-access-gvg4v\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-systemd-units\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-netns\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-kubelet\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-multus-daemon-config\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-kubernetes\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-k8s-cni-cncf-io\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjpmh\" (UniqueName: \"kubernetes.io/projected/3b471003-8eed-4687-bd0b-52b63e72cf87-kube-api-access-jjpmh\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-hostroot\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-etc-kubernetes\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-socket-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-etc-selinux\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjrd\" (UniqueName: \"kubernetes.io/projected/d533d30d-f82a-4764-819a-3561612d3494-kube-api-access-zfjrd\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-modprobe-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.574781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-cnibin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c95930a-e283-48c8-a484-bb99194ab7ee-tmp-dir\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-dbus\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-kubelet\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53991793-28a1-4a6e-bca6-1681274b65f9-host-slash\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.575343 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.574809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbwwf\" (UniqueName: \"kubernetes.io/projected/4c494a60-97f6-4b60-9680-8a26f1de4c4e-kube-api-access-zbwwf\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675165 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-slash\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675165 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-slash\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-systemd\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvg4v\" (UniqueName: \"kubernetes.io/projected/8fd50371-320e-451a-ad62-66bfac5dded0-kube-api-access-gvg4v\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-systemd-units\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-netns\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-netns\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-systemd-units\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-kubelet\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-multus-daemon-config\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-systemd\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-kubernetes\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.675490 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-kubelet\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-k8s-cni-cncf-io\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjpmh\" (UniqueName: \"kubernetes.io/projected/3b471003-8eed-4687-bd0b-52b63e72cf87-kube-api-access-jjpmh\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-hostroot\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-kubernetes\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-etc-kubernetes\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-k8s-cni-cncf-io\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-socket-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-etc-selinux\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-hostroot\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-etc-kubernetes\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjrd\" (UniqueName: \"kubernetes.io/projected/d533d30d-f82a-4764-819a-3561612d3494-kube-api-access-zfjrd\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-modprobe-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-cnibin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-socket-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.676442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-etc-selinux\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-modprobe-d\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-cnibin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c95930a-e283-48c8-a484-bb99194ab7ee-tmp-dir\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-dbus\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-kubelet\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-dbus\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.675999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53991793-28a1-4a6e-bca6-1681274b65f9-host-slash\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-kubelet\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbwwf\" (UniqueName: \"kubernetes.io/projected/4c494a60-97f6-4b60-9680-8a26f1de4c4e-kube-api-access-zbwwf\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysconfig\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-var-lib-kubelet\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysconfig\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.677280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-tuned\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-multus-daemon-config\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-conf-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c95930a-e283-48c8-a484-bb99194ab7ee-tmp-dir\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53991793-28a1-4a6e-bca6-1681274b65f9-host-slash\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95d9h\" (UniqueName: \"kubernetes.io/projected/8c8d5e98-89f9-48c7-82ba-5890a826d740-kube-api-access-95d9h\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-conf-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-konnectivity-ca\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-netd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-var-lib-kubelet\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-multus\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-system-cni-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676404    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-multus\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-netd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-multus-certs\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.678198 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-system-cni-dir\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-multus-certs\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-cnibin\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-cnibin\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngjpb\" (UniqueName: \"kubernetes.io/projected/c19de51b-a214-4368-80f8-73fa2212b9c2-kube-api-access-ngjpb\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-systemd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-registration-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-device-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-var-lib-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-systemd\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-etc-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-registration-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-device-dir\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-bin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.679226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-var-lib-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-sys-fs\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-konnectivity-ca\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-etc-openvswitch\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-host\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-cni-binary-copy\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d533d30d-f82a-4764-819a-3561612d3494-sys-fs\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-var-lib-cni-bin\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-host\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmh9k\" (UniqueName: \"kubernetes.io/projected/53991793-28a1-4a6e-bca6-1681274b65f9-kube-api-access-tmh9k\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-conf\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-sys\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-host\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.676994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c95930a-e283-48c8-a484-bb99194ab7ee-hosts-file\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-kubelet-config\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-host\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-node-log\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-log-socket\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c95930a-e283-48c8-a484-bb99194ab7ee-hosts-file\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-bin\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-sys\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-sysctl-conf\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-tmp\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d346835-866e-4fc5-969b-fb7c5d537ca2-kubelet-config\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-log-socket\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-host-cni-bin\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6sf\" (UniqueName: \"kubernetes.io/projected/1c95930a-e283-48c8-a484-bb99194ab7ee-kube-api-access-rk6sf\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-node-log\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-run\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gf4x\" (UniqueName: \"kubernetes.io/projected/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-kube-api-access-2gf4x\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-netns\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-run\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-system-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-system-cni-dir\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.680941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-host-run-netns\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-socket-dir-parent\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-config\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fd50371-320e-451a-ad62-66bfac5dded0-cni-binary-copy\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-multus-socket-dir-parent\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-env-overrides\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-serviceca\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-os-release\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-os-release\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-agent-certs\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-ovn\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-script-lib\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53991793-28a1-4a6e-bca6-1681274b65f9-iptables-alerter-script\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-lib-modules\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.677912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.678029    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:05.681507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-config\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c494a60-97f6-4b60-9680-8a26f1de4c4e-run-ovn\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.678104    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.17808267 +0000 UTC m=+2.055283867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fd50371-320e-451a-ad62-66bfac5dded0-os-release\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-serviceca\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b471003-8eed-4687-bd0b-52b63e72cf87-lib-modules\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c19de51b-a214-4368-80f8-73fa2212b9c2-os-release\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.678344    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.678405    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.178388654 +0000 UTC m=+2.055589856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovnkube-script-lib\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c494a60-97f6-4b60-9680-8a26f1de4c4e-env-overrides\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.678804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c19de51b-a214-4368-80f8-73fa2212b9c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.679135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53991793-28a1-4a6e-bca6-1681274b65f9-iptables-alerter-script\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.679985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-etc-tuned\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.680038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b471003-8eed-4687-bd0b-52b63e72cf87-tmp\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.680237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c494a60-97f6-4b60-9680-8a26f1de4c4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.682048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.680945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87c92ea7-6d7a-455f-8672-6bd7eb96fb09-agent-certs\") pod \"konnectivity-agent-29b9z\" (UID: \"87c92ea7-6d7a-455f-8672-6bd7eb96fb09\") " pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.684953 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.684929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjpmh\" (UniqueName: \"kubernetes.io/projected/3b471003-8eed-4687-bd0b-52b63e72cf87-kube-api-access-jjpmh\") pod \"tuned-bgwv9\" (UID: \"3b471003-8eed-4687-bd0b-52b63e72cf87\") " pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.685319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.685287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjrd\" (UniqueName: \"kubernetes.io/projected/d533d30d-f82a-4764-819a-3561612d3494-kube-api-access-zfjrd\") pod \"aws-ebs-csi-driver-node-h49hg\" (UID: \"d533d30d-f82a-4764-819a-3561612d3494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.685319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.685311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvg4v\" (UniqueName: \"kubernetes.io/projected/8fd50371-320e-451a-ad62-66bfac5dded0-kube-api-access-gvg4v\") pod \"multus-fhz5q\" (UID: \"8fd50371-320e-451a-ad62-66bfac5dded0\") " pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.685554 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.685530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbwwf\" (UniqueName: \"kubernetes.io/projected/4c494a60-97f6-4b60-9680-8a26f1de4c4e-kube-api-access-zbwwf\") pod \"ovnkube-node-wm9d9\" (UID: \"4c494a60-97f6-4b60-9680-8a26f1de4c4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.686154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.686133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngjpb\" (UniqueName: \"kubernetes.io/projected/c19de51b-a214-4368-80f8-73fa2212b9c2-kube-api-access-ngjpb\") pod \"multus-additional-cni-plugins-kvwfc\" (UID: \"c19de51b-a214-4368-80f8-73fa2212b9c2\") " pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.686154 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.686147    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:05.686323 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.686165    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:05.686323 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.686184    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:05.686323 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:05.686239    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.186226347 +0000 UTC m=+2.063427559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:05.687135 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.687117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95d9h\" (UniqueName: \"kubernetes.io/projected/8c8d5e98-89f9-48c7-82ba-5890a826d740-kube-api-access-95d9h\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:05.692086 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.692060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmh9k\" (UniqueName: \"kubernetes.io/projected/53991793-28a1-4a6e-bca6-1681274b65f9-kube-api-access-tmh9k\") pod \"iptables-alerter-vh7kr\" (UID: \"53991793-28a1-4a6e-bca6-1681274b65f9\") " pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.692167 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.692118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6sf\" (UniqueName: \"kubernetes.io/projected/1c95930a-e283-48c8-a484-bb99194ab7ee-kube-api-access-rk6sf\") pod \"node-resolver-q6vkg\" (UID: \"1c95930a-e283-48c8-a484-bb99194ab7ee\") " pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.692167 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.692143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gf4x\" (UniqueName: \"kubernetes.io/projected/9ad12cf3-c6ee-470d-8bbb-d43be8259ee6-kube-api-access-2gf4x\") pod \"node-ca-gvhk5\" (UID: \"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6\") " pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.730538 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.730498    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f14f156ce10e05bbdf20bfb209f82c0.slice/crio-4d59b2d3a7d68b535024655d328995ffebb77a700f434848afa191148e5ef430 WatchSource:0}: Error finding container 4d59b2d3a7d68b535024655d328995ffebb77a700f434848afa191148e5ef430: Status 404 returned error can't find the container with id 4d59b2d3a7d68b535024655d328995ffebb77a700f434848afa191148e5ef430
Jul 27 17:25:05.734804 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.734789    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:25:05.811041 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.810973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vh7kr"
Jul 27 17:25:05.814301 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.814281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgwv9"
Jul 27 17:25:05.822433 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.822411    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53991793_28a1_4a6e_bca6_1681274b65f9.slice/crio-fdf7bd984d4ac598d0a9e7936551490b65bc3016b39028f450ddcfb2de528e67 WatchSource:0}: Error finding container fdf7bd984d4ac598d0a9e7936551490b65bc3016b39028f450ddcfb2de528e67: Status 404 returned error can't find the container with id fdf7bd984d4ac598d0a9e7936551490b65bc3016b39028f450ddcfb2de528e67
Jul 27 17:25:05.824311 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.824290    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b471003_8eed_4687_bd0b_52b63e72cf87.slice/crio-98aba26ee579529e45be77283e6c1250c73aef5e12e6ece94ec538a86e363772 WatchSource:0}: Error finding container 98aba26ee579529e45be77283e6c1250c73aef5e12e6ece94ec538a86e363772: Status 404 returned error can't find the container with id 98aba26ee579529e45be77283e6c1250c73aef5e12e6ece94ec538a86e363772
Jul 27 17:25:05.830530 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.830511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6vkg"
Jul 27 17:25:05.839759 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.839738    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c95930a_e283_48c8_a484_bb99194ab7ee.slice/crio-d60ef1ae96d8cc1a0c3850c9ab3a3484b9bca32afdbe2e2409adf39de3613498 WatchSource:0}: Error finding container d60ef1ae96d8cc1a0c3850c9ab3a3484b9bca32afdbe2e2409adf39de3613498: Status 404 returned error can't find the container with id d60ef1ae96d8cc1a0c3850c9ab3a3484b9bca32afdbe2e2409adf39de3613498
Jul 27 17:25:05.847733 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.847716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gvhk5"
Jul 27 17:25:05.855640 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.855621    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad12cf3_c6ee_470d_8bbb_d43be8259ee6.slice/crio-69016f342c82323576a21809c43e058a9d779e2c3f9d2c4713faef2e2ba952b7 WatchSource:0}: Error finding container 69016f342c82323576a21809c43e058a9d779e2c3f9d2c4713faef2e2ba952b7: Status 404 returned error can't find the container with id 69016f342c82323576a21809c43e058a9d779e2c3f9d2c4713faef2e2ba952b7
Jul 27 17:25:05.862559 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.862537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhz5q"
Jul 27 17:25:05.870108 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.870089    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd50371_320e_451a_ad62_66bfac5dded0.slice/crio-f790ad95fa8d89ff8cfc5b842d398d4710e68382c542d38b42155b79d341a8a3 WatchSource:0}: Error finding container f790ad95fa8d89ff8cfc5b842d398d4710e68382c542d38b42155b79d341a8a3: Status 404 returned error can't find the container with id f790ad95fa8d89ff8cfc5b842d398d4710e68382c542d38b42155b79d341a8a3
Jul 27 17:25:05.871182 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.871166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:05.880465 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.880447    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c92ea7_6d7a_455f_8672_6bd7eb96fb09.slice/crio-577ad0cf6cf781910272b7bc86d5e08b79a97ff7be3d0318b91393473eacf741 WatchSource:0}: Error finding container 577ad0cf6cf781910272b7bc86d5e08b79a97ff7be3d0318b91393473eacf741: Status 404 returned error can't find the container with id 577ad0cf6cf781910272b7bc86d5e08b79a97ff7be3d0318b91393473eacf741
Jul 27 17:25:05.883400 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.883381    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:05.891100 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.891077    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c494a60_97f6_4b60_9680_8a26f1de4c4e.slice/crio-d31f7301144b50b6da01c16311ba1a9fd22eb415f555a0727180476f3783faa7 WatchSource:0}: Error finding container d31f7301144b50b6da01c16311ba1a9fd22eb415f555a0727180476f3783faa7: Status 404 returned error can't find the container with id d31f7301144b50b6da01c16311ba1a9fd22eb415f555a0727180476f3783faa7
Jul 27 17:25:05.904238 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.904211    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg"
Jul 27 17:25:05.911591 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.911569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvwfc"
Jul 27 17:25:05.912137 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.912119    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd533d30d_f82a_4764_819a_3561612d3494.slice/crio-8b49f00390273d59b39b4aeefa79f0ada04cd52004b6eb1211921c6fb5419068 WatchSource:0}: Error finding container 8b49f00390273d59b39b4aeefa79f0ada04cd52004b6eb1211921c6fb5419068: Status 404 returned error can't find the container with id 8b49f00390273d59b39b4aeefa79f0ada04cd52004b6eb1211921c6fb5419068
Jul 27 17:25:05.920597 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:05.920567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19de51b_a214_4368_80f8_73fa2212b9c2.slice/crio-1ff04c50cd00549fa9d2083789a89f07683ad50084bee6598245fe30e80a80a3 WatchSource:0}: Error finding container 1ff04c50cd00549fa9d2083789a89f07683ad50084bee6598245fe30e80a80a3: Status 404 returned error can't find the container with id 1ff04c50cd00549fa9d2083789a89f07683ad50084bee6598245fe30e80a80a3
Jul 27 17:25:05.993405 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:05.993375    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:06.182676 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.182574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:06.182676 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.182615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:06.182892 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.182739    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.182892 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.182800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.182780032 +0000 UTC m=+3.059981216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.182892 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.182739    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.182892 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.182865    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.182852929 +0000 UTC m=+3.060054120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.283040 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.283004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:06.283222 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.283143    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:06.283222 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.283158    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:06.283222 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.283168    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.283358 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.283233    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.283202016 +0000 UTC m=+3.160403202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.517756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.517638    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:20:06 +0000 UTC" deadline="2028-05-07 09:54:52.410359514 +0000 UTC"
Jul 27 17:25:06.517756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.517702    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15592h29m45.892661984s"
Jul 27 17:25:06.662500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.662469    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:06.662792 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.662774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:06.662930 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:06.662904    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:06.670244 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.670187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg" event={"ID":"d533d30d-f82a-4764-819a-3561612d3494","Type":"ContainerStarted","Data":"8b49f00390273d59b39b4aeefa79f0ada04cd52004b6eb1211921c6fb5419068"}
Jul 27 17:25:06.677656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.676569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"d31f7301144b50b6da01c16311ba1a9fd22eb415f555a0727180476f3783faa7"}
Jul 27 17:25:06.679248 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.679217    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29b9z" event={"ID":"87c92ea7-6d7a-455f-8672-6bd7eb96fb09","Type":"ContainerStarted","Data":"577ad0cf6cf781910272b7bc86d5e08b79a97ff7be3d0318b91393473eacf741"}
Jul 27 17:25:06.681627 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.681601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgwv9" event={"ID":"3b471003-8eed-4687-bd0b-52b63e72cf87","Type":"ContainerStarted","Data":"98aba26ee579529e45be77283e6c1250c73aef5e12e6ece94ec538a86e363772"}
Jul 27 17:25:06.684508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.684480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vh7kr" event={"ID":"53991793-28a1-4a6e-bca6-1681274b65f9","Type":"ContainerStarted","Data":"fdf7bd984d4ac598d0a9e7936551490b65bc3016b39028f450ddcfb2de528e67"}
Jul 27 17:25:06.686801 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.686776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerStarted","Data":"1ff04c50cd00549fa9d2083789a89f07683ad50084bee6598245fe30e80a80a3"}
Jul 27 17:25:06.692868 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.692838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhz5q" event={"ID":"8fd50371-320e-451a-ad62-66bfac5dded0","Type":"ContainerStarted","Data":"f790ad95fa8d89ff8cfc5b842d398d4710e68382c542d38b42155b79d341a8a3"}
Jul 27 17:25:06.696199 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.696172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gvhk5" event={"ID":"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6","Type":"ContainerStarted","Data":"69016f342c82323576a21809c43e058a9d779e2c3f9d2c4713faef2e2ba952b7"}
Jul 27 17:25:06.699331 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.699305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6vkg" event={"ID":"1c95930a-e283-48c8-a484-bb99194ab7ee","Type":"ContainerStarted","Data":"d60ef1ae96d8cc1a0c3850c9ab3a3484b9bca32afdbe2e2409adf39de3613498"}
Jul 27 17:25:06.703176 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.703119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" event={"ID":"7f14f156ce10e05bbdf20bfb209f82c0","Type":"ContainerStarted","Data":"4d59b2d3a7d68b535024655d328995ffebb77a700f434848afa191148e5ef430"}
Jul 27 17:25:06.876447 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:06.876364    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.189599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.189686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.189902    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.189973    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.189951165 +0000 UTC m=+5.067152358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.190399    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:07.190545 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.190450    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.190434222 +0000 UTC m=+5.067635420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:07.291321 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.290584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:07.291321 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.290783    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:07.291321 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.290812    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:07.291321 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.290826    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:07.291321 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.290890    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.290868497 +0000 UTC m=+5.168069694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:07.518434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.518357    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:20:06 +0000 UTC" deadline="2028-03-23 23:52:00.497078327 +0000 UTC"
Jul 27 17:25:07.518434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.518394    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14526h26m52.978688704s"
Jul 27 17:25:07.530350 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:07.530314    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23275bb73041f25395a19eaa32e3d155.slice/crio-f73675984c2f89c87c45d8448cb4d2d1e0d9314ccdc6ae3068f6277d35225724 WatchSource:0}: Error finding container f73675984c2f89c87c45d8448cb4d2d1e0d9314ccdc6ae3068f6277d35225724: Status 404 returned error can't find the container with id f73675984c2f89c87c45d8448cb4d2d1e0d9314ccdc6ae3068f6277d35225724
Jul 27 17:25:07.663171 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.662448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:07.663171 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.662584    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:07.663171 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.663016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:07.663171 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:07.663125    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:07.693735 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.693532    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:07.716390 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:07.716354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"23275bb73041f25395a19eaa32e3d155","Type":"ContainerStarted","Data":"f73675984c2f89c87c45d8448cb4d2d1e0d9314ccdc6ae3068f6277d35225724"}
Jul 27 17:25:08.665160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:08.665125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:08.665711 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:08.665288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:09.207731 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:09.207648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:09.207731 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:09.207702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:09.207978 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.207880    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:09.207978 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.207946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.207926288 +0000 UTC m=+9.085127477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:09.208371 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.208353    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:09.208463 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.208408    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.208391551 +0000 UTC m=+9.085592759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:09.308891 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:09.308857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:09.309073 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.309060    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:09.309138 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.309084    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:09.309138 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.309097    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:09.309246 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.309153    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.309133948 +0000 UTC m=+9.186335150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:09.662999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:09.662437    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:09.662999 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.662579    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:09.662999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:09.662648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:09.662999 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:09.662800    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:10.662806 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:10.662769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:10.663340 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:10.662929    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:11.662764 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:11.662687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:11.662930 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:11.662833    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:11.662930 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:11.662897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:11.663424 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:11.663036    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:12.663289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:12.662832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:12.663289 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:12.662978    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:13.242523 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:13.242467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:13.242523 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:13.242530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:13.242767 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.242706    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:13.242833 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.242771    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.242751714 +0000 UTC m=+17.119952910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:13.243093 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.242998    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:13.243093 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.243069    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.24304971 +0000 UTC m=+17.120250898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:13.343712 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:13.343321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:13.343712 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.343578    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:13.343712 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.343599    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:13.343712 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.343612    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:13.344109 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.343790    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.3436805 +0000 UTC m=+17.220881704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:13.662964 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:13.662015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:13.662964 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.662174    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:13.662964 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:13.662661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:13.662964 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:13.662862    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:14.663571 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:14.663485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:14.664055 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:14.663617    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:15.662631 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:15.662594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:15.662828 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:15.662755    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:15.663113 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:15.663025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:15.663218 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:15.663140    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:16.662225 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:16.662195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:16.662664 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:16.662310    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:17.662571 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:17.662530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:17.662963 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:17.662648    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:17.662963 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:17.662669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:17.662963 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:17.662806    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:18.662951 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:18.662923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:18.663357 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:18.663031    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:19.661961 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:19.661915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:19.661961 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:19.661962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:19.662172 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:19.662075    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:19.662280 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:19.662220    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:20.664519 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:20.664488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:20.664926 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:20.664604    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:21.308067 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:21.307834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:21.308241 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:21.308088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:21.308241 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.307992    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:21.308241 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.308207    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.308174349 +0000 UTC m=+33.185375533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:21.308405 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.308285    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:21.308405 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.308343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.308326856 +0000 UTC m=+33.185528041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:21.409111 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:21.409076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:21.409294 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.409229    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:21.409294 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.409246    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:21.409294 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.409259    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:21.409421 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.409312    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.409298941 +0000 UTC m=+33.286500125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:21.662772 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:21.662687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:21.662934 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:21.662687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:21.662934 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.662808    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:21.662934 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:21.662872    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:22.662664 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:22.662632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:22.663254 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:22.662770    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:23.662932 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:23.662900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:23.663390 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:23.663025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:23.663390 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:23.663077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:23.663390 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:23.663203    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:24.662807 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:24.662769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:24.662985 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:24.662870    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:25.662448 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:25.662419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:25.662615 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:25.662418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:25.662615 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:25.662530    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:25.662615 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:25.662587    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:26.662684 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.662534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:26.663258 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:26.662765    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:26.751956 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.751928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6vkg" event={"ID":"1c95930a-e283-48c8-a484-bb99194ab7ee","Type":"ContainerStarted","Data":"0f55ba38dd7cbb31eeaea9325cdbc9604c628302503665963acf1253b6ef1060"}
Jul 27 17:25:26.753481 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.753449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" event={"ID":"7f14f156ce10e05bbdf20bfb209f82c0","Type":"ContainerStarted","Data":"a99d58ebfd9287c004c09054258069eb0bb025e42bcda55dfd6fca3b9b74047f"}
Jul 27 17:25:26.754799 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.754780    2564 generic.go:356] "Generic (PLEG): container finished" podID="23275bb73041f25395a19eaa32e3d155" containerID="e9da1a2c021f6d33cabec5e7289ce30bf0ed4365ecd783182423c0476ff29433" exitCode=0
Jul 27 17:25:26.754861 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.754846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"23275bb73041f25395a19eaa32e3d155","Type":"ContainerDied","Data":"e9da1a2c021f6d33cabec5e7289ce30bf0ed4365ecd783182423c0476ff29433"}
Jul 27 17:25:26.756194 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.756164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg" event={"ID":"d533d30d-f82a-4764-819a-3561612d3494","Type":"ContainerStarted","Data":"0f19cc3799f7bee9cd418010fed275423c3f7afe158d2902c561002c1202f66d"}
Jul 27 17:25:26.758617 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.758593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"04f1cf5a8f57a713220f206fc00b7252754cb74fb4c1dfc69014991c7a8adfa2"}
Jul 27 17:25:26.758690 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.758648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"79873f852e4e4eff73799fe4e6a1853c7c2d35ab7ba432f0c53630806f768409"}
Jul 27 17:25:26.758690 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.758681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"d40d17dd3b0b354171f7ec9e4b141323df9c498237a290ce7e37f5ddc8e0cf3d"}
Jul 27 17:25:26.758783 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.758710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"4d62a2d2c8d5c37ca07524c913d12e79e17248930bfed68b21d2305118d8c9b5"}
Jul 27 17:25:26.759803 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.759787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29b9z" event={"ID":"87c92ea7-6d7a-455f-8672-6bd7eb96fb09","Type":"ContainerStarted","Data":"9dda9f4454c222f2e77ec768eb5edfd6f55f811cd706971ebc9186b1a2709d2e"}
Jul 27 17:25:26.760961 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.760942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgwv9" event={"ID":"3b471003-8eed-4687-bd0b-52b63e72cf87","Type":"ContainerStarted","Data":"0bb9bd9ca51dc2194790dad81a1b6193aa83347d084a3a4ca39e9c4e86c9076a"}
Jul 27 17:25:26.762267 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.762248    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="e49909644b1bb9e3478aecab5c81a12e1572102ceb78ed499305c75cb932a8fb" exitCode=0
Jul 27 17:25:26.762337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.762309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"e49909644b1bb9e3478aecab5c81a12e1572102ceb78ed499305c75cb932a8fb"}
Jul 27 17:25:26.763758 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.763739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhz5q" event={"ID":"8fd50371-320e-451a-ad62-66bfac5dded0","Type":"ContainerStarted","Data":"bdd379a60dce981a0ad5f2fb7ce7ca8d87d1f7514ea395d7eedb513187e18990"}
Jul 27 17:25:26.765081 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.765064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gvhk5" event={"ID":"9ad12cf3-c6ee-470d-8bbb-d43be8259ee6","Type":"ContainerStarted","Data":"eb129ae2d30299fef141422f69a9177ad00f1b0acc775f878634c19feb8f7c5e"}
Jul 27 17:25:26.770023 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.769968    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q6vkg" podStartSLOduration=1.387413133 podStartE2EDuration="21.769951473s" totalImagesPullingTime="20.38253834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.769141342 +0000 UTC m=+22.646342546" watchObservedRunningTime="2026-07-27 17:25:26.769951473 +0000 UTC m=+22.647152677"
Jul 27 17:25:26.785802 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.785768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-29b9z" podStartSLOduration=7.140155076 podStartE2EDuration="21.785760236s" totalImagesPullingTime="14.64560516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.785359691 +0000 UTC m=+22.662560895" watchObservedRunningTime="2026-07-27 17:25:26.785760236 +0000 UTC m=+22.662961436"
Jul 27 17:25:26.800635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.800602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gvhk5" podStartSLOduration=1.76386027 podStartE2EDuration="21.80059117s" totalImagesPullingTime="20.0367309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.800267155 +0000 UTC m=+22.677468357" watchObservedRunningTime="2026-07-27 17:25:26.80059117 +0000 UTC m=+22.677792372"
Jul 27 17:25:26.817642 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.817594    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fhz5q" podStartSLOduration=1.46793912 podStartE2EDuration="21.817584724s" totalImagesPullingTime="20.349645604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.817523889 +0000 UTC m=+22.694725092" watchObservedRunningTime="2026-07-27 17:25:26.817584724 +0000 UTC m=+22.694785927"
Jul 27 17:25:26.858820 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.858687    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" podStartSLOduration=20.858676236 podStartE2EDuration="20.858676236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.85839745 +0000 UTC m=+22.735598651" watchObservedRunningTime="2026-07-27 17:25:26.858676236 +0000 UTC m=+22.735877438"
Jul 27 17:25:26.877888 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.877853    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bgwv9" podStartSLOduration=1.48220322 podStartE2EDuration="21.877842049s" totalImagesPullingTime="20.395638829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.877581023 +0000 UTC m=+22.754782227" watchObservedRunningTime="2026-07-27 17:25:26.877842049 +0000 UTC m=+22.755043230"
Jul 27 17:25:26.887895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.887872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:26.994166 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:26.994074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:27.091845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.091814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:27.378905 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.378796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:27.662208 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.662168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:27.662334 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.662168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:27.662334 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:27.662308    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:27.662508 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:27.662398    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:27.769249 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.769220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vh7kr" event={"ID":"53991793-28a1-4a6e-bca6-1681274b65f9","Type":"ContainerStarted","Data":"9e224a5cbfe3354a647be350842e31d8938721e12cd21837221ef266229ec9c0"}
Jul 27 17:25:27.772742 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.772702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"b8d48ead3d657a3f591ec40a098cd49c333b0acf7bccf7a2037fdba66d8f2846"}
Jul 27 17:25:27.772837 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.772791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"fd119154d7240bdfe87567e5249e6f41aefbf900e48c5b0963d056fbfa647ae2"}
Jul 27 17:25:27.786265 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.786154    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vh7kr" podStartSLOduration=2.898037482 podStartE2EDuration="22.786135448s" totalImagesPullingTime="19.888097966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:27.78567227 +0000 UTC m=+23.662873472" watchObservedRunningTime="2026-07-27 17:25:27.786135448 +0000 UTC m=+23.663336652"
Jul 27 17:25:27.796967 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.796940    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 17:25:27.906197 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:27.906162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.005946 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.005907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.422357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.422323    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:28.423096 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.423068    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:28.543412 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.543252    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:25:27.796954072Z","UUID":"788aef3c-846e-429f-836f-bbac5728e1b8","Handler":null,"Name":"","Endpoint":""}
Jul 27 17:25:28.545076 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.545042    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 17:25:28.545220 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.545084    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 17:25:28.563371 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.563330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.662407 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.662377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:28.662675 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:28.662501    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:28.776923 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.776889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"23275bb73041f25395a19eaa32e3d155","Type":"ContainerStarted","Data":"bf3f80f3dc13b04824e1753901357cbaae8aaffb7973e084a2a9e216af7b56a2"}
Jul 27 17:25:28.779003 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.778971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg" event={"ID":"d533d30d-f82a-4764-819a-3561612d3494","Type":"ContainerStarted","Data":"ba535f6da0d9ed59e952721753a586ed128117ea4c0275dc87bb79fdbd74a859"}
Jul 27 17:25:28.779331 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.779306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:28.779716 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.779702    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-29b9z"
Jul 27 17:25:28.792680 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.792642    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" podStartSLOduration=22.792631231 podStartE2EDuration="22.792631231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:28.792324373 +0000 UTC m=+24.669525577" watchObservedRunningTime="2026-07-27 17:25:28.792631231 +0000 UTC m=+24.669832434"
Jul 27 17:25:28.851811 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.851781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.957234 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:28.957209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:29.061433 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.061399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:29.662442 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.662414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:29.662707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.662457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:29.662707 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:29.662540    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:29.662707 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:29.662678    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:29.784159 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.784125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg" event={"ID":"d533d30d-f82a-4764-819a-3561612d3494","Type":"ContainerStarted","Data":"9376aa2571e2b6bdaa28016ff9c1628341860a785fde2a2394af7a5644553b0e"}
Jul 27 17:25:29.787695 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.787666    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"48cf40655ab159628150568c53aaaaf301ac05b974f9aadec3d3b4fac8dc6bb2"}
Jul 27 17:25:29.804994 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:29.804953    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h49hg" podStartSLOduration=2.701277436 podStartE2EDuration="24.804937344s" totalImagesPullingTime="22.103659908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:29.804624565 +0000 UTC m=+25.681825769" watchObservedRunningTime="2026-07-27 17:25:29.804937344 +0000 UTC m=+25.682138546"
Jul 27 17:25:30.662428 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:30.662393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:30.662604 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:30.662520    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:31.662510 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.662330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:31.663100 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.662367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:31.663100 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:31.662604    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:31.663100 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:31.662663    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:31.794634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.794598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" event={"ID":"4c494a60-97f6-4b60-9680-8a26f1de4c4e","Type":"ContainerStarted","Data":"166601b7d6b7596a0db9b6448925b28f6bd475e5d0cc8627cbc5a20066a3cae3"}
Jul 27 17:25:31.794831 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.794816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:31.796471 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.796441    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="f8ad7dcb625d176d9f0834250d89b42182fd6fef8e660dc298de4a810526b212" exitCode=0
Jul 27 17:25:31.796560 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.796475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"f8ad7dcb625d176d9f0834250d89b42182fd6fef8e660dc298de4a810526b212"}
Jul 27 17:25:31.809890 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.809867    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:31.823399 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:31.823361    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9" podStartSLOduration=6.493221866 podStartE2EDuration="26.8233472s" totalImagesPullingTime="20.330125334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:31.822751478 +0000 UTC m=+27.699952681" watchObservedRunningTime="2026-07-27 17:25:31.8233472 +0000 UTC m=+27.700548404"
Jul 27 17:25:32.662749 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:32.662721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:32.663365 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:32.662827    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:32.799296 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:32.799077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:32.799450 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:32.799434    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:32.814556 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:32.814530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:25:33.144733 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.144640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpxwg"]
Jul 27 17:25:33.144857 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.144780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:33.144918 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:33.144897    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:33.145398 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.145367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5rbbv"]
Jul 27 17:25:33.145524 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.145444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:33.145567 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:33.145536    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:33.147237 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.147215    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fzx8"]
Jul 27 17:25:33.147346 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.147325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:33.147427 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:33.147409    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:33.802141 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.802110    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="4e9eae2ccb0f78e9fe3ab3f0bdf48c3c8c7d28234f5819a8b6ce85d71327563b" exitCode=0
Jul 27 17:25:33.802633 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:33.802218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"4e9eae2ccb0f78e9fe3ab3f0bdf48c3c8c7d28234f5819a8b6ce85d71327563b"}
Jul 27 17:25:34.662770 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:34.662740    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:34.662945 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:34.662748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:34.662945 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:34.662845    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:34.662945 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:34.662917    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:34.662945 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:34.662935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:34.663147 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:34.663050    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:35.808878 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:35.808851    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="0e0c80e31d89c958b93cff921861eea32285a222052736e357a624221865c41f" exitCode=0
Jul 27 17:25:35.809174 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:35.808889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"0e0c80e31d89c958b93cff921861eea32285a222052736e357a624221865c41f"}
Jul 27 17:25:36.662093 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:36.662058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:36.662289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:36.662058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:36.662289 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:36.662192    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:36.662289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:36.662058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:36.662457 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:36.662308    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:36.662457 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:36.662433    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:37.331878 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:37.331836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:37.332363 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:37.331893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:37.332363 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.331963    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:37.332363 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.332042    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret podName:6d346835-866e-4fc5-969b-fb7c5d537ca2 nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.332017162 +0000 UTC m=+65.209218359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret") pod "global-pull-secret-syncer-5rbbv" (UID: "6d346835-866e-4fc5-969b-fb7c5d537ca2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:37.332363 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.332059    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:37.332363 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.332118    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.332100523 +0000 UTC m=+65.209301717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:37.432295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:37.432262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:37.432472 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.432413    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:37.432472 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.432431    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:37.432472 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.432440    2564 projected.go:196] Error preparing data for projected volume kube-api-access-s4g5l for pod openshift-network-diagnostics/network-check-target-6fzx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:37.432640 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:37.432485    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l podName:39e162b4-71e3-443b-b5cc-8402af04006c nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.432472327 +0000 UTC m=+65.309673512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4g5l" (UniqueName: "kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l") pod "network-check-target-6fzx8" (UID: "39e162b4-71e3-443b-b5cc-8402af04006c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:38.662892 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:38.662661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:38.663326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:38.662682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:38.663326 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:38.663000    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fzx8" podUID="39e162b4-71e3-443b-b5cc-8402af04006c"
Jul 27 17:25:38.663326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:38.662703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:38.663326 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:38.663077    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:25:38.663326 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:38.663156    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rbbv" podUID="6d346835-866e-4fc5-969b-fb7c5d537ca2"
Jul 27 17:25:39.927563 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.927535    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeReady"
Jul 27 17:25:39.927961 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.927684    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 17:25:39.976866 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.976840    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k5lwv"]
Jul 27 17:25:39.979046 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.979026    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:39.982362 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.982340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 17:25:39.982505 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.982401    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nmw22"]
Jul 27 17:25:39.982629 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.982507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:25:39.982629 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.982611    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 17:25:39.984488 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.984428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:39.987069 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.987012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 17:25:39.987262 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.987249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 17:25:39.987444 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.987411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 17:25:39.987531 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.987502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkb8l\""
Jul 27 17:25:39.992083 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.992059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k5lwv"]
Jul 27 17:25:39.996097 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:39.995836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmw22"]
Jul 27 17:25:40.062808 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.062783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:40.153978 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.153952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-config-volume\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.154106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.154035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.154106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.154052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335afd52-e9d8-4d26-8c0c-512dceb352d1-cert\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.154106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.154067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-tmp-dir\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.154106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.154082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzrf\" (UniqueName: \"kubernetes.io/projected/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-kube-api-access-mrzrf\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.154106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.154097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7zq\" (UniqueName: \"kubernetes.io/projected/335afd52-e9d8-4d26-8c0c-512dceb352d1-kube-api-access-pr7zq\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.166671 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.166641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:40.255320 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.255320 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335afd52-e9d8-4d26-8c0c-512dceb352d1-cert\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.255320 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-tmp-dir\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.255541 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrzrf\" (UniqueName: \"kubernetes.io/projected/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-kube-api-access-mrzrf\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.255541 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7zq\" (UniqueName: \"kubernetes.io/projected/335afd52-e9d8-4d26-8c0c-512dceb352d1-kube-api-access-pr7zq\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.255541 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-config-volume\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.255541 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:40.255404    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.255541 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:40.255469    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:40.755449887 +0000 UTC m=+36.632651071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.255711 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255684    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-tmp-dir\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.255998 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.255981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-config-volume\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.259327 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.259311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335afd52-e9d8-4d26-8c0c-512dceb352d1-cert\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.264705 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.264685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7zq\" (UniqueName: \"kubernetes.io/projected/335afd52-e9d8-4d26-8c0c-512dceb352d1-kube-api-access-pr7zq\") pod \"ingress-canary-nmw22\" (UID: \"335afd52-e9d8-4d26-8c0c-512dceb352d1\") " pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.264789 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.264740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrzrf\" (UniqueName: \"kubernetes.io/projected/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-kube-api-access-mrzrf\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.296864 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.296845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmw22"
Jul 27 17:25:40.421923 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.421896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmw22"]
Jul 27 17:25:40.425630 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:25:40.425609    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335afd52_e9d8_4d26_8c0c_512dceb352d1.slice/crio-d7bbf40983d312b5b107097bfb60c52c34be99d48bf2a5f0c2cea3f78aa4ba04 WatchSource:0}: Error finding container d7bbf40983d312b5b107097bfb60c52c34be99d48bf2a5f0c2cea3f78aa4ba04: Status 404 returned error can't find the container with id d7bbf40983d312b5b107097bfb60c52c34be99d48bf2a5f0c2cea3f78aa4ba04
Jul 27 17:25:40.662069 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.661983    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:25:40.662377 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.661983    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:25:40.662377 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.662122    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:25:40.665595 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.665566    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:25:40.665595 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.665593    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:25:40.665772 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.665673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:25:40.666990 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.666971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:25:40.667106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.667007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:25:40.667106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.667014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:25:40.759678 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.759658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:40.759820 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:40.759804    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.759896 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:40.759860    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:41.759842219 +0000 UTC m=+37.637043420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.822775 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.822752    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="f175a61af4e6e50d9d78eb329326d47c08d14d07e1cd75e4205bfa6d1983f73d" exitCode=0
Jul 27 17:25:40.822875 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.822835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"f175a61af4e6e50d9d78eb329326d47c08d14d07e1cd75e4205bfa6d1983f73d"}
Jul 27 17:25:40.824012 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:40.823992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmw22" event={"ID":"335afd52-e9d8-4d26-8c0c-512dceb352d1","Type":"ContainerStarted","Data":"d7bbf40983d312b5b107097bfb60c52c34be99d48bf2a5f0c2cea3f78aa4ba04"}
Jul 27 17:25:41.767156 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:41.767122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:41.767793 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:41.767254    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:41.767793 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:41.767316    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:43.767298385 +0000 UTC m=+39.644499569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:41.830143 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:41.830092    2564 generic.go:356] "Generic (PLEG): container finished" podID="c19de51b-a214-4368-80f8-73fa2212b9c2" containerID="8786dfdf0f60ea14eea43e2326338659dd0d73d239d7bf55bba3e30f4eacfe34" exitCode=0
Jul 27 17:25:41.830297 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:41.830172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerDied","Data":"8786dfdf0f60ea14eea43e2326338659dd0d73d239d7bf55bba3e30f4eacfe34"}
Jul 27 17:25:42.835761 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:42.835731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" event={"ID":"c19de51b-a214-4368-80f8-73fa2212b9c2","Type":"ContainerStarted","Data":"62f9cf85aeb5424437061d7ab37488b77931b04350283654524f4818667a6823"}
Jul 27 17:25:42.861456 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:42.861410    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kvwfc" podStartSLOduration=7.590518569 podStartE2EDuration="37.861397011s" totalImagesPullingTime="30.270878442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:42.859735216 +0000 UTC m=+38.736936415" watchObservedRunningTime="2026-07-27 17:25:42.861397011 +0000 UTC m=+38.738598214"
Jul 27 17:25:42.981666 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:42.981586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:43.080952 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:43.080921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:43.525684 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:43.525655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:43.581655 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:43.581621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:43.778871 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:43.778798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:43.778995 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:43.778912    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:43.778995 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:43.778979    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:47.778964351 +0000 UTC m=+43.656165533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:47.806420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:47.806383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:47.806767 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:47.806534    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:47.806767 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:47.806597    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:55.806579954 +0000 UTC m=+51.683781135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:47.848569 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:47.848538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmw22" event={"ID":"335afd52-e9d8-4d26-8c0c-512dceb352d1","Type":"ContainerStarted","Data":"2ea0f3fdb34b55972c06e44e9a7bd415a19ea90cc5b24aad2f87109c1c0ef79e"}
Jul 27 17:25:47.865022 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:47.864983    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nmw22" podStartSLOduration=2.556376083 podStartE2EDuration="8.864970652s" totalImagesPullingTime="6.308594569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:47.864925157 +0000 UTC m=+43.742126359" watchObservedRunningTime="2026-07-27 17:25:47.864970652 +0000 UTC m=+43.742171854"
Jul 27 17:25:55.860936 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:25:55.860893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:25:55.861422 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:55.861009    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:55.861422 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:25:55.861062    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:26:11.861048482 +0000 UTC m=+67.738249668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:04.488044 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:04.488016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:04.546810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:04.546781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:04.823286 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:04.823216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wm9d9"
Jul 27 17:26:05.278309 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:05.278270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:05.881772 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:05.881739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:09.347313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.347280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:26:09.347313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.347317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:26:09.350448 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.350427    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:26:09.350564 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.350457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:26:09.357926 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:09.357907    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:26:09.358011 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:09.357974    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:27:13.357953007 +0000 UTC m=+129.235154191 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : secret "metrics-daemon-secret" not found
Jul 27 17:26:09.360972 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.360950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d346835-866e-4fc5-969b-fb7c5d537ca2-original-pull-secret\") pod \"global-pull-secret-syncer-5rbbv\" (UID: \"6d346835-866e-4fc5-969b-fb7c5d537ca2\") " pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:26:09.447910 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.447876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:26:09.450844 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.450827    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:26:09.461077 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.461060    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:26:09.471038 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.471011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4g5l\" (UniqueName: \"kubernetes.io/projected/39e162b4-71e3-443b-b5cc-8402af04006c-kube-api-access-s4g5l\") pod \"network-check-target-6fzx8\" (UID: \"39e162b4-71e3-443b-b5cc-8402af04006c\") " pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:26:09.478893 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.478877    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rbbv"
Jul 27 17:26:09.485595 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.485581    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:26:09.493904 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.493879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:26:09.605678 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.605614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5rbbv"]
Jul 27 17:26:09.608726 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:26:09.608690    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d346835_866e_4fc5_969b_fb7c5d537ca2.slice/crio-7be9aee2c54fa5f8cb66147fa8900c530fc97a17973656695392313c825ccfad WatchSource:0}: Error finding container 7be9aee2c54fa5f8cb66147fa8900c530fc97a17973656695392313c825ccfad: Status 404 returned error can't find the container with id 7be9aee2c54fa5f8cb66147fa8900c530fc97a17973656695392313c825ccfad
Jul 27 17:26:09.625472 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.625451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fzx8"]
Jul 27 17:26:09.627339 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:26:09.627317    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e162b4_71e3_443b_b5cc_8402af04006c.slice/crio-9a403f22c7449d576359b16ebbb60752701aeb298566d93b0e86d5a90ac20012 WatchSource:0}: Error finding container 9a403f22c7449d576359b16ebbb60752701aeb298566d93b0e86d5a90ac20012: Status 404 returned error can't find the container with id 9a403f22c7449d576359b16ebbb60752701aeb298566d93b0e86d5a90ac20012
Jul 27 17:26:09.897847 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.897758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fzx8" event={"ID":"39e162b4-71e3-443b-b5cc-8402af04006c","Type":"ContainerStarted","Data":"9a403f22c7449d576359b16ebbb60752701aeb298566d93b0e86d5a90ac20012"}
Jul 27 17:26:09.898780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:09.898748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5rbbv" event={"ID":"6d346835-866e-4fc5-969b-fb7c5d537ca2","Type":"ContainerStarted","Data":"7be9aee2c54fa5f8cb66147fa8900c530fc97a17973656695392313c825ccfad"}
Jul 27 17:26:11.863523 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:11.863483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:26:11.864127 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:11.863666    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:26:11.864127 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:11.863747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:26:43.863725085 +0000 UTC m=+99.740926281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:14.914777 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:14.914740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fzx8" event={"ID":"39e162b4-71e3-443b-b5cc-8402af04006c","Type":"ContainerStarted","Data":"093502cfe0ae47458c565d04442095eed784c9aa56816cdca87c7af53ea66119"}
Jul 27 17:26:14.915313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:14.914863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:26:14.916066 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:14.916047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5rbbv" event={"ID":"6d346835-866e-4fc5-969b-fb7c5d537ca2","Type":"ContainerStarted","Data":"e21ebe63f0b3946846e416bf50a933df4c34dea0ba7f178cca8ca250b513f54c"}
Jul 27 17:26:14.932884 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:14.932838    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6fzx8" podStartSLOduration=65.622730406 podStartE2EDuration="1m9.932824959s" totalImagesPullingTime="4.310094553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:14.931917356 +0000 UTC m=+70.809118551" watchObservedRunningTime="2026-07-27 17:26:14.932824959 +0000 UTC m=+70.810026162"
Jul 27 17:26:14.946938 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:14.946892    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5rbbv" podStartSLOduration=65.61319236 podStartE2EDuration="1m9.946878647s" totalImagesPullingTime="4.333686287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:14.945913288 +0000 UTC m=+70.823114493" watchObservedRunningTime="2026-07-27 17:26:14.946878647 +0000 UTC m=+70.824079873"
Jul 27 17:26:43.868503 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:43.868464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:26:43.868879 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:43.868582    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:26:43.868879 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:26:43.868646    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:27:47.868631088 +0000 UTC m=+163.745832272 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:45.920283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:26:45.920254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6fzx8"
Jul 27 17:27:13.358931 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:27:13.358888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:27:13.359456 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:13.359016    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:27:13.359456 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:13.359069    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs podName:8c8d5e98-89f9-48c7-82ba-5890a826d740 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:15.359055351 +0000 UTC m=+251.236256532 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs") pod "network-metrics-daemon-qpxwg" (UID: "8c8d5e98-89f9-48c7-82ba-5890a826d740") : secret "metrics-daemon-secret" not found
Jul 27 17:27:42.989109 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:42.989025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k5lwv" podUID="c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a"
Jul 27 17:27:43.118453 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:27:43.118427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:27:43.672902 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:43.672859    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qpxwg" podUID="8c8d5e98-89f9-48c7-82ba-5890a826d740"
Jul 27 17:27:47.868872 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:27:47.868818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:27:47.869374 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:47.868971    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:27:47.869374 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:27:47.869040    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls podName:c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a nodeName:}" failed. No retries permitted until 2026-07-27 17:29:49.869022464 +0000 UTC m=+285.746223644 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls") pod "dns-default-k5lwv" (UID: "c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a") : secret "dns-default-metrics-tls" not found
Jul 27 17:27:55.662278 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:27:55.662246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:28:04.162158 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:04.162081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:35.659896 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.659856    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"]
Jul 27 17:28:35.661752 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.661733    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"]
Jul 27 17:28:35.661877 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.661861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"
Jul 27 17:28:35.663629 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.663602    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56f7bb7d55-jnrhm"]
Jul 27 17:28:35.663750 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.663732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"
Jul 27 17:28:35.665309 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.665292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.667409 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.667383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2vdd4\""
Jul 27 17:28:35.667508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.667436    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9nn4t\""
Jul 27 17:28:35.667508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.667481    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.667624 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.667517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.668448 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.668140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 17:28:35.668448 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.668376    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8wcgg\""
Jul 27 17:28:35.668744 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.668728    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 17:28:35.668848 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.668829    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.668910 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.668850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.669141 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.669126    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 17:28:35.669548 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.669532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 17:28:35.679608 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.679358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"]
Jul 27 17:28:35.680311 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.680291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"]
Jul 27 17:28:35.706785 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.706763    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f7bb7d55-jnrhm"]
Jul 27 17:28:35.753426 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.753404    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"]
Jul 27 17:28:35.755449 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.755426    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tqhvw"]
Jul 27 17:28:35.755555 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.755538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.757120 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.757104    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"]
Jul 27 17:28:35.757239 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.757221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.758677 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.758660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.758999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.758980    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.759074 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.759038    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tsdcr\""
Jul 27 17:28:35.759281 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.759269    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 17:28:35.759281 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.759278    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.759937 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.759921    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 17:28:35.759991 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.759976    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 17:28:35.761154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.761136    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.761845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.761728    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.763273 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.763255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wbrvp\""
Jul 27 17:28:35.763923 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.763908    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.764157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.764144    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 17:28:35.764257 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.764242    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.764436 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.764419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 17:28:35.767496 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.767476    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 17:28:35.767749 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.767733    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s5pm8\""
Jul 27 17:28:35.768251 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.768231    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 17:28:35.769929 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.769911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"]
Jul 27 17:28:35.770313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-stats-auth\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.770420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.770420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvgb\" (UniqueName: \"kubernetes.io/projected/7404b837-7f91-4133-a540-6a7c2db506b6-kube-api-access-zvvgb\") pod \"volume-data-source-validator-549c6d54cf-dht4j\" (UID: \"7404b837-7f91-4133-a540-6a7c2db506b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"
Jul 27 17:28:35.770542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlkt8\" (UniqueName: \"kubernetes.io/projected/aa31e2c4-1822-46a7-8285-579f66b698a5-kube-api-access-vlkt8\") pod \"network-check-source-7d88cb55d8-br257\" (UID: \"aa31e2c4-1822-46a7-8285-579f66b698a5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"
Jul 27 17:28:35.770542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.770542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdml\" (UniqueName: \"kubernetes.io/projected/0ce634e7-417d-4faa-a18a-a438c885cdee-kube-api-access-2rdml\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.770542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-default-certificate\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.770809 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.770789    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tqhvw"]
Jul 27 17:28:35.815395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.815372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"]
Jul 27 17:28:35.870959 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.870936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-tmp\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.871068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.870964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-service-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.871068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.870986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlkt8\" (UniqueName: \"kubernetes.io/projected/aa31e2c4-1822-46a7-8285-579f66b698a5-kube-api-access-vlkt8\") pod \"network-check-source-7d88cb55d8-br257\" (UID: \"aa31e2c4-1822-46a7-8285-579f66b698a5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"
Jul 27 17:28:35.871068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.871068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.871269 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87t5p\" (UniqueName: \"kubernetes.io/projected/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-kube-api-access-87t5p\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.871269 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:35.871120    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:36.371100631 +0000 UTC m=+212.248301817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:35.871269 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-snapshots\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.871269 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-config\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.871269 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdml\" (UniqueName: \"kubernetes.io/projected/0ce634e7-417d-4faa-a18a-a438c885cdee-kube-api-access-2rdml\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.871457 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-default-certificate\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.871457 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-serving-cert\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.871554 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-stats-auth\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.871554 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.871656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvgb\" (UniqueName: \"kubernetes.io/projected/7404b837-7f91-4133-a540-6a7c2db506b6-kube-api-access-zvvgb\") pod \"volume-data-source-validator-549c6d54cf-dht4j\" (UID: \"7404b837-7f91-4133-a540-6a7c2db506b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"
Jul 27 17:28:35.871656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bba1d9b-a978-40d0-91dd-e62519a7cba3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.871656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bba1d9b-a978-40d0-91dd-e62519a7cba3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.871656 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:35.871616    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 17:28:35.871656 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtvjn\" (UniqueName: \"kubernetes.io/projected/1bba1d9b-a978-40d0-91dd-e62519a7cba3-kube-api-access-dtvjn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.871913 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:35.871664    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:36.371649532 +0000 UTC m=+212.248850728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : secret "router-metrics-certs-default" not found
Jul 27 17:28:35.871913 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2w7s\" (UniqueName: \"kubernetes.io/projected/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-kube-api-access-w2w7s\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.871913 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.871721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-serving-cert\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.873723 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.873693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-default-certificate\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.873827 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.873704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-stats-auth\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.884911 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.884892    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvgb\" (UniqueName: \"kubernetes.io/projected/7404b837-7f91-4133-a540-6a7c2db506b6-kube-api-access-zvvgb\") pod \"volume-data-source-validator-549c6d54cf-dht4j\" (UID: \"7404b837-7f91-4133-a540-6a7c2db506b6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"
Jul 27 17:28:35.890383 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.890365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlkt8\" (UniqueName: \"kubernetes.io/projected/aa31e2c4-1822-46a7-8285-579f66b698a5-kube-api-access-vlkt8\") pod \"network-check-source-7d88cb55d8-br257\" (UID: \"aa31e2c4-1822-46a7-8285-579f66b698a5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"
Jul 27 17:28:35.890491 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.890475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdml\" (UniqueName: \"kubernetes.io/projected/0ce634e7-417d-4faa-a18a-a438c885cdee-kube-api-access-2rdml\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:35.972117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"
Jul 27 17:28:35.972273 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bba1d9b-a978-40d0-91dd-e62519a7cba3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.972326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bba1d9b-a978-40d0-91dd-e62519a7cba3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.972326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtvjn\" (UniqueName: \"kubernetes.io/projected/1bba1d9b-a978-40d0-91dd-e62519a7cba3-kube-api-access-dtvjn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.972326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2w7s\" (UniqueName: \"kubernetes.io/projected/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-kube-api-access-w2w7s\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.972418 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-serving-cert\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972455 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-tmp\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972494 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-service-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972530 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972577 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87t5p\" (UniqueName: \"kubernetes.io/projected/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-kube-api-access-87t5p\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972577 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-snapshots\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.972675 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-config\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.972675 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-serving-cert\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.972908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.972883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-tmp\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.973230 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.973148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-service-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.973323 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.973268    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bba1d9b-a978-40d0-91dd-e62519a7cba3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.973483 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.973460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-config\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.973560 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.973483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-snapshots\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.973785 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.973765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.974911 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.974740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-serving-cert\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.974911 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.974866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bba1d9b-a978-40d0-91dd-e62519a7cba3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:35.974997 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.974976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-serving-cert\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.977978 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.977957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"
Jul 27 17:28:35.983090 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.983071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87t5p\" (UniqueName: \"kubernetes.io/projected/fbea3ce3-e76a-4303-b5f8-45eefc4cde17-kube-api-access-87t5p\") pod \"insights-operator-5885fdb759-tqhvw\" (UID: \"fbea3ce3-e76a-4303-b5f8-45eefc4cde17\") " pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:35.987903 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.987873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2w7s\" (UniqueName: \"kubernetes.io/projected/fff8b62f-a429-4d3d-9c1f-f1d20870ec19-kube-api-access-w2w7s\") pod \"service-ca-operator-5d6c75f84f-w7tgd\" (UID: \"fff8b62f-a429-4d3d-9c1f-f1d20870ec19\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:35.988517 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:35.988500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtvjn\" (UniqueName: \"kubernetes.io/projected/1bba1d9b-a978-40d0-91dd-e62519a7cba3-kube-api-access-dtvjn\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n\" (UID: \"1bba1d9b-a978-40d0-91dd-e62519a7cba3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:36.016611 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.016468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:36.065458 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.065432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"
Jul 27 17:28:36.073346 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.072483    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-tqhvw"
Jul 27 17:28:36.077324 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.077129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"
Jul 27 17:28:36.095800 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.095700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:36.112037 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.111925    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-br257"]
Jul 27 17:28:36.125411 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.125159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j"]
Jul 27 17:28:36.130654 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:28:36.130595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7404b837_7f91_4133_a540_6a7c2db506b6.slice/crio-dacc17516a5c6ae169f5bd5c064005fdce654fe44fa3bf25e0259f9e3a2baff7 WatchSource:0}: Error finding container dacc17516a5c6ae169f5bd5c064005fdce654fe44fa3bf25e0259f9e3a2baff7: Status 404 returned error can't find the container with id dacc17516a5c6ae169f5bd5c064005fdce654fe44fa3bf25e0259f9e3a2baff7
Jul 27 17:28:36.219096 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.219069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n"]
Jul 27 17:28:36.221639 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:28:36.221606    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bba1d9b_a978_40d0_91dd_e62519a7cba3.slice/crio-7629e8b2404f217aed68512f9c756ff5dc9e001166b3a9fe3c999cb73a1b09f3 WatchSource:0}: Error finding container 7629e8b2404f217aed68512f9c756ff5dc9e001166b3a9fe3c999cb73a1b09f3: Status 404 returned error can't find the container with id 7629e8b2404f217aed68512f9c756ff5dc9e001166b3a9fe3c999cb73a1b09f3
Jul 27 17:28:36.243125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.243071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd"]
Jul 27 17:28:36.243756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.243625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257" event={"ID":"aa31e2c4-1822-46a7-8285-579f66b698a5","Type":"ContainerStarted","Data":"330aa6e0444fa944e06c6d4a4f1b3be3bd20b14994d70c3f0496c677eea60e5d"}
Jul 27 17:28:36.243756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.243693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257" event={"ID":"aa31e2c4-1822-46a7-8285-579f66b698a5","Type":"ContainerStarted","Data":"b10bbbeafb917897c3437f57b46b28a31d945caa095fbdbafdd551b8926e9400"}
Jul 27 17:28:36.244958 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.244933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j" event={"ID":"7404b837-7f91-4133-a540-6a7c2db506b6","Type":"ContainerStarted","Data":"dacc17516a5c6ae169f5bd5c064005fdce654fe44fa3bf25e0259f9e3a2baff7"}
Jul 27 17:28:36.245873 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:28:36.245840    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff8b62f_a429_4d3d_9c1f_f1d20870ec19.slice/crio-ef60a2f81a326ef028ade2ec426f008534394b8bef1f13a286ce7d503b34d9b1 WatchSource:0}: Error finding container ef60a2f81a326ef028ade2ec426f008534394b8bef1f13a286ce7d503b34d9b1: Status 404 returned error can't find the container with id ef60a2f81a326ef028ade2ec426f008534394b8bef1f13a286ce7d503b34d9b1
Jul 27 17:28:36.246157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.246129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n" event={"ID":"1bba1d9b-a978-40d0-91dd-e62519a7cba3","Type":"ContainerStarted","Data":"7629e8b2404f217aed68512f9c756ff5dc9e001166b3a9fe3c999cb73a1b09f3"}
Jul 27 17:28:36.258460 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.258440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tqhvw"]
Jul 27 17:28:36.260704 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.260668    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-br257" podStartSLOduration=1.260654822 podStartE2EDuration="1.260654822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:36.260359863 +0000 UTC m=+212.137561069" watchObservedRunningTime="2026-07-27 17:28:36.260654822 +0000 UTC m=+212.137856025"
Jul 27 17:28:36.261309 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:28:36.261287    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbea3ce3_e76a_4303_b5f8_45eefc4cde17.slice/crio-fca9c0685e6e6c0a6529c1ffc7b7908d6adb0581d71da470f2748d5c3da6e9bd WatchSource:0}: Error finding container fca9c0685e6e6c0a6529c1ffc7b7908d6adb0581d71da470f2748d5c3da6e9bd: Status 404 returned error can't find the container with id fca9c0685e6e6c0a6529c1ffc7b7908d6adb0581d71da470f2748d5c3da6e9bd
Jul 27 17:28:36.376494 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.376463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:36.376630 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:36.376535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:36.376630 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:36.376604    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 17:28:36.376729 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:36.376663    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:37.376649081 +0000 UTC m=+213.253850266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : secret "router-metrics-certs-default" not found
Jul 27 17:28:36.376729 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:36.376676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:37.376670635 +0000 UTC m=+213.253871822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:37.251546 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.251476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tqhvw" event={"ID":"fbea3ce3-e76a-4303-b5f8-45eefc4cde17","Type":"ContainerStarted","Data":"fca9c0685e6e6c0a6529c1ffc7b7908d6adb0581d71da470f2748d5c3da6e9bd"}
Jul 27 17:28:37.253033 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.252984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd" event={"ID":"fff8b62f-a429-4d3d-9c1f-f1d20870ec19","Type":"ContainerStarted","Data":"ef60a2f81a326ef028ade2ec426f008534394b8bef1f13a286ce7d503b34d9b1"}
Jul 27 17:28:37.255360 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.255297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j" event={"ID":"7404b837-7f91-4133-a540-6a7c2db506b6","Type":"ContainerStarted","Data":"379a114c7303e32f8420f82b37323b646b8a3f014c017c5e68738d7903f50ca9"}
Jul 27 17:28:37.274969 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.274905    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dht4j" podStartSLOduration=1.25050971 podStartE2EDuration="2.274886813s" totalImagesPullingTime="1.024377103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:37.273272943 +0000 UTC m=+213.150474153" watchObservedRunningTime="2026-07-27 17:28:37.274886813 +0000 UTC m=+213.152088021"
Jul 27 17:28:37.356810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.356684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:37.386634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.386198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:37.386634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.386363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:37.386634 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:37.386587    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:39.386568098 +0000 UTC m=+215.263769287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:37.386634 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:37.386596    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 17:28:37.386925 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:37.386686    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:39.386637241 +0000 UTC m=+215.263838439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : secret "router-metrics-certs-default" not found
Jul 27 17:28:37.457637 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:37.457562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:39.264297 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.264003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd" event={"ID":"fff8b62f-a429-4d3d-9c1f-f1d20870ec19","Type":"ContainerStarted","Data":"f35c2126a3fa76023baa052932aaa2a38ce74c59d60853c564c7559c258eca27"}
Jul 27 17:28:39.271245 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.271208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n" event={"ID":"1bba1d9b-a978-40d0-91dd-e62519a7cba3","Type":"ContainerStarted","Data":"5610c0a519c606ab5e53cf197a1cb1914bd319176219dac70a09b7189d568573"}
Jul 27 17:28:39.272880 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.272851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tqhvw" event={"ID":"fbea3ce3-e76a-4303-b5f8-45eefc4cde17","Type":"ContainerStarted","Data":"c4c131e720aba11311e24d4ac8ce1fc34f0ea9611fb5bde652461e7508fe1cf7"}
Jul 27 17:28:39.284695 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.284651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd" podStartSLOduration=1.383565806 podStartE2EDuration="4.284637193s" totalImagesPullingTime="2.901071387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:39.284524062 +0000 UTC m=+215.161725267" watchObservedRunningTime="2026-07-27 17:28:39.284637193 +0000 UTC m=+215.161838396"
Jul 27 17:28:39.302995 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.302938    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n" podStartSLOduration=1.379209087 podStartE2EDuration="4.302920151s" totalImagesPullingTime="2.923711064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:39.302172064 +0000 UTC m=+215.179373268" watchObservedRunningTime="2026-07-27 17:28:39.302920151 +0000 UTC m=+215.180121352"
Jul 27 17:28:39.320475 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.320434    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-tqhvw" podStartSLOduration=1.441447831 podStartE2EDuration="4.32041574s" totalImagesPullingTime="2.878967909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:39.320263325 +0000 UTC m=+215.197464529" watchObservedRunningTime="2026-07-27 17:28:39.32041574 +0000 UTC m=+215.197616921"
Jul 27 17:28:39.404019 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.403956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:39.404146 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:39.404121    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.404100663 +0000 UTC m=+219.281301856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:39.404551 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:39.404527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:39.404671 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:39.404652    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 17:28:39.404729 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:39.404711    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.404695434 +0000 UTC m=+219.281896629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : secret "router-metrics-certs-default" not found
Jul 27 17:28:40.039300 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.039273    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9wtms"]
Jul 27 17:28:40.041477 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.041462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.044451 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.044427    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 17:28:40.044590 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.044470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 17:28:40.044826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.044811    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 17:28:40.060907 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.060884    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9wtms"]
Jul 27 17:28:40.102950 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.102922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:40.197056 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.197027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:40.211042 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.211015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79cd464c-763c-433f-9cd8-41d51bee8c4f-data-volume\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.211152 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.211069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.211253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.211150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79cd464c-763c-433f-9cd8-41d51bee8c4f-crio-socket\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.211253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.211174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.211336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.211279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfkxs\" (UniqueName: \"kubernetes.io/projected/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-api-access-pfkxs\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.298283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.298205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:40.311566 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkxs\" (UniqueName: \"kubernetes.io/projected/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-api-access-pfkxs\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79cd464c-763c-433f-9cd8-41d51bee8c4f-data-volume\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79cd464c-763c-433f-9cd8-41d51bee8c4f-crio-socket\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311808 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.311753    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.311808 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.311777    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.311808 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.311790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79cd464c-763c-433f-9cd8-41d51bee8c4f-crio-socket\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.311920 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.311805    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.811788823 +0000 UTC m=+216.688990006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.311920 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.311850    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.811832227 +0000 UTC m=+216.689033425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.312470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.312453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79cd464c-763c-433f-9cd8-41d51bee8c4f-data-volume\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.322174 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.322152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfkxs\" (UniqueName: \"kubernetes.io/projected/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-api-access-pfkxs\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.816400 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.816372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.816578 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:40.816416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:40.816578 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.816489    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.816578 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.816520    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.816578 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.816537    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.816520577 +0000 UTC m=+217.693721762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.816732 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:40.816590    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.81657617 +0000 UTC m=+217.693777357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.075941 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.075872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:41.178549 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.178517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:41.239131 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.239101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:41.360319 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.360225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:41.461001 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.460966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:41.823696 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.823669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:41.823869 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:41.823713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:41.823869 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:41.823834    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.823869 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:41.823850    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:41.823983 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:41.823902    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.823884882 +0000 UTC m=+219.701086069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.823983 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:41.823917    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.823910006 +0000 UTC m=+219.701111187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:42.016498 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:42.016474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6vkg_1c95930a-e283-48c8-a484-bb99194ab7ee/dns-node-resolver/0.log"
Jul 27 17:28:42.994014 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:42.993981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:43.015738 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.015721    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gvhk5_9ad12cf3-c6ee-470d-8bbb-d43be8259ee6/node-ca/0.log"
Jul 27 17:28:43.053536 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.053505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:43.435532 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.435444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:43.435532 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.435501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:43.435728 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.435603    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:51.435585002 +0000 UTC m=+227.312786256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:43.435728 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.435629    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 17:28:43.435728 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.435667    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:28:51.435656168 +0000 UTC m=+227.312857349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : secret "router-metrics-certs-default" not found
Jul 27 17:28:43.838544 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.838503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:43.838722 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:43.838568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:43.838722 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.838671    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:43.838818 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.838717    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:43.838818 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.838750    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.838734021 +0000 UTC m=+223.715935205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:43.838818 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:43.838780    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.838767016 +0000 UTC m=+223.715968202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:44.017551 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:44.017514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmw22_335afd52-e9d8-4d26-8c0c-512dceb352d1/serve-healthcheck-canary/0.log"
Jul 27 17:28:44.109342 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:44.109259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:46.197140 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:46.197104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:46.350075 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:46.350043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:46.450382 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:46.450305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:46.552655 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:46.552620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:46.674339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:46.674308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:47.506779 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:47.506731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:47.868026 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:47.867939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:47.868026 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:47.867987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:47.868270 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:47.868094    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:47.868270 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:47.868097    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.868270 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:47.868144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.868131093 +0000 UTC m=+231.745332278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:47.868270 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:47.868156    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.868150547 +0000 UTC m=+231.745351727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.904841 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:47.904803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:48.107379 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:48.107340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:48.301154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:48.301120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:48.498812 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:48.498781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:49.612463 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:49.612431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:49.715308 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:49.715277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:51.300553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.300521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:51.361304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.361274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:51.496045 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.496012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:51.496234 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.496065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:51.496234 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:51.496205    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle podName:0ce634e7-417d-4faa-a18a-a438c885cdee nodeName:}" failed. No retries permitted until 2026-07-27 17:29:07.496167837 +0000 UTC m=+243.373369034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle") pod "router-default-56f7bb7d55-jnrhm" (UID: "0ce634e7-417d-4faa-a18a-a438c885cdee") : configmap references non-existent config key: service-ca.crt
Jul 27 17:28:51.498447 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.498417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce634e7-417d-4faa-a18a-a438c885cdee-metrics-certs\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:28:51.502211 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.502165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:51.731434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:51.731404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:52.101765 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:52.101677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:52.320402 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:52.320366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:52.715031 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:52.715002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:52.785317 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:52.785285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:53.293900 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:53.293872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:53.366855 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:53.366825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:55.392961 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.392923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:55.493958 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.493926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:55.721958 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.721933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:55.926081 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.926050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:55.926274 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.926104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:55.926274 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:55.926208    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.926274 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:28:55.926271    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls podName:79cd464c-763c-433f-9cd8-41d51bee8c4f nodeName:}" failed. No retries permitted until 2026-07-27 17:29:11.926253022 +0000 UTC m=+247.803454231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9wtms" (UID: "79cd464c-763c-433f-9cd8-41d51bee8c4f") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.926669 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:55.926647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79cd464c-763c-433f-9cd8-41d51bee8c4f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:28:56.100854 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:56.100785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:56.229525 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:56.229496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.041312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.041279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.141937 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.141909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.472154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.472128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.575547 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.575521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.677577 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.677552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.778358 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.778294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.879954 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.879927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:57.943675 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:57.943653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:58.478270 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:58.478240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:58.676541 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:58.676511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:59.058966 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:59.058937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:59.306636 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:59.306604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:59.363095 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:28:59.363027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:05.243240 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.243200    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2pcpb"]
Jul 27 17:29:05.245601 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.245581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:05.248440 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.248419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 17:29:05.248552 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.248516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 17:29:05.248552 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.248527    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lct8n\""
Jul 27 17:29:05.260029 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.260010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2pcpb"]
Jul 27 17:29:05.289500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.289472    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c5d887dd-8v7lc"]
Jul 27 17:29:05.291782 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.291760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.295429 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.295403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krhk5\" (UniqueName: \"kubernetes.io/projected/a8615566-8810-49d9-b404-b1ff4f4783db-kube-api-access-krhk5\") pod \"downloads-7c97dc4555-2pcpb\" (UID: \"a8615566-8810-49d9-b404-b1ff4f4783db\") " pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:05.298709 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.298688    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 17:29:05.298809 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.298723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 17:29:05.298809 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.298696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 17:29:05.299105 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.299083    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krvhz\""
Jul 27 17:29:05.305810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.305791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 17:29:05.312649 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.312630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c5d887dd-8v7lc"]
Jul 27 17:29:05.324280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.324259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:05.396287 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8fc8\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-kube-api-access-j8fc8\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396426 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-trusted-ca\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396426 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-installation-pull-secrets\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396426 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-bound-sa-token\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krhk5\" (UniqueName: \"kubernetes.io/projected/a8615566-8810-49d9-b404-b1ff4f4783db-kube-api-access-krhk5\") pod \"downloads-7c97dc4555-2pcpb\" (UID: \"a8615566-8810-49d9-b404-b1ff4f4783db\") " pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:05.396543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-ca-trust-extracted\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-image-registry-private-configuration\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-tls\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.396635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.396570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-certificates\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.410262 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.410241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krhk5\" (UniqueName: \"kubernetes.io/projected/a8615566-8810-49d9-b404-b1ff4f4783db-kube-api-access-krhk5\") pod \"downloads-7c97dc4555-2pcpb\" (UID: \"a8615566-8810-49d9-b404-b1ff4f4783db\") " pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:05.423320 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.423279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:05.497719 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-installation-pull-secrets\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497719 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-bound-sa-token\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-ca-trust-extracted\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-image-registry-private-configuration\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-tls\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-certificates\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.497933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8fc8\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-kube-api-access-j8fc8\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.498171 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.497950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-trusted-ca\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.498268 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.498252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-ca-trust-extracted\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.498933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.498909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-trusted-ca\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.499025 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.498968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-certificates\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.500127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.500106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-installation-pull-secrets\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.500318 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.500302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-image-registry-private-configuration\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.500364 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.500316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-registry-tls\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.507421 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.507390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-bound-sa-token\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.507844 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.507827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8fc8\" (UniqueName: \"kubernetes.io/projected/b2fa5ad5-3440-4524-b71d-a8a7e24d021c-kube-api-access-j8fc8\") pod \"image-registry-67c5d887dd-8v7lc\" (UID: \"b2fa5ad5-3440-4524-b71d-a8a7e24d021c\") " pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.541717 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.541696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:05.554758 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.554737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:05.600217 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.600170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:05.685295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.685267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2pcpb"]
Jul 27 17:29:05.687607 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:05.687580    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8615566_8810_49d9_b404_b1ff4f4783db.slice/crio-ade917fd5b99e6301147217674cb70f6e916dfb860f4f10f9a7697d4ca6fb616 WatchSource:0}: Error finding container ade917fd5b99e6301147217674cb70f6e916dfb860f4f10f9a7697d4ca6fb616: Status 404 returned error can't find the container with id ade917fd5b99e6301147217674cb70f6e916dfb860f4f10f9a7697d4ca6fb616
Jul 27 17:29:05.728398 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:05.728373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c5d887dd-8v7lc"]
Jul 27 17:29:05.730739 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:05.730706    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2fa5ad5_3440_4524_b71d_a8a7e24d021c.slice/crio-1a8a953b9e0fd9b73774e523722395068274f9554a22d2d296106340707b7c85 WatchSource:0}: Error finding container 1a8a953b9e0fd9b73774e523722395068274f9554a22d2d296106340707b7c85: Status 404 returned error can't find the container with id 1a8a953b9e0fd9b73774e523722395068274f9554a22d2d296106340707b7c85
Jul 27 17:29:06.359964 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.359925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2pcpb" event={"ID":"a8615566-8810-49d9-b404-b1ff4f4783db","Type":"ContainerStarted","Data":"ade917fd5b99e6301147217674cb70f6e916dfb860f4f10f9a7697d4ca6fb616"}
Jul 27 17:29:06.361684 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.361659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc" event={"ID":"b2fa5ad5-3440-4524-b71d-a8a7e24d021c","Type":"ContainerStarted","Data":"76c3e6ffc427d594a6d5ed48844d9619b6fbd96bea0f915fbd0521db6a710726"}
Jul 27 17:29:06.361824 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.361696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc" event={"ID":"b2fa5ad5-3440-4524-b71d-a8a7e24d021c","Type":"ContainerStarted","Data":"1a8a953b9e0fd9b73774e523722395068274f9554a22d2d296106340707b7c85"}
Jul 27 17:29:06.361824 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.361804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:06.381003 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.380957    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc" podStartSLOduration=1.3809379179999999 podStartE2EDuration="1.380937918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:06.379943786 +0000 UTC m=+242.257144996" watchObservedRunningTime="2026-07-27 17:29:06.380937918 +0000 UTC m=+242.258139122"
Jul 27 17:29:06.497001 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.496964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:06.595214 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:06.595166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:07.518216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:07.518149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:07.519454 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:07.519428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce634e7-417d-4faa-a18a-a438c885cdee-service-ca-bundle\") pod \"router-default-56f7bb7d55-jnrhm\" (UID: \"0ce634e7-417d-4faa-a18a-a438c885cdee\") " pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:07.786903 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:07.786831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8wcgg\""
Jul 27 17:29:07.794462 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:07.794427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:07.923277 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:07.923253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f7bb7d55-jnrhm"]
Jul 27 17:29:07.925967 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:07.925937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce634e7_417d_4faa_a18a_a438c885cdee.slice/crio-88d44ebaeb69f9a283aabfb7520c112f4e1e0537dd450eed4ed044af9a17bb93 WatchSource:0}: Error finding container 88d44ebaeb69f9a283aabfb7520c112f4e1e0537dd450eed4ed044af9a17bb93: Status 404 returned error can't find the container with id 88d44ebaeb69f9a283aabfb7520c112f4e1e0537dd450eed4ed044af9a17bb93
Jul 27 17:29:08.333502 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.333472    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:08.335813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.335792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.338651 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.338630    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 17:29:08.338877 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.338857    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 17:29:08.338981 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.338899    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 17:29:08.338981 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.338960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 17:29:08.339096 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.338961    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfkjx\""
Jul 27 17:29:08.339988 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.339969    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 17:29:08.346765 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.346744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:08.370357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.370330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm" event={"ID":"0ce634e7-417d-4faa-a18a-a438c885cdee","Type":"ContainerStarted","Data":"03d203e6619dab16c2b4ffd3670e9c5c636a3278a0b19bbd3e369dffe5546a1e"}
Jul 27 17:29:08.370476 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.370370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm" event={"ID":"0ce634e7-417d-4faa-a18a-a438c885cdee","Type":"ContainerStarted","Data":"88d44ebaeb69f9a283aabfb7520c112f4e1e0537dd450eed4ed044af9a17bb93"}
Jul 27 17:29:08.390946 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.390898    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm" podStartSLOduration=33.39086906 podStartE2EDuration="33.39086906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:08.390752837 +0000 UTC m=+244.267954041" watchObservedRunningTime="2026-07-27 17:29:08.39086906 +0000 UTC m=+244.268070282"
Jul 27 17:29:08.426502 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.426610 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.426610 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.426731 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.426788 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.426788 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.426759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbncl\" (UniqueName: \"kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527488 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527947 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527947 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbncl\" (UniqueName: \"kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527947 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527947 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.527947 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.527687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.528337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.528310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.528411 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.528340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.528635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.528613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.530456 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.530434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.530622 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.530600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.537051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.537028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbncl\" (UniqueName: \"kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl\") pod \"console-5598f6b6b8-qclpc\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") " pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.647497 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.647428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:08.785311 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.785282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:08.789567 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:08.789529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426d88c2_75fe_41af_9930_0d4a8a93d88b.slice/crio-d919aa5a9807a3bd21661c50c01d1a5914b7f2725145597cc7a5742013229a1f WatchSource:0}: Error finding container d919aa5a9807a3bd21661c50c01d1a5914b7f2725145597cc7a5742013229a1f: Status 404 returned error can't find the container with id d919aa5a9807a3bd21661c50c01d1a5914b7f2725145597cc7a5742013229a1f
Jul 27 17:29:08.795412 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.795388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:08.799436 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:08.799413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:09.374733 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.374696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f6b6b8-qclpc" event={"ID":"426d88c2-75fe-41af-9930-0d4a8a93d88b","Type":"ContainerStarted","Data":"d919aa5a9807a3bd21661c50c01d1a5914b7f2725145597cc7a5742013229a1f"}
Jul 27 17:29:09.375139 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.375119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:09.376454 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.376433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56f7bb7d55-jnrhm"
Jul 27 17:29:09.733409 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.733376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:09.897838 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.897805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:09.905901 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.905876    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"]
Jul 27 17:29:09.908703 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.908685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:09.911688 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.911668    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 17:29:09.911810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.911673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jgfph\""
Jul 27 17:29:09.918695 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.918673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"]
Jul 27 17:29:09.941534 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:09.941512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r4rq7\" (UID: \"cd29043e-6628-4eeb-930c-1daf0ece3674\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:10.042401 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.042312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r4rq7\" (UID: \"cd29043e-6628-4eeb-930c-1daf0ece3674\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:10.042564 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:10.042451    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 17:29:10.042564 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:10.042531    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates podName:cd29043e-6628-4eeb-930c-1daf0ece3674 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:10.542501641 +0000 UTC m=+246.419702827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-r4rq7" (UID: "cd29043e-6628-4eeb-930c-1daf0ece3674") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 17:29:10.147542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.147508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:10.547358 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.547319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r4rq7\" (UID: \"cd29043e-6628-4eeb-930c-1daf0ece3674\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:10.550108 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.550086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd29043e-6628-4eeb-930c-1daf0ece3674-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r4rq7\" (UID: \"cd29043e-6628-4eeb-930c-1daf0ece3674\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:10.819826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.819752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:10.953500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:10.953478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"]
Jul 27 17:29:10.955498 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:10.955468    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd29043e_6628_4eeb_930c_1daf0ece3674.slice/crio-56b32df53676a7f23679db98412b5bd4a23b52719a86960785380122d47b0119 WatchSource:0}: Error finding container 56b32df53676a7f23679db98412b5bd4a23b52719a86960785380122d47b0119: Status 404 returned error can't find the container with id 56b32df53676a7f23679db98412b5bd4a23b52719a86960785380122d47b0119
Jul 27 17:29:11.383411 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:11.383368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7" event={"ID":"cd29043e-6628-4eeb-930c-1daf0ece3674","Type":"ContainerStarted","Data":"56b32df53676a7f23679db98412b5bd4a23b52719a86960785380122d47b0119"}
Jul 27 17:29:11.959339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:11.959299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:29:11.961939 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:11.961907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79cd464c-763c-433f-9cd8-41d51bee8c4f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9wtms\" (UID: \"79cd464c-763c-433f-9cd8-41d51bee8c4f\") " pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:29:12.154420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:12.154389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 17:29:12.162022 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:12.161999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9wtms"
Jul 27 17:29:12.311663 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:12.311573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9wtms"]
Jul 27 17:29:12.315732 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:12.315704    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cd464c_763c_433f_9cd8_41d51bee8c4f.slice/crio-fa1d1366646fa42959331b77ac534348fdfb3d078b38eb6bbc63e649a92cae70 WatchSource:0}: Error finding container fa1d1366646fa42959331b77ac534348fdfb3d078b38eb6bbc63e649a92cae70: Status 404 returned error can't find the container with id fa1d1366646fa42959331b77ac534348fdfb3d078b38eb6bbc63e649a92cae70
Jul 27 17:29:12.389283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:12.389250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9wtms" event={"ID":"79cd464c-763c-433f-9cd8-41d51bee8c4f","Type":"ContainerStarted","Data":"fa1d1366646fa42959331b77ac534348fdfb3d078b38eb6bbc63e649a92cae70"}
Jul 27 17:29:14.401652 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:14.401613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7" event={"ID":"cd29043e-6628-4eeb-930c-1daf0ece3674","Type":"ContainerStarted","Data":"62a1fce128307e64aceeee535ee8dc6fe11035db064d5903c0cb8cce6bfb4167"}
Jul 27 17:29:14.402445 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:14.402424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:14.408939 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:14.408898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7"
Jul 27 17:29:14.421753 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:14.421569    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r4rq7" podStartSLOduration=2.990942249 podStartE2EDuration="5.421550488s" totalImagesPullingTime="2.430608239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:14.420827391 +0000 UTC m=+250.298028619" watchObservedRunningTime="2026-07-27 17:29:14.421550488 +0000 UTC m=+250.298751672"
Jul 27 17:29:14.963223 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:14.963158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:15.062044 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.061946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:15.279620 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.279508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:15.389719 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.389686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:29:15.396618 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.396571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c8d5e98-89f9-48c7-82ba-5890a826d740-metrics-certs\") pod \"network-metrics-daemon-qpxwg\" (UID: \"8c8d5e98-89f9-48c7-82ba-5890a826d740\") " pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:29:15.466687 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.466514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:29:15.474253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:15.474225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpxwg"
Jul 27 17:29:16.114142 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.114015    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:29:16.120315 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.120263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:16.123039 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.123020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.138085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.137970    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:29:16.142336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.142309    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 17:29:16.187626 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.187590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:16.197916 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.197887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.197927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.197954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.197980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.198009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198059 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.198026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbfh\" (UniqueName: \"kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.198345 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.198088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299256 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299256 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbfh\" (UniqueName: \"kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.299506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.299494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.300027 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.300001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.300150 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.300080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.300301 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.300280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.300489 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.300442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.302205 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.302169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.302588 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.302569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.308301 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.308280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbfh\" (UniqueName: \"kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh\") pod \"console-8484ccdb94-m5d4k\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") " pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.442048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.442010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:16.515580 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.515545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:16.608019 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:16.607990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:18.493134 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:18.493099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:18.621995 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:18.621950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:18.746825 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:18.746748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:18.855106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:18.855069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:19.104749 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:19.104675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:19.180832 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:19.180795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:19.859149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:19.859118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.134826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.134792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.229275 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.229234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.329617 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.329580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.356169 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.356139    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"]
Jul 27 17:29:22.359119 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.359093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.361952 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.361919    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 17:29:22.362084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.362028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 17:29:22.362084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.362074    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 17:29:22.362280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.362262    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 17:29:22.363752 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.363730    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 17:29:22.363909 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.363872    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-crkbl\""
Jul 27 17:29:22.372515 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.372497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"]
Jul 27 17:29:22.410221 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.410129    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95ccz"]
Jul 27 17:29:22.414374 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.414346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.417717 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.417693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6csp\""
Jul 27 17:29:22.418044 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.417979    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 17:29:22.418502 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.418482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 17:29:22.418604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.418544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 17:29:22.433348 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.433312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.455313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.455290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfn6\" (UniqueName: \"kubernetes.io/projected/68d7ce48-694c-4081-b524-73d260ce3754-kube-api-access-7bfn6\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.455436 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.455356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d7ce48-694c-4081-b524-73d260ce3754-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.455436 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.455417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.455549 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.455467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.556653 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.556653 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-root\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.556886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.556886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d7ce48-694c-4081-b524-73d260ce3754-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.556886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.556886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.556886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-wtmp\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.556988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv6tz\" (UniqueName: \"kubernetes.io/projected/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-kube-api-access-bv6tz\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:22.557008    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.557059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-sys\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:22.557088    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls podName:68d7ce48-694c-4081-b524-73d260ce3754 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:23.057065399 +0000 UTC m=+258.934266585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-4md5p" (UID: "68d7ce48-694c-4081-b524-73d260ce3754") : secret "openshift-state-metrics-tls" not found
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.557130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-textfile\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.557168 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.557162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfn6\" (UniqueName: \"kubernetes.io/projected/68d7ce48-694c-4081-b524-73d260ce3754-kube-api-access-7bfn6\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.557600 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.557206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-metrics-client-ca\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.557600 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.557557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68d7ce48-694c-4081-b524-73d260ce3754-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.559400 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.559374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.579544 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.579517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfn6\" (UniqueName: \"kubernetes.io/projected/68d7ce48-694c-4081-b524-73d260ce3754-kube-api-access-7bfn6\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:22.607363 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.607333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.658460 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-sys\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-textfile\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-metrics-client-ca\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-sys\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-root\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-root\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-wtmp\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.658813 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:22.658801    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:22.659076 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-textfile\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.659076 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.658804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv6tz\" (UniqueName: \"kubernetes.io/projected/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-kube-api-access-bv6tz\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.659076 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:22.658870    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls podName:97cc0934-7822-4d26-b7ca-e31c2b46d7b1 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:23.158849702 +0000 UTC m=+259.036050884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls") pod "node-exporter-95ccz" (UID: "97cc0934-7822-4d26-b7ca-e31c2b46d7b1") : secret "node-exporter-tls" not found
Jul 27 17:29:22.659241 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.659115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-wtmp\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.659241 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.659226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-metrics-client-ca\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.659330 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.659228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.661253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.661172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.669902 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.669797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv6tz\" (UniqueName: \"kubernetes.io/projected/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-kube-api-access-bv6tz\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:22.704491 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.704461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.806333 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.806292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:22.914300 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:22.914219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:23.014896 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.014848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:23.062898 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.062861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:23.065584 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.065558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/68d7ce48-694c-4081-b524-73d260ce3754-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4md5p\" (UID: \"68d7ce48-694c-4081-b524-73d260ce3754\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:23.163922 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.163884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:23.164346 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:23.164051    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:23.164346 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:23.164132    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls podName:97cc0934-7822-4d26-b7ca-e31c2b46d7b1 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:24.164110294 +0000 UTC m=+260.041311480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls") pod "node-exporter-95ccz" (UID: "97cc0934-7822-4d26-b7ca-e31c2b46d7b1") : secret "node-exporter-tls" not found
Jul 27 17:29:23.270060 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.270033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"
Jul 27 17:29:23.837690 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:23.837657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:24.175094 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:24.175003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:24.177739 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:24.177709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97cc0934-7822-4d26-b7ca-e31c2b46d7b1-node-exporter-tls\") pod \"node-exporter-95ccz\" (UID: \"97cc0934-7822-4d26-b7ca-e31c2b46d7b1\") " pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:24.225858 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:24.225831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95ccz"
Jul 27 17:29:25.147295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.147263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpxwg"]
Jul 27 17:29:25.338117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.338030    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58b84688bb-v5x9t"]
Jul 27 17:29:25.341739 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.341717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.344814 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.344773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 17:29:25.344814 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.344785    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 17:29:25.344955 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.344838    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5nw8p\""
Jul 27 17:29:25.344955 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.344908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 17:29:25.345173 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.345120    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 17:29:25.345173 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.345132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 17:29:25.345327 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.345200    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-h7uucpq3k25c\""
Jul 27 17:29:25.352769 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.352748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58b84688bb-v5x9t"]
Jul 27 17:29:25.367885 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.367863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:25.375858 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:25.375832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8d5e98_89f9_48c7_82ba_5890a826d740.slice/crio-5246a8fdff0876967f6ff9cbce6ad6de22aa784ca1f2bf39000ca9c5717b4187 WatchSource:0}: Error finding container 5246a8fdff0876967f6ff9cbce6ad6de22aa784ca1f2bf39000ca9c5717b4187: Status 404 returned error can't find the container with id 5246a8fdff0876967f6ff9cbce6ad6de22aa784ca1f2bf39000ca9c5717b4187
Jul 27 17:29:25.450441 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.450158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95ccz" event={"ID":"97cc0934-7822-4d26-b7ca-e31c2b46d7b1","Type":"ContainerStarted","Data":"09f597797792c1630422dc13b225a9521300683c6e07916eceabc259e941bdb1"}
Jul 27 17:29:25.451618 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.451555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpxwg" event={"ID":"8c8d5e98-89f9-48c7-82ba-5890a826d740","Type":"ContainerStarted","Data":"5246a8fdff0876967f6ff9cbce6ad6de22aa784ca1f2bf39000ca9c5717b4187"}
Jul 27 17:29:25.475530 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.475475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:25.486016 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.485985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486138 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crq4t\" (UniqueName: \"kubernetes.io/projected/2566563d-8a96-4c4c-a8b6-5a8467c0773a-kube-api-access-crq4t\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486138 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2566563d-8a96-4c4c-a8b6-5a8467c0773a-metrics-client-ca\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486284 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486284 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-grpc-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.486395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.486386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.526253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.526169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p"]
Jul 27 17:29:25.547337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.547193    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:29:25.551582 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:25.551547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e30453_6f21_4b90_bf84_e041c9cb507e.slice/crio-8fe2daec066d3e355131a8a67a4ef82dd560bf77380d73c6f0420918981add90 WatchSource:0}: Error finding container 8fe2daec066d3e355131a8a67a4ef82dd560bf77380d73c6f0420918981add90: Status 404 returned error can't find the container with id 8fe2daec066d3e355131a8a67a4ef82dd560bf77380d73c6f0420918981add90
Jul 27 17:29:25.587564 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.587564 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.587564 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.587782 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.587891 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crq4t\" (UniqueName: \"kubernetes.io/projected/2566563d-8a96-4c4c-a8b6-5a8467c0773a-kube-api-access-crq4t\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.588088 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.587937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2566563d-8a96-4c4c-a8b6-5a8467c0773a-metrics-client-ca\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.588088 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.588022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.588088 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.588055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-grpc-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.592085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.591902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.594231 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.594153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2566563d-8a96-4c4c-a8b6-5a8467c0773a-metrics-client-ca\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.594611 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.594558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.594611 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.594596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.594914 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.594641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.595306 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.595283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.595995 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.595976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2566563d-8a96-4c4c-a8b6-5a8467c0773a-secret-grpc-tls\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.598937 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.598912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crq4t\" (UniqueName: \"kubernetes.io/projected/2566563d-8a96-4c4c-a8b6-5a8467c0773a-kube-api-access-crq4t\") pod \"thanos-querier-58b84688bb-v5x9t\" (UID: \"2566563d-8a96-4c4c-a8b6-5a8467c0773a\") " pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.605411 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.605366    2564 patch_prober.go:28] interesting pod/image-registry-67c5d887dd-8v7lc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 17:29:25.605506 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.605422    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc" podUID="b2fa5ad5-3440-4524-b71d-a8a7e24d021c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:29:25.655595 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.655536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:25.837453 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:25.837333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58b84688bb-v5x9t"]
Jul 27 17:29:25.845406 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:25.844811    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2566563d_8a96_4c4c_a8b6_5a8467c0773a.slice/crio-66f1c2d4048c2726355cf5eabaf81eeef5f9fc5820fbf0814d645a79dddf1f60 WatchSource:0}: Error finding container 66f1c2d4048c2726355cf5eabaf81eeef5f9fc5820fbf0814d645a79dddf1f60: Status 404 returned error can't find the container with id 66f1c2d4048c2726355cf5eabaf81eeef5f9fc5820fbf0814d645a79dddf1f60
Jul 27 17:29:26.097397 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.097254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:26.158039 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.157928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:26.239386 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.239311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:26.343657 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.343490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:26.463110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.463044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2pcpb" event={"ID":"a8615566-8810-49d9-b404-b1ff4f4783db","Type":"ContainerStarted","Data":"a73096ffd357451342170166884299ecc8dc5cffa7de7b01124a18106810e2a9"}
Jul 27 17:29:26.464457 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.464397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:26.466275 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.466246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8484ccdb94-m5d4k" event={"ID":"a0e30453-6f21-4b90-bf84-e041c9cb507e","Type":"ContainerStarted","Data":"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"}
Jul 27 17:29:26.466404 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.466295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8484ccdb94-m5d4k" event={"ID":"a0e30453-6f21-4b90-bf84-e041c9cb507e","Type":"ContainerStarted","Data":"8fe2daec066d3e355131a8a67a4ef82dd560bf77380d73c6f0420918981add90"}
Jul 27 17:29:26.468705 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.468675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"66f1c2d4048c2726355cf5eabaf81eeef5f9fc5820fbf0814d645a79dddf1f60"}
Jul 27 17:29:26.472754 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.472311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f6b6b8-qclpc" event={"ID":"426d88c2-75fe-41af-9930-0d4a8a93d88b","Type":"ContainerStarted","Data":"b8c81b125808f50367022ea3264a735ea04e28c38774fde9c049d91252f841d4"}
Jul 27 17:29:26.476312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.475819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p" event={"ID":"68d7ce48-694c-4081-b524-73d260ce3754","Type":"ContainerStarted","Data":"a3dc7d4ccfaf7aa4ae4d92a73def0e580c3e36813cbfed17587b2d0076694015"}
Jul 27 17:29:26.476312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.475872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p" event={"ID":"68d7ce48-694c-4081-b524-73d260ce3754","Type":"ContainerStarted","Data":"dcea064d50cb4ff7d77cec11db5550580ccd7754632e7d3b4852777b6edcaf16"}
Jul 27 17:29:26.476312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.475899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p" event={"ID":"68d7ce48-694c-4081-b524-73d260ce3754","Type":"ContainerStarted","Data":"e118feff3c97dc85eb457a09ac0a3f0c3cdd74824e4abb02dbf500b8a90c7c53"}
Jul 27 17:29:26.478619 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.478597    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2pcpb"
Jul 27 17:29:26.479121 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.479057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9wtms" event={"ID":"79cd464c-763c-433f-9cd8-41d51bee8c4f","Type":"ContainerStarted","Data":"e0081f5b238fa039abecfa7142fa0adc81d3632fc972b2e72f94e73c4d6b467e"}
Jul 27 17:29:26.488022 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.487901    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2pcpb" podStartSLOduration=1.804857983 podStartE2EDuration="21.487883655s" totalImagesPullingTime="19.683025672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:26.487559007 +0000 UTC m=+262.364760211" watchObservedRunningTime="2026-07-27 17:29:26.487883655 +0000 UTC m=+262.365084850"
Jul 27 17:29:26.506418 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.506362    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8484ccdb94-m5d4k" podStartSLOduration=10.506333961 podStartE2EDuration="10.506333961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:26.505364492 +0000 UTC m=+262.382565692" watchObservedRunningTime="2026-07-27 17:29:26.506333961 +0000 UTC m=+262.383535168"
Jul 27 17:29:26.543562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.543500    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5598f6b6b8-qclpc" podStartSLOduration=2.317753607 podStartE2EDuration="18.54347826s" totalImagesPullingTime="16.225724653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:26.542974846 +0000 UTC m=+262.420176063" watchObservedRunningTime="2026-07-27 17:29:26.54347826 +0000 UTC m=+262.420679464"
Jul 27 17:29:26.759695 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.759608    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75d44bd6f4-wcb58"]
Jul 27 17:29:26.795899 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.795291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75d44bd6f4-wcb58"]
Jul 27 17:29:26.795899 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.795408    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.800757 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.800203    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 17:29:26.800757 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.800433    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 17:29:26.803907 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.803132    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 17:29:26.803907 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.803234    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 17:29:26.803907 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.803413    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vk6sr\""
Jul 27 17:29:26.813649 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.813478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-30b4evbj4fi53\""
Jul 27 17:29:26.901951 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.901877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-client-certs\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-metrics-server-audit-profiles\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fdd0eaed-1f17-4c98-a182-40a597e84c6f-audit-log\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhjw4\" (UniqueName: \"kubernetes.io/projected/fdd0eaed-1f17-4c98-a182-40a597e84c6f-kube-api-access-zhjw4\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-tls\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-client-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:26.902553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:26.902466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fdd0eaed-1f17-4c98-a182-40a597e84c6f-audit-log\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhjw4\" (UniqueName: \"kubernetes.io/projected/fdd0eaed-1f17-4c98-a182-40a597e84c6f-kube-api-access-zhjw4\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-tls\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-client-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-client-certs\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.003542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-metrics-server-audit-profiles\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.004597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-metrics-server-audit-profiles\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.005543 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.004869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fdd0eaed-1f17-4c98-a182-40a597e84c6f-audit-log\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.006126 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.006067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd0eaed-1f17-4c98-a182-40a597e84c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.008905 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.008846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-tls\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.010843 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.010546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-client-ca-bundle\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.010843 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.010788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fdd0eaed-1f17-4c98-a182-40a597e84c6f-secret-metrics-server-client-certs\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.023763 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.023714    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhjw4\" (UniqueName: \"kubernetes.io/projected/fdd0eaed-1f17-4c98-a182-40a597e84c6f-kube-api-access-zhjw4\") pod \"metrics-server-75d44bd6f4-wcb58\" (UID: \"fdd0eaed-1f17-4c98-a182-40a597e84c6f\") " pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.115356 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.115025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:27.139668 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.139601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:27.144532 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.144469    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:27.173905 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.172490    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"]
Jul 27 17:29:27.190206 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.190060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.190746 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.190570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"]
Jul 27 17:29:27.195311 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.194830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lmq4q\""
Jul 27 17:29:27.195311 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.195086    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 17:29:27.238717 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.238624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:27.306826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.306748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hjff\" (UniqueName: \"kubernetes.io/projected/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-kube-api-access-9hjff\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.306826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.306801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.371834 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.370965    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67c5d887dd-8v7lc"
Jul 27 17:29:27.407814 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.407770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hjff\" (UniqueName: \"kubernetes.io/projected/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-kube-api-access-9hjff\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.407976 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.407826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.408055 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:27.407987    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 17:29:27.408055 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:27.408048    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert podName:7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed nodeName:}" failed. No retries permitted until 2026-07-27 17:29:27.908028115 +0000 UTC m=+263.785229316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-g67jp" (UID: "7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed") : secret "monitoring-plugin-cert" not found
Jul 27 17:29:27.423458 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.423399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hjff\" (UniqueName: \"kubernetes.io/projected/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-kube-api-access-9hjff\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.521313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.521277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:27.599317 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.599233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:27.914876 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.914655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:27.920153 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:27.920104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-g67jp\" (UID: \"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:28.098899 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:28.098811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:28.105909 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:28.105880    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:28.216212 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:28.216157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:28.607915 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:28.607806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:28.648087 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:28.647988    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:30.321176 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:30.320985    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75d44bd6f4-wcb58"]
Jul 27 17:29:31.077696 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:31.077660    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd0eaed_1f17_4c98_a182_40a597e84c6f.slice/crio-8afaa17f50314f402be8a22aa8c1487b78d4f84750b568dc723ca4a08a59428c WatchSource:0}: Error finding container 8afaa17f50314f402be8a22aa8c1487b78d4f84750b568dc723ca4a08a59428c: Status 404 returned error can't find the container with id 8afaa17f50314f402be8a22aa8c1487b78d4f84750b568dc723ca4a08a59428c
Jul 27 17:29:31.512306 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:31.512260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58" event={"ID":"fdd0eaed-1f17-4c98-a182-40a597e84c6f","Type":"ContainerStarted","Data":"8afaa17f50314f402be8a22aa8c1487b78d4f84750b568dc723ca4a08a59428c"}
Jul 27 17:29:32.499998 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:32.499974    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"]
Jul 27 17:29:32.505168 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:32.505123    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0e5989_882e_44c2_8b4b_d87b9f8fd2ed.slice/crio-af4c116fed47d136030635c105ac0fcec0c1c06731d2168e4724a9b6e141ecd4 WatchSource:0}: Error finding container af4c116fed47d136030635c105ac0fcec0c1c06731d2168e4724a9b6e141ecd4: Status 404 returned error can't find the container with id af4c116fed47d136030635c105ac0fcec0c1c06731d2168e4724a9b6e141ecd4
Jul 27 17:29:32.520395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:32.520293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp" event={"ID":"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed","Type":"ContainerStarted","Data":"af4c116fed47d136030635c105ac0fcec0c1c06731d2168e4724a9b6e141ecd4"}
Jul 27 17:29:32.522987 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:32.522928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95ccz" event={"ID":"97cc0934-7822-4d26-b7ca-e31c2b46d7b1","Type":"ContainerStarted","Data":"18827cd17f3543adaedef3e22e115fd9b397e7dfb76ebcdd27a458c965cc940a"}
Jul 27 17:29:33.531032 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.530913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpxwg" event={"ID":"8c8d5e98-89f9-48c7-82ba-5890a826d740","Type":"ContainerStarted","Data":"458df53996ba7e235423094c9eae5a33f0d61ad54816a17c178f88980f460266"}
Jul 27 17:29:33.531718 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.531687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpxwg" event={"ID":"8c8d5e98-89f9-48c7-82ba-5890a826d740","Type":"ContainerStarted","Data":"918c22b9794ba7ef60780eedd202628ca0a874504da96fb4f514ac38d9471441"}
Jul 27 17:29:33.534365 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.534333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"994eabe196c4b02a6a330eaa2e2c76d8db01e3138b179458fae5ef25b51d7f6d"}
Jul 27 17:29:33.534539 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.534414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"9a62ce84e73d2265db4c5d0b82803b77a7482e3c6b5e3f93c4c4e53008b85077"}
Jul 27 17:29:33.534539 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.534456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"95eaebfa42416a9f331e9cb203833cac942025555073502f04daa61b8d0975cd"}
Jul 27 17:29:33.537907 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.537842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p" event={"ID":"68d7ce48-694c-4081-b524-73d260ce3754","Type":"ContainerStarted","Data":"3b1becb59f029e0b5a3b5abf7e6ad91f8c16c43c4a80f38483a1d9e6e2957c79"}
Jul 27 17:29:33.540495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.540467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9wtms" event={"ID":"79cd464c-763c-433f-9cd8-41d51bee8c4f","Type":"ContainerStarted","Data":"cfcf80bd6f29719f760a10c38a26e3f668a4b4a208897a5138a29cab376e5ef3"}
Jul 27 17:29:33.542434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.542408    2564 generic.go:356] "Generic (PLEG): container finished" podID="97cc0934-7822-4d26-b7ca-e31c2b46d7b1" containerID="18827cd17f3543adaedef3e22e115fd9b397e7dfb76ebcdd27a458c965cc940a" exitCode=0
Jul 27 17:29:33.542727 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.542437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95ccz" event={"ID":"97cc0934-7822-4d26-b7ca-e31c2b46d7b1","Type":"ContainerDied","Data":"18827cd17f3543adaedef3e22e115fd9b397e7dfb76ebcdd27a458c965cc940a"}
Jul 27 17:29:33.549625 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.549341    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qpxwg" podStartSLOduration=262.856228703 podStartE2EDuration="4m28.549325019s" totalImagesPullingTime="5.693096316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:33.54827275 +0000 UTC m=+269.425473960" watchObservedRunningTime="2026-07-27 17:29:33.549325019 +0000 UTC m=+269.426526222"
Jul 27 17:29:33.589614 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.589558    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4md5p" podStartSLOduration=4.924513288 podStartE2EDuration="11.589543211s" totalImagesPullingTime="6.665029923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:33.588828607 +0000 UTC m=+269.466029811" watchObservedRunningTime="2026-07-27 17:29:33.589543211 +0000 UTC m=+269.466744413"
Jul 27 17:29:33.668903 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.668863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:33.765372 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:33.765333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:35.554757 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.554678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95ccz" event={"ID":"97cc0934-7822-4d26-b7ca-e31c2b46d7b1","Type":"ContainerStarted","Data":"a2020dcc0c2943db5476e81689cc77bb7a8f2512faa19a403217306c26819fe4"}
Jul 27 17:29:35.554757 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.554744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95ccz" event={"ID":"97cc0934-7822-4d26-b7ca-e31c2b46d7b1","Type":"ContainerStarted","Data":"21b855def5918947c47ddd9501bfe1fa7558d674c9e15229736f6f743be9b6c1"}
Jul 27 17:29:35.558446 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.558416    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"4d2f5a5a914d85d4323165f385763da1869dfaaa7642f109b2c7a632bc94b145"}
Jul 27 17:29:35.558559 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.558489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"18dc559500991468feb65e3a21b2c34edabcea9a675b68bff240f621f97fb0ae"}
Jul 27 17:29:35.558559 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.558542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:35.558676 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.558583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" event={"ID":"2566563d-8a96-4c4c-a8b6-5a8467c0773a","Type":"ContainerStarted","Data":"37b6c3c51790cf4022605b2b858b95f2fe42fbfaeafb3df19e36d5be718cb7af"}
Jul 27 17:29:35.565681 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.560325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58" event={"ID":"fdd0eaed-1f17-4c98-a182-40a597e84c6f","Type":"ContainerStarted","Data":"a50f05555059b46fe58caa5832001fcea23dc1022889b1e6399f1266ff3f26e2"}
Jul 27 17:29:35.565681 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.565362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp" event={"ID":"7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed","Type":"ContainerStarted","Data":"037cd4b0ab4c2bbc9a5d16cf0e4289654a08e7ec4c709cb11103bac4cfca9eaf"}
Jul 27 17:29:35.565858 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.565741    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:35.571887 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.571867    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp"
Jul 27 17:29:35.579077 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.579030    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95ccz" podStartSLOduration=6.72028517 podStartE2EDuration="13.579017074s" totalImagesPullingTime="6.731558202s" totalInitContainerRuntime="127.173702ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:35.577500421 +0000 UTC m=+271.454701626" watchObservedRunningTime="2026-07-27 17:29:35.579017074 +0000 UTC m=+271.456218317"
Jul 27 17:29:35.599140 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.599046    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-g67jp" podStartSLOduration=6.54311954 podStartE2EDuration="8.59903087s" totalImagesPullingTime="2.05591133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:35.597681012 +0000 UTC m=+271.474882241" watchObservedRunningTime="2026-07-27 17:29:35.59903087 +0000 UTC m=+271.476232067"
Jul 27 17:29:35.622742 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.622694    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t" podStartSLOduration=1.872670583 podStartE2EDuration="10.622675645s" totalImagesPullingTime="8.750005062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:35.620006462 +0000 UTC m=+271.497207667" watchObservedRunningTime="2026-07-27 17:29:35.622675645 +0000 UTC m=+271.499876850"
Jul 27 17:29:35.640854 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:35.640806    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58" podStartSLOduration=6.153570909 podStartE2EDuration="9.640767433s" totalImagesPullingTime="3.487196524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:35.638849595 +0000 UTC m=+271.516050799" watchObservedRunningTime="2026-07-27 17:29:35.640767433 +0000 UTC m=+271.517968636"
Jul 27 17:29:36.442240 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.442201    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:36.442562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.442275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:36.447843 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.447817    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:36.576123 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.576089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:29:36.741058 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.740970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:36.801110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.801056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:36.973536 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:36.973488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:37.028450 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:37.028379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:38.156828 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.156796    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:29:38.178167 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.178140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:38.279230 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.279166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:38.361744 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.361716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:38.612066 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.612035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:38.666457 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:38.666420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:39.131992 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:39.131918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:39.226089 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:39.226066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:39.588989 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:39.588956    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9wtms" event={"ID":"79cd464c-763c-433f-9cd8-41d51bee8c4f","Type":"ContainerStarted","Data":"118633afeec82a909b5cdf8df2d6d32f7591e9f7f63a25990957bf0eb5156128"}
Jul 27 17:29:39.610154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:39.610102    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9wtms" podStartSLOduration=33.396326548 podStartE2EDuration="59.610089295s" totalImagesPullingTime="26.213762747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:28:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:39.609152269 +0000 UTC m=+275.486353472" watchObservedRunningTime="2026-07-27 17:29:39.610089295 +0000 UTC m=+275.487290498"
Jul 27 17:29:41.578351 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:41.578323    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58b84688bb-v5x9t"
Jul 27 17:29:41.603495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:41.603467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:41.702708 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:41.702678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:45.613190 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:45.613143    2564 generic.go:356] "Generic (PLEG): container finished" podID="fff8b62f-a429-4d3d-9c1f-f1d20870ec19" containerID="f35c2126a3fa76023baa052932aaa2a38ce74c59d60853c564c7559c258eca27" exitCode=0
Jul 27 17:29:45.613626 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:45.613211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd" event={"ID":"fff8b62f-a429-4d3d-9c1f-f1d20870ec19","Type":"ContainerDied","Data":"f35c2126a3fa76023baa052932aaa2a38ce74c59d60853c564c7559c258eca27"}
Jul 27 17:29:45.613626 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:45.613475    2564 scope.go:117] "RemoveContainer" containerID="f35c2126a3fa76023baa052932aaa2a38ce74c59d60853c564c7559c258eca27"
Jul 27 17:29:46.119661 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:29:46.119622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k5lwv" podUID="c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a"
Jul 27 17:29:46.122447 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:46.122419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:46.190845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:46.190800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:46.619545 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:46.619516    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:29:46.619933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:46.619511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-w7tgd" event={"ID":"fff8b62f-a429-4d3d-9c1f-f1d20870ec19","Type":"ContainerStarted","Data":"28ff31645f46a540fe2b1a276b0c247d2f05ee36fa75b4de00112bb4370755ce"}
Jul 27 17:29:47.115730 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:47.115697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:47.115919 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:47.115760    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:29:49.931430 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:49.931395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:29:49.933607 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:49.933587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a-metrics-tls\") pod \"dns-default-k5lwv\" (UID: \"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a\") " pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:29:50.223533 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:50.223504    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:29:50.230857 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:50.230839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:29:50.372265 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:50.372239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k5lwv"]
Jul 27 17:29:50.374176 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:29:50.374145    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8104ce3_9e47_46d5_ac9d_9fc5cfa6470a.slice/crio-ce9432613290f10eb07f794f6fcffc3194efee727c39ad8241f845906f88dd32 WatchSource:0}: Error finding container ce9432613290f10eb07f794f6fcffc3194efee727c39ad8241f845906f88dd32: Status 404 returned error can't find the container with id ce9432613290f10eb07f794f6fcffc3194efee727c39ad8241f845906f88dd32
Jul 27 17:29:50.636090 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:50.636004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5lwv" event={"ID":"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a","Type":"ContainerStarted","Data":"ce9432613290f10eb07f794f6fcffc3194efee727c39ad8241f845906f88dd32"}
Jul 27 17:29:53.525527 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.525480    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5598f6b6b8-qclpc" podUID="426d88c2-75fe-41af-9930-0d4a8a93d88b" containerName="console" containerID="cri-o://b8c81b125808f50367022ea3264a735ea04e28c38774fde9c049d91252f841d4" gracePeriod=15
Jul 27 17:29:53.648550 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.648524    2564 generic.go:356] "Generic (PLEG): container finished" podID="426d88c2-75fe-41af-9930-0d4a8a93d88b" containerID="b8c81b125808f50367022ea3264a735ea04e28c38774fde9c049d91252f841d4" exitCode=0
Jul 27 17:29:53.648654 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.648594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f6b6b8-qclpc" event={"ID":"426d88c2-75fe-41af-9930-0d4a8a93d88b","Type":"ContainerDied","Data":"b8c81b125808f50367022ea3264a735ea04e28c38774fde9c049d91252f841d4"}
Jul 27 17:29:53.650380 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.650358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5lwv" event={"ID":"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a","Type":"ContainerStarted","Data":"538a5dd57bac56e4d085ee25bf9b0dac7ab3caf967268f5de2ff99e4409c77f1"}
Jul 27 17:29:53.650483 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.650405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5lwv" event={"ID":"c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a","Type":"ContainerStarted","Data":"04bcdd2633e60285398224256d900fe5e952e1b793cac441f1c565079958a476"}
Jul 27 17:29:53.650533 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.650492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:29:53.669611 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.669569    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k5lwv" podStartSLOduration=252.247956435 podStartE2EDuration="4m14.669556003s" totalImagesPullingTime="2.421599568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:53.669437066 +0000 UTC m=+289.546638269" watchObservedRunningTime="2026-07-27 17:29:53.669556003 +0000 UTC m=+289.546757207"
Jul 27 17:29:53.798216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.798142    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:53.866072 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866043    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866371 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866260    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866371 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866286    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbncl\" (UniqueName: \"kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl\") pod \"426d88c2-75fe-41af-9930-0d4a8a93d88b\" (UID: \"426d88c2-75fe-41af-9930-0d4a8a93d88b\") "
Jul 27 17:29:53.866589 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866467    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca" (OuterVolumeSpecName: "service-ca") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:53.866589 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866489    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:53.866589 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866570    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-oauth-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.866589 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866587    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.866796 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.866682    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config" (OuterVolumeSpecName: "console-config") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:53.868372 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.868340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:53.868475 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.868384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:53.868475 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.868434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl" (OuterVolumeSpecName: "kube-api-access-sbncl") pod "426d88c2-75fe-41af-9930-0d4a8a93d88b" (UID: "426d88c2-75fe-41af-9930-0d4a8a93d88b"). InnerVolumeSpecName "kube-api-access-sbncl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:53.967249 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.967217    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.967249 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.967244    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-oauth-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.967249 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.967253    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d88c2-75fe-41af-9930-0d4a8a93d88b-console-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.967437 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:53.967263    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbncl\" (UniqueName: \"kubernetes.io/projected/426d88c2-75fe-41af-9930-0d4a8a93d88b-kube-api-access-sbncl\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:29:54.656295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:54.656264    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f6b6b8-qclpc"
Jul 27 17:29:54.656295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:54.656277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f6b6b8-qclpc" event={"ID":"426d88c2-75fe-41af-9930-0d4a8a93d88b","Type":"ContainerDied","Data":"d919aa5a9807a3bd21661c50c01d1a5914b7f2725145597cc7a5742013229a1f"}
Jul 27 17:29:54.656756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:54.656355    2564 scope.go:117] "RemoveContainer" containerID="b8c81b125808f50367022ea3264a735ea04e28c38774fde9c049d91252f841d4"
Jul 27 17:29:54.730436 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:54.730407    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:54.732624 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:54.732600    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5598f6b6b8-qclpc"]
Jul 27 17:29:55.662715 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:55.662685    2564 generic.go:356] "Generic (PLEG): container finished" podID="1bba1d9b-a978-40d0-91dd-e62519a7cba3" containerID="5610c0a519c606ab5e53cf197a1cb1914bd319176219dac70a09b7189d568573" exitCode=0
Jul 27 17:29:55.663146 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:55.662762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n" event={"ID":"1bba1d9b-a978-40d0-91dd-e62519a7cba3","Type":"ContainerDied","Data":"5610c0a519c606ab5e53cf197a1cb1914bd319176219dac70a09b7189d568573"}
Jul 27 17:29:55.663146 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:55.663098    2564 scope.go:117] "RemoveContainer" containerID="5610c0a519c606ab5e53cf197a1cb1914bd319176219dac70a09b7189d568573"
Jul 27 17:29:56.667758 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:56.667724    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426d88c2-75fe-41af-9930-0d4a8a93d88b" path="/var/lib/kubelet/pods/426d88c2-75fe-41af-9930-0d4a8a93d88b/volumes"
Jul 27 17:29:56.669624 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:56.669601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n" event={"ID":"1bba1d9b-a978-40d0-91dd-e62519a7cba3","Type":"ContainerStarted","Data":"b5ffa7bfa0cc0aba2be1cc4d34d3894f9ea2a28e9749bc2e7d3626cbbb8a43bb"}
Jul 27 17:29:59.683728 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:59.683693    2564 generic.go:356] "Generic (PLEG): container finished" podID="fbea3ce3-e76a-4303-b5f8-45eefc4cde17" containerID="c4c131e720aba11311e24d4ac8ce1fc34f0ea9611fb5bde652461e7508fe1cf7" exitCode=0
Jul 27 17:29:59.684110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:59.683764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tqhvw" event={"ID":"fbea3ce3-e76a-4303-b5f8-45eefc4cde17","Type":"ContainerDied","Data":"c4c131e720aba11311e24d4ac8ce1fc34f0ea9611fb5bde652461e7508fe1cf7"}
Jul 27 17:29:59.684150 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:29:59.684123    2564 scope.go:117] "RemoveContainer" containerID="c4c131e720aba11311e24d4ac8ce1fc34f0ea9611fb5bde652461e7508fe1cf7"
Jul 27 17:30:00.689271 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:00.689237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tqhvw" event={"ID":"fbea3ce3-e76a-4303-b5f8-45eefc4cde17","Type":"ContainerStarted","Data":"9e0ce5e329e9a66bcc3dfaf7dd019ddc753dece5c899a051686c30c9f16a0296"}
Jul 27 17:30:00.746169 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:00.746144    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5lwv_c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a/dns/0.log"
Jul 27 17:30:00.752721 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:00.752688    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5lwv_c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a/kube-rbac-proxy/0.log"
Jul 27 17:30:01.058997 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:01.058932    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6vkg_1c95930a-e283-48c8-a484-bb99194ab7ee/dns-node-resolver/0.log"
Jul 27 17:30:03.601949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.601913    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8484ccdb94-m5d4k" podUID="a0e30453-6f21-4b90-bf84-e041c9cb507e" containerName="console" containerID="cri-o://5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98" gracePeriod=15
Jul 27 17:30:03.658567 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.658541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k5lwv"
Jul 27 17:30:03.883753 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.883689    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:30:03.956073 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956038    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956086    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956152    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956200    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956227    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcbfh\" (UniqueName: \"kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956280 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956262    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956534 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert\") pod \"a0e30453-6f21-4b90-bf84-e041c9cb507e\" (UID: \"a0e30453-6f21-4b90-bf84-e041c9cb507e\") "
Jul 27 17:30:03.956593 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:30:03.956648 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:30:03.956745 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config" (OuterVolumeSpecName: "console-config") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:30:03.956745 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956708    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:30:03.956957 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956937    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:03.957036 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956961    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:03.957036 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956975    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-oauth-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:03.957036 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.956987    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0e30453-6f21-4b90-bf84-e041c9cb507e-trusted-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:03.958347 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.958317    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:30:03.958484 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.958460    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:30:03.958484 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:03.958470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh" (OuterVolumeSpecName: "kube-api-access-rcbfh") pod "a0e30453-6f21-4b90-bf84-e041c9cb507e" (UID: "a0e30453-6f21-4b90-bf84-e041c9cb507e"). InnerVolumeSpecName "kube-api-access-rcbfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:30:04.058021 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.057991    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcbfh\" (UniqueName: \"kubernetes.io/projected/a0e30453-6f21-4b90-bf84-e041c9cb507e-kube-api-access-rcbfh\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:04.058021 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.058017    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:04.058021 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.058027    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0e30453-6f21-4b90-bf84-e041c9cb507e-console-oauth-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:30:04.494917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.494892    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.703728    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0e30453-6f21-4b90-bf84-e041c9cb507e" containerID="5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98" exitCode=0
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.703782    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8484ccdb94-m5d4k"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.703794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8484ccdb94-m5d4k" event={"ID":"a0e30453-6f21-4b90-bf84-e041c9cb507e","Type":"ContainerDied","Data":"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"}
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.703829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8484ccdb94-m5d4k" event={"ID":"a0e30453-6f21-4b90-bf84-e041c9cb507e","Type":"ContainerDied","Data":"8fe2daec066d3e355131a8a67a4ef82dd560bf77380d73c6f0420918981add90"}
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.703852    2564 scope.go:117] "RemoveContainer" containerID="5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.711482    2564 scope.go:117] "RemoveContainer" containerID="5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:30:04.711728    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98\": container with ID starting with 5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98 not found: ID does not exist" containerID="5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.711756    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98"} err="failed to get container status \"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98\": rpc error: code = NotFound desc = could not find container \"5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98\": container with ID starting with 5b21aded533efb02e67924d04c4cd2087892a636850d75f5f3ac1c74a940ac98 not found: ID does not exist"
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.721137    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:30:05.083479 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:04.731989    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8484ccdb94-m5d4k"]
Jul 27 17:30:06.668155 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:06.668121    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0e30453-6f21-4b90-bf84-e041c9cb507e" path="/var/lib/kubelet/pods/a0e30453-6f21-4b90-bf84-e041c9cb507e/volumes"
Jul 27 17:30:07.120815 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:07.120780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:30:07.124733 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:07.124711    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75d44bd6f4-wcb58"
Jul 27 17:30:11.238828 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:11.238791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:11.296986 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:11.296953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:13.191162 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:13.191121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:13.250766 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:13.250729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:34.905729 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:34.905697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:34.960101 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:34.960070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:41.610305 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:41.610265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:45.051127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:45.051094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:46.708858 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.708830    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c57cd594-fskpz"]
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709115    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426d88c2-75fe-41af-9930-0d4a8a93d88b" containerName="console"
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709125    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="426d88c2-75fe-41af-9930-0d4a8a93d88b" containerName="console"
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709132    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0e30453-6f21-4b90-bf84-e041c9cb507e" containerName="console"
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709138    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0e30453-6f21-4b90-bf84-e041c9cb507e" containerName="console"
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709220    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="426d88c2-75fe-41af-9930-0d4a8a93d88b" containerName="console"
Jul 27 17:30:46.709242 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.709227    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0e30453-6f21-4b90-bf84-e041c9cb507e" containerName="console"
Jul 27 17:30:46.714914 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.714896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.717991 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.717968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 17:30:46.718128 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.718107    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 17:30:46.718222 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.718207    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 17:30:46.718296 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.718248    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 17:30:46.718453 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.718434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l66p7\""
Jul 27 17:30:46.718554 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.718536    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 17:30:46.724823 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.724801    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 17:30:46.725807 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.725788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c57cd594-fskpz"]
Jul 27 17:30:46.794618 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zlfl\" (UniqueName: \"kubernetes.io/projected/3f5b6620-243f-443d-87bb-65e7b43dc9e2-kube-api-access-8zlfl\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794728 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-serving-certs-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-metrics-client-ca\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794955 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-federate-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.794955 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.794920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895699 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-serving-certs-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895699 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-metrics-client-ca\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-federate-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zlfl\" (UniqueName: \"kubernetes.io/projected/3f5b6620-243f-443d-87bb-65e7b43dc9e2-kube-api-access-8zlfl\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.895908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.895899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.896535 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.896512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-metrics-client-ca\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.896680 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.896650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-serving-certs-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.896895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.896868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.898430 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.898402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-federate-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.898534 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.898503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.898619 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.898602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-telemeter-client-tls\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.898740 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.898721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f5b6620-243f-443d-87bb-65e7b43dc9e2-secret-telemeter-client\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:46.906188 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:46.906158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zlfl\" (UniqueName: \"kubernetes.io/projected/3f5b6620-243f-443d-87bb-65e7b43dc9e2-kube-api-access-8zlfl\") pod \"telemeter-client-5c57cd594-fskpz\" (UID: \"3f5b6620-243f-443d-87bb-65e7b43dc9e2\") " pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:47.025583 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:47.025516    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz"
Jul 27 17:30:47.153987 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:47.153955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c57cd594-fskpz"]
Jul 27 17:30:47.157378 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:30:47.157346    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5b6620_243f_443d_87bb_65e7b43dc9e2.slice/crio-5f41227a201e64e7b0dbcf8c454a11add5711b18ab26157b1e5a5a60548df373 WatchSource:0}: Error finding container 5f41227a201e64e7b0dbcf8c454a11add5711b18ab26157b1e5a5a60548df373: Status 404 returned error can't find the container with id 5f41227a201e64e7b0dbcf8c454a11add5711b18ab26157b1e5a5a60548df373
Jul 27 17:30:47.159759 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:47.159743    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:30:47.866709 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:47.866648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz" event={"ID":"3f5b6620-243f-443d-87bb-65e7b43dc9e2","Type":"ContainerStarted","Data":"5f41227a201e64e7b0dbcf8c454a11add5711b18ab26157b1e5a5a60548df373"}
Jul 27 17:30:49.879411 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:49.879373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz" event={"ID":"3f5b6620-243f-443d-87bb-65e7b43dc9e2","Type":"ContainerStarted","Data":"9a719ad928a37f7e16cb70db640152e2be46765c844475797a883f1996857512"}
Jul 27 17:30:50.885258 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:50.885225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz" event={"ID":"3f5b6620-243f-443d-87bb-65e7b43dc9e2","Type":"ContainerStarted","Data":"3c62694a6821ba5446da2f7c6e9f994541cb3698f8b1a7783abbff193142a54e"}
Jul 27 17:30:50.885661 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:50.885291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz" event={"ID":"3f5b6620-243f-443d-87bb-65e7b43dc9e2","Type":"ContainerStarted","Data":"24d7d84159fe6dd7030de70e771daf212719a606c1ec74210e8d7213a825e7c0"}
Jul 27 17:30:50.911891 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:50.911847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c57cd594-fskpz" podStartSLOduration=2.110159733 podStartE2EDuration="4.911833523s" totalImagesPullingTime="2.80167379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:30:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:30:50.910118901 +0000 UTC m=+346.787320103" watchObservedRunningTime="2026-07-27 17:30:50.911833523 +0000 UTC m=+346.789034725"
Jul 27 17:30:51.878075 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.878034    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:30:51.880234 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.880212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:51.883231 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.883201    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 17:30:51.883341 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.883319    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 17:30:51.884745 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.884727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 17:30:51.884840 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.884769    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 17:30:51.885053 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.885031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfkjx\""
Jul 27 17:30:51.885200 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.885159    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 17:30:51.890100 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.890082    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 17:30:51.896573 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:51.896553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:30:52.039313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr54w\" (UniqueName: \"kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039562 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.039723 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.039672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr54w\" (UniqueName: \"kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140876 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.140876 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.141062 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.140941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.141283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.141253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.142890 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.142867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.142993 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.142890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.149458 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.149426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr54w\" (UniqueName: \"kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w\") pod \"console-5cddfff579-2xhhs\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") " pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.190295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.190270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:30:52.317497 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.317468    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:30:52.320481 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:30:52.320446    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdc0833_5393_476b_88d9_394808bd5db0.slice/crio-2f4a4dfc9ecb06b90b7f502a9e15e9499ae46211a0b71efa42e4f782c022de6b WatchSource:0}: Error finding container 2f4a4dfc9ecb06b90b7f502a9e15e9499ae46211a0b71efa42e4f782c022de6b: Status 404 returned error can't find the container with id 2f4a4dfc9ecb06b90b7f502a9e15e9499ae46211a0b71efa42e4f782c022de6b
Jul 27 17:30:52.895298 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.895251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cddfff579-2xhhs" event={"ID":"2fdc0833-5393-476b-88d9-394808bd5db0","Type":"ContainerStarted","Data":"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"}
Jul 27 17:30:52.895674 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.895319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cddfff579-2xhhs" event={"ID":"2fdc0833-5393-476b-88d9-394808bd5db0","Type":"ContainerStarted","Data":"2f4a4dfc9ecb06b90b7f502a9e15e9499ae46211a0b71efa42e4f782c022de6b"}
Jul 27 17:30:52.917264 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:52.917216    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cddfff579-2xhhs" podStartSLOduration=1.917201959 podStartE2EDuration="1.917201959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:30:52.914929563 +0000 UTC m=+348.792130790" watchObservedRunningTime="2026-07-27 17:30:52.917201959 +0000 UTC m=+348.794403159"
Jul 27 17:30:54.546275 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:54.546240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:56.871113 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:56.871036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:56.934450 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:30:56.934418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:02.191149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:02.191119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:02.191610 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:02.191279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:02.195806 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:02.195784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:02.936253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:02.936226    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:03.069663 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.069630    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffd6f8845-r4wkh"]
Jul 27 17:31:03.071916 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.071899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.082760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.082734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffd6f8845-r4wkh"]
Jul 27 17:31:03.227760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.227732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-oauth-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.227767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-oauth-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.227789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-service-ca\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.227884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.227931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-trusted-ca-bundle\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.228002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsr2q\" (UniqueName: \"kubernetes.io/projected/94f98189-1400-4ab3-9ef4-a41df09ba68c-kube-api-access-dsr2q\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.228125 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.228050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329142 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsr2q\" (UniqueName: \"kubernetes.io/projected/94f98189-1400-4ab3-9ef4-a41df09ba68c-kube-api-access-dsr2q\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-oauth-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-oauth-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-service-ca\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.329549 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.329429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-trusted-ca-bundle\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.330129 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.330097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-oauth-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.330233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.330160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-service-ca\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.330738 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.330720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-trusted-ca-bundle\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.330780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.330721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.331792 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.331763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-oauth-config\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.331917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.331898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94f98189-1400-4ab3-9ef4-a41df09ba68c-console-serving-cert\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.338053 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.338032    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsr2q\" (UniqueName: \"kubernetes.io/projected/94f98189-1400-4ab3-9ef4-a41df09ba68c-kube-api-access-dsr2q\") pod \"console-7ffd6f8845-r4wkh\" (UID: \"94f98189-1400-4ab3-9ef4-a41df09ba68c\") " pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.381358 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.381335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:03.444142 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.443970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:03.524350 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.524325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffd6f8845-r4wkh"]
Jul 27 17:31:03.525847 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.525807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:03.525972 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:31:03.525950    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f98189_1400_4ab3_9ef4_a41df09ba68c.slice/crio-6339969ebbc9083a96694090bd11a1a71a0a3c09a7c76f3a44d06cfebb2e4eae WatchSource:0}: Error finding container 6339969ebbc9083a96694090bd11a1a71a0a3c09a7c76f3a44d06cfebb2e4eae: Status 404 returned error can't find the container with id 6339969ebbc9083a96694090bd11a1a71a0a3c09a7c76f3a44d06cfebb2e4eae
Jul 27 17:31:03.938841 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.938805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffd6f8845-r4wkh" event={"ID":"94f98189-1400-4ab3-9ef4-a41df09ba68c","Type":"ContainerStarted","Data":"80288810e7c593483bac2ef56f563bf6c97dcd06c07d814cb3b6aa32d57844d1"}
Jul 27 17:31:03.938999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.938862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffd6f8845-r4wkh" event={"ID":"94f98189-1400-4ab3-9ef4-a41df09ba68c","Type":"ContainerStarted","Data":"6339969ebbc9083a96694090bd11a1a71a0a3c09a7c76f3a44d06cfebb2e4eae"}
Jul 27 17:31:03.957104 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:03.957061    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ffd6f8845-r4wkh" podStartSLOduration=0.957046132 podStartE2EDuration="957.046132ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:31:03.956777234 +0000 UTC m=+359.833978462" watchObservedRunningTime="2026-07-27 17:31:03.957046132 +0000 UTC m=+359.834247331"
Jul 27 17:31:06.468362 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:06.468330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:06.534790 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:06.534762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:08.816103 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:08.816055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:08.873983 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:08.873951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:13.381485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:13.381448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:13.381889 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:13.381520    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:13.385890 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:13.385870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:13.983958 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:13.983929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ffd6f8845-r4wkh"
Jul 27 17:31:14.034555 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:14.034523    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:31:14.152548 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:14.152513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:14.205866 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:14.205826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:14.266597 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:14.266522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:24.410256 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:24.410224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:24.512013 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:24.511981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:31.394235 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:31.394201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:31.449219 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:31.449155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:39.054779 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.054717    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cddfff579-2xhhs" podUID="2fdc0833-5393-476b-88d9-394808bd5db0" containerName="console" containerID="cri-o://31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0" gracePeriod=15
Jul 27 17:31:39.301598 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.301577    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:39.430283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430196    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr54w\" (UniqueName: \"kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430255    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430300    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430345    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert\") pod \"2fdc0833-5393-476b-88d9-394808bd5db0\" (UID: \"2fdc0833-5393-476b-88d9-394808bd5db0\") "
Jul 27 17:31:39.430794 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430761    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config" (OuterVolumeSpecName: "console-config") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:39.430794 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430781    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:39.430989 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.430930    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:39.431069 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.431050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:39.432431 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.432404    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w" (OuterVolumeSpecName: "kube-api-access-wr54w") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "kube-api-access-wr54w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:31:39.432833 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.432815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:31:39.432945 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.432832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fdc0833-5393-476b-88d9-394808bd5db0" (UID: "2fdc0833-5393-476b-88d9-394808bd5db0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:31:39.531553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531512    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-oauth-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531551    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531553 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531560    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-console-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531572    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdc0833-5393-476b-88d9-394808bd5db0-console-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531584    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-trusted-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531594    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fdc0833-5393-476b-88d9-394808bd5db0-oauth-serving-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:39.531780 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:39.531602    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr54w\" (UniqueName: \"kubernetes.io/projected/2fdc0833-5393-476b-88d9-394808bd5db0-kube-api-access-wr54w\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:31:40.093826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.093793    2564 generic.go:356] "Generic (PLEG): container finished" podID="2fdc0833-5393-476b-88d9-394808bd5db0" containerID="31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0" exitCode=0
Jul 27 17:31:40.094272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.093837    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cddfff579-2xhhs"
Jul 27 17:31:40.094272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.093877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cddfff579-2xhhs" event={"ID":"2fdc0833-5393-476b-88d9-394808bd5db0","Type":"ContainerDied","Data":"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"}
Jul 27 17:31:40.094272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.093924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cddfff579-2xhhs" event={"ID":"2fdc0833-5393-476b-88d9-394808bd5db0","Type":"ContainerDied","Data":"2f4a4dfc9ecb06b90b7f502a9e15e9499ae46211a0b71efa42e4f782c022de6b"}
Jul 27 17:31:40.094272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.093944    2564 scope.go:117] "RemoveContainer" containerID="31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"
Jul 27 17:31:40.102612 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.102595    2564 scope.go:117] "RemoveContainer" containerID="31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"
Jul 27 17:31:40.102861 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:31:40.102842    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0\": container with ID starting with 31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0 not found: ID does not exist" containerID="31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"
Jul 27 17:31:40.102910 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.102872    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0"} err="failed to get container status \"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0\": rpc error: code = NotFound desc = could not find container \"31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0\": container with ID starting with 31d6dff940ff5cd12f83ac7a8b9d7debbf91652c874f3fe2690084ade15e09b0 not found: ID does not exist"
Jul 27 17:31:40.116357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.116337    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:31:40.119784 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.119765    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cddfff579-2xhhs"]
Jul 27 17:31:40.667191 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:31:40.667143    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdc0833-5393-476b-88d9-394808bd5db0" path="/var/lib/kubelet/pods/2fdc0833-5393-476b-88d9-394808bd5db0/volumes"
Jul 27 17:32:06.228963 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:06.228929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:09.035245 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:09.035176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:12.794327 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:12.794291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:12.898654 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:12.898615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:13.494368 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.494332    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"]
Jul 27 17:32:13.494654 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.494643    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fdc0833-5393-476b-88d9-394808bd5db0" containerName="console"
Jul 27 17:32:13.494696 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.494656    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fdc0833-5393-476b-88d9-394808bd5db0" containerName="console"
Jul 27 17:32:13.494729 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.494714    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fdc0833-5393-476b-88d9-394808bd5db0" containerName="console"
Jul 27 17:32:13.499073 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.499057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.502062 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.502038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:32:13.502157 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.502038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:32:13.503487 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.503472    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl4rc\""
Jul 27 17:32:13.506646 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.506622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"]
Jul 27 17:32:13.614511 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.614475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.614676 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.614541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22vt\" (UniqueName: \"kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.614676 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.614563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.715846 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.715812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.716009 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.715895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22vt\" (UniqueName: \"kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.716009 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.715917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.716290 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.716273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.716336 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.716273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.725209 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.725171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22vt\" (UniqueName: \"kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.808225 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.808134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:13.936999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:13.936970    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"]
Jul 27 17:32:13.938778 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:32:13.938749    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa03e924_fa8c_4acf_8dfc_dd8c2ca89213.slice/crio-87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469 WatchSource:0}: Error finding container 87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469: Status 404 returned error can't find the container with id 87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469
Jul 27 17:32:14.229367 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:14.229338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn" event={"ID":"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213","Type":"ContainerStarted","Data":"87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469"}
Jul 27 17:32:21.260203 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:21.260153    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerID="b51c6582abd959b4b25f73c920a12a3de5e1dc9173c82ee8480af611059fb7e2" exitCode=0
Jul 27 17:32:21.260726 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:21.260209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn" event={"ID":"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213","Type":"ContainerDied","Data":"b51c6582abd959b4b25f73c920a12a3de5e1dc9173c82ee8480af611059fb7e2"}
Jul 27 17:32:24.275449 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:24.275413    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerID="32a77308d870818a424eed0ebbb0ae8fef285f04a681b1c82a9a973bde442a95" exitCode=0
Jul 27 17:32:24.275835 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:24.275465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn" event={"ID":"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213","Type":"ContainerDied","Data":"32a77308d870818a424eed0ebbb0ae8fef285f04a681b1c82a9a973bde442a95"}
Jul 27 17:32:24.634978 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:24.634906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:24.695024 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:24.694989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:32.310965 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:32.310920    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerID="8c1df5519bbffb6bea69d67951776bfd01a5ed8828a6f2c391535cf9ffea5b2e" exitCode=0
Jul 27 17:32:32.311357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:32.310991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn" event={"ID":"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213","Type":"ContainerDied","Data":"8c1df5519bbffb6bea69d67951776bfd01a5ed8828a6f2c391535cf9ffea5b2e"}
Jul 27 17:32:33.439420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.439399    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:33.588737 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.588658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util\") pod \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") "
Jul 27 17:32:33.588737 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.588724    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l22vt\" (UniqueName: \"kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt\") pod \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") "
Jul 27 17:32:33.588940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.588788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle\") pod \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\" (UID: \"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213\") "
Jul 27 17:32:33.589467 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.589440    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle" (OuterVolumeSpecName: "bundle") pod "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" (UID: "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:32:33.590885 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.590865    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt" (OuterVolumeSpecName: "kube-api-access-l22vt") pod "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" (UID: "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213"). InnerVolumeSpecName "kube-api-access-l22vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:32:33.595876 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.595850    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util" (OuterVolumeSpecName: "util") pod "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" (UID: "aa03e924-fa8c-4acf-8dfc-dd8c2ca89213"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:32:33.690160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.690130    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:33.690160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.690154    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l22vt\" (UniqueName: \"kubernetes.io/projected/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-kube-api-access-l22vt\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:33.690160 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:33.690166    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa03e924-fa8c-4acf-8dfc-dd8c2ca89213-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:34.326726 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:34.326699    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn"
Jul 27 17:32:34.326886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:34.326704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfgwn" event={"ID":"aa03e924-fa8c-4acf-8dfc-dd8c2ca89213","Type":"ContainerDied","Data":"87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469"}
Jul 27 17:32:34.326886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:34.326837    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87ef89eda916d03e16f768fd47a5fb0060157192bbc3ea71b896f6a5aad37469"
Jul 27 17:32:39.547472 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:39.547422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:40.404928 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:40.404881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:41.525115 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525083    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"]
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525393    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="util"
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525404    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="util"
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525414    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="pull"
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525419    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="pull"
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525428    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="extract"
Jul 27 17:32:41.525485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525433    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="extract"
Jul 27 17:32:41.525671 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.525496    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa03e924-fa8c-4acf-8dfc-dd8c2ca89213" containerName="extract"
Jul 27 17:32:41.528848 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.528830    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.531873 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.531843    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 17:32:41.531992 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.531879    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:32:41.531992 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.531877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v9qdf\""
Jul 27 17:32:41.542029 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.542005    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"]
Jul 27 17:32:41.653524 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.653497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96500ce3-a03d-4318-9b9b-60790118745b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.653673 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.653560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvdw\" (UniqueName: \"kubernetes.io/projected/96500ce3-a03d-4318-9b9b-60790118745b-kube-api-access-rsvdw\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.755012 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.754973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96500ce3-a03d-4318-9b9b-60790118745b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.755216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.755037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvdw\" (UniqueName: \"kubernetes.io/projected/96500ce3-a03d-4318-9b9b-60790118745b-kube-api-access-rsvdw\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.755444 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.755424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96500ce3-a03d-4318-9b9b-60790118745b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.764913 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.764886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvdw\" (UniqueName: \"kubernetes.io/projected/96500ce3-a03d-4318-9b9b-60790118745b-kube-api-access-rsvdw\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkh2b\" (UID: \"96500ce3-a03d-4318-9b9b-60790118745b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.838101 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.838041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"
Jul 27 17:32:41.964781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:41.964742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b"]
Jul 27 17:32:41.968618 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:32:41.968588    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96500ce3_a03d_4318_9b9b_60790118745b.slice/crio-7ff1c515a56345c19cae8486441840c3e345e2fe427f134a8880c0a6690dbd67 WatchSource:0}: Error finding container 7ff1c515a56345c19cae8486441840c3e345e2fe427f134a8880c0a6690dbd67: Status 404 returned error can't find the container with id 7ff1c515a56345c19cae8486441840c3e345e2fe427f134a8880c0a6690dbd67
Jul 27 17:32:42.359367 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:42.359317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b" event={"ID":"96500ce3-a03d-4318-9b9b-60790118745b","Type":"ContainerStarted","Data":"7ff1c515a56345c19cae8486441840c3e345e2fe427f134a8880c0a6690dbd67"}
Jul 27 17:32:43.207884 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:43.207850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:43.310333 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:43.310300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:46.378117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.378080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b" event={"ID":"96500ce3-a03d-4318-9b9b-60790118745b","Type":"ContainerStarted","Data":"ea31ccd011faf9a1f316baab4b46049d345157af21d6a6898ac8bc1121a6bf9a"}
Jul 27 17:32:46.402856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.402804    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkh2b" podStartSLOduration=1.648278437 podStartE2EDuration="5.402791036s" totalImagesPullingTime="3.754512599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:32:46.400694407 +0000 UTC m=+462.277895609" watchObservedRunningTime="2026-07-27 17:32:46.402791036 +0000 UTC m=+462.279992238"
Jul 27 17:32:46.742220 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.742169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:46.886715 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.886685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:46.946324 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.946291    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"]
Jul 27 17:32:46.949082 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.949055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:46.952440 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.952416    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:32:46.952552 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.952536    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:32:46.953833 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.953814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl4rc\""
Jul 27 17:32:46.960669 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:46.960645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"]
Jul 27 17:32:47.058279 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.058210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:47.101865 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.101828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr52p\" (UniqueName: \"kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.101976 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.101867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.102020 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.101984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.203094 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.203066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.203296 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.203112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr52p\" (UniqueName: \"kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.203296 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.203131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.203471 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.203451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.203529 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.203477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.221352 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.221329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr52p\" (UniqueName: \"kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.259170 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.259132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:47.388046 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:47.388019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"]
Jul 27 17:32:47.389343 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:32:47.389313    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388604a3_326c_4d57_af80_dbb305075238.slice/crio-2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8 WatchSource:0}: Error finding container 2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8: Status 404 returned error can't find the container with id 2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8
Jul 27 17:32:48.387726 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:48.387694    2564 generic.go:356] "Generic (PLEG): container finished" podID="388604a3-326c-4d57-af80-dbb305075238" containerID="74a982a41fc86334504d9cf22907f150d3335b56169da1371d927beec1afe927" exitCode=0
Jul 27 17:32:48.387895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:48.387785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd" event={"ID":"388604a3-326c-4d57-af80-dbb305075238","Type":"ContainerDied","Data":"74a982a41fc86334504d9cf22907f150d3335b56169da1371d927beec1afe927"}
Jul 27 17:32:48.387895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:48.387841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd" event={"ID":"388604a3-326c-4d57-af80-dbb305075238","Type":"ContainerStarted","Data":"2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8"}
Jul 27 17:32:48.603117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:48.603046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:48.694830 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:48.694805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:49.232983 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:49.232954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:49.472337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:49.472306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:51.404639 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:51.404601    2564 generic.go:356] "Generic (PLEG): container finished" podID="388604a3-326c-4d57-af80-dbb305075238" containerID="829b2d091c60e613488f901eacff1b5ae30131f79741568998199b61692fcf60" exitCode=0
Jul 27 17:32:51.405108 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:51.404708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd" event={"ID":"388604a3-326c-4d57-af80-dbb305075238","Type":"ContainerDied","Data":"829b2d091c60e613488f901eacff1b5ae30131f79741568998199b61692fcf60"}
Jul 27 17:32:52.410418 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:52.410384    2564 generic.go:356] "Generic (PLEG): container finished" podID="388604a3-326c-4d57-af80-dbb305075238" containerID="867381626cb7c8e8365573e27be52f81a6040adc76b2ab56a9380e950c07dde8" exitCode=0
Jul 27 17:32:52.410841 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:52.410469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd" event={"ID":"388604a3-326c-4d57-af80-dbb305075238","Type":"ContainerDied","Data":"867381626cb7c8e8365573e27be52f81a6040adc76b2ab56a9380e950c07dde8"}
Jul 27 17:32:53.535134 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.535113    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:53.551843 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.551813    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util\") pod \"388604a3-326c-4d57-af80-dbb305075238\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") "
Jul 27 17:32:53.551999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.551868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle\") pod \"388604a3-326c-4d57-af80-dbb305075238\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") "
Jul 27 17:32:53.551999 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.551899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr52p\" (UniqueName: \"kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p\") pod \"388604a3-326c-4d57-af80-dbb305075238\" (UID: \"388604a3-326c-4d57-af80-dbb305075238\") "
Jul 27 17:32:53.552407 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.552378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle" (OuterVolumeSpecName: "bundle") pod "388604a3-326c-4d57-af80-dbb305075238" (UID: "388604a3-326c-4d57-af80-dbb305075238"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:32:53.554555 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.554516    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p" (OuterVolumeSpecName: "kube-api-access-zr52p") pod "388604a3-326c-4d57-af80-dbb305075238" (UID: "388604a3-326c-4d57-af80-dbb305075238"). InnerVolumeSpecName "kube-api-access-zr52p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:32:53.558253 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.558229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util" (OuterVolumeSpecName: "util") pod "388604a3-326c-4d57-af80-dbb305075238" (UID: "388604a3-326c-4d57-af80-dbb305075238"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:32:53.652981 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.652948    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:53.652981 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.652976    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388604a3-326c-4d57-af80-dbb305075238-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:53.652981 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:53.652985    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr52p\" (UniqueName: \"kubernetes.io/projected/388604a3-326c-4d57-af80-dbb305075238-kube-api-access-zr52p\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:32:54.421029 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:54.420998    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd"
Jul 27 17:32:54.421029 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:54.421025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5lqjd" event={"ID":"388604a3-326c-4d57-af80-dbb305075238","Type":"ContainerDied","Data":"2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8"}
Jul 27 17:32:54.421251 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:54.421073    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a6d54831ca4c308ab375aab686df239b43218eb4fe2e1f63441f7781cd255b8"
Jul 27 17:32:55.043992 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:55.043955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:55.144284 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:55.144251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:56.466134 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:56.466098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:57.346719 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.346685    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qbvzl"]
Jul 27 17:32:57.347039 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347021    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="pull"
Jul 27 17:32:57.347084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347040    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="pull"
Jul 27 17:32:57.347084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347065    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="extract"
Jul 27 17:32:57.347084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347071    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="extract"
Jul 27 17:32:57.347084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347077    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="util"
Jul 27 17:32:57.347084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347083    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="util"
Jul 27 17:32:57.347277 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.347148    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="388604a3-326c-4d57-af80-dbb305075238" containerName="extract"
Jul 27 17:32:57.349089 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.349072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.351895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.351877    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 17:32:57.352256 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.352241    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 17:32:57.353404 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.353384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6trgf\""
Jul 27 17:32:57.360202 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.360169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qbvzl"]
Jul 27 17:32:57.382987 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.382961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-bound-sa-token\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.383069 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.382995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5887\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-kube-api-access-s5887\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.484044 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.484020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-bound-sa-token\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.484425 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.484054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5887\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-kube-api-access-s5887\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.493067 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.493049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-bound-sa-token\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.493368 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.493348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5887\" (UniqueName: \"kubernetes.io/projected/d712d419-9a84-4fed-b807-a40596b5199d-kube-api-access-s5887\") pod \"cert-manager-55b4d954d5-qbvzl\" (UID: \"d712d419-9a84-4fed-b807-a40596b5199d\") " pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.672342 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.672277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qbvzl"
Jul 27 17:32:57.799387 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:57.799365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qbvzl"]
Jul 27 17:32:57.801458 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:32:57.801433    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd712d419_9a84_4fed_b807_a40596b5199d.slice/crio-7488a6d4427c66e58ffb5057df72ab7dec8ddf4b2e83da55f6b934a264b4e79c WatchSource:0}: Error finding container 7488a6d4427c66e58ffb5057df72ab7dec8ddf4b2e83da55f6b934a264b4e79c: Status 404 returned error can't find the container with id 7488a6d4427c66e58ffb5057df72ab7dec8ddf4b2e83da55f6b934a264b4e79c
Jul 27 17:32:58.440603 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:58.440571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qbvzl" event={"ID":"d712d419-9a84-4fed-b807-a40596b5199d","Type":"ContainerStarted","Data":"7488a6d4427c66e58ffb5057df72ab7dec8ddf4b2e83da55f6b934a264b4e79c"}
Jul 27 17:32:58.837256 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:58.837158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:58.938283 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:32:58.938239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:01.457086 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:01.457048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qbvzl" event={"ID":"d712d419-9a84-4fed-b807-a40596b5199d","Type":"ContainerStarted","Data":"15f3a7ca710296e0562c0fc3e8477971d19e4429b0cd395c672a14e12b46566d"}
Jul 27 17:33:01.474726 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:01.474672    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qbvzl" podStartSLOduration=1.879422197 podStartE2EDuration="4.474657536s" totalImagesPullingTime="2.595235339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:01.47302156 +0000 UTC m=+477.350222775" watchObservedRunningTime="2026-07-27 17:33:01.474657536 +0000 UTC m=+477.351858739"
Jul 27 17:33:04.925720 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:04.925687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:05.025317 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:05.025280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:06.660279 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.660246    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"]
Jul 27 17:33:06.662970 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.662947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.666247 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.666226    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:33:06.666357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.666284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:33:06.667548 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.667528    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl4rc\""
Jul 27 17:33:06.671863 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.671839    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"]
Jul 27 17:33:06.762868 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.762846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.763080 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.763058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkddl\" (UniqueName: \"kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.763162 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.763117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.863845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.863815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkddl\" (UniqueName: \"kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.863959 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.863861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.863959 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.863916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.864297 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.864265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.864377 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.864302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.872560 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.872539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkddl\" (UniqueName: \"kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:06.972845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:06.972808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:07.101323 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:07.101302    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"]
Jul 27 17:33:07.103231 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:33:07.103200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb51f43_a21e_4d51_b65c_72cfee408cd5.slice/crio-0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645 WatchSource:0}: Error finding container 0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645: Status 404 returned error can't find the container with id 0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645
Jul 27 17:33:07.393056 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:07.392979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:07.484672 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:07.484637    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerID="ab127ff67e2ee441f3f2980810c52b59435743bc936288b43c8c659be7139c6d" exitCode=0
Jul 27 17:33:07.484817 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:07.484721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4" event={"ID":"5fb51f43-a21e-4d51-b65c-72cfee408cd5","Type":"ContainerDied","Data":"ab127ff67e2ee441f3f2980810c52b59435743bc936288b43c8c659be7139c6d"}
Jul 27 17:33:07.484817 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:07.484774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4" event={"ID":"5fb51f43-a21e-4d51-b65c-72cfee408cd5","Type":"ContainerStarted","Data":"0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645"}
Jul 27 17:33:08.492112 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:08.492083    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerID="3660e9bdff0c2b818072c0b6bd03a4817df261769552175c5fa76e0ef07241ee" exitCode=0
Jul 27 17:33:08.492514 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:08.492156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4" event={"ID":"5fb51f43-a21e-4d51-b65c-72cfee408cd5","Type":"ContainerDied","Data":"3660e9bdff0c2b818072c0b6bd03a4817df261769552175c5fa76e0ef07241ee"}
Jul 27 17:33:09.498430 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:09.498394    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerID="3f3d75a6a47b6f972812ca3027dcfa3aaeed7ea43cd9928234efd8c406fcb76c" exitCode=0
Jul 27 17:33:09.498860 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:09.498462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4" event={"ID":"5fb51f43-a21e-4d51-b65c-72cfee408cd5","Type":"ContainerDied","Data":"3f3d75a6a47b6f972812ca3027dcfa3aaeed7ea43cd9928234efd8c406fcb76c"}
Jul 27 17:33:10.632145 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.632123    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:10.692619 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.692590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util\") pod \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") "
Jul 27 17:33:10.692761 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.692635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkddl\" (UniqueName: \"kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl\") pod \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") "
Jul 27 17:33:10.692761 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.692699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle\") pod \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\" (UID: \"5fb51f43-a21e-4d51-b65c-72cfee408cd5\") "
Jul 27 17:33:10.693441 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.693407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle" (OuterVolumeSpecName: "bundle") pod "5fb51f43-a21e-4d51-b65c-72cfee408cd5" (UID: "5fb51f43-a21e-4d51-b65c-72cfee408cd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:33:10.694756 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.694731    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl" (OuterVolumeSpecName: "kube-api-access-jkddl") pod "5fb51f43-a21e-4d51-b65c-72cfee408cd5" (UID: "5fb51f43-a21e-4d51-b65c-72cfee408cd5"). InnerVolumeSpecName "kube-api-access-jkddl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:33:10.697689 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.697670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util" (OuterVolumeSpecName: "util") pod "5fb51f43-a21e-4d51-b65c-72cfee408cd5" (UID: "5fb51f43-a21e-4d51-b65c-72cfee408cd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:33:10.794236 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.794141    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkddl\" (UniqueName: \"kubernetes.io/projected/5fb51f43-a21e-4d51-b65c-72cfee408cd5-kube-api-access-jkddl\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:33:10.794236 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.794172    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:33:10.794236 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:10.794200    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb51f43-a21e-4d51-b65c-72cfee408cd5-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:33:11.509109 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:11.509082    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4"
Jul 27 17:33:11.509292 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:11.509105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg4jt4" event={"ID":"5fb51f43-a21e-4d51-b65c-72cfee408cd5","Type":"ContainerDied","Data":"0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645"}
Jul 27 17:33:11.509292 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:11.509149    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0642021dd324f7e2660eb3fdefba316ae08adbe9b9cc47e454f0276bf7511645"
Jul 27 17:33:20.998287 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:20.998241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:21.111570 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.111532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:21.596856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.596806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:21.830441 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.830412    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:21.931993 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.931912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:21.949044 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949015    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"]
Jul 27 17:33:21.949368 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949354    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="pull"
Jul 27 17:33:21.949415 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949371    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="pull"
Jul 27 17:33:21.949415 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949387    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="extract"
Jul 27 17:33:21.949415 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949393    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="extract"
Jul 27 17:33:21.949415 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949405    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="util"
Jul 27 17:33:21.949415 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949411    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="util"
Jul 27 17:33:21.949564 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.949468    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb51f43-a21e-4d51-b65c-72cfee408cd5" containerName="extract"
Jul 27 17:33:21.955563 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.953582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:21.957864 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.957830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 17:33:21.958002 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.957981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 17:33:21.958243 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.958226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b9sxj\""
Jul 27 17:33:21.958497 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.958483    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 17:33:21.958631 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.958617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 17:33:21.966133 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:21.966114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"]
Jul 27 17:33:22.086265 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.086228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.086707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.086274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.086707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.086342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.086707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.086365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-254ng\" (UniqueName: \"kubernetes.io/projected/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-kube-api-access-254ng\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.086707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.086479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.185032 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.184943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.187127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.187292 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.187292 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.187292 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.187468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-254ng\" (UniqueName: \"kubernetes.io/projected/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-kube-api-access-254ng\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.187659 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.187631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.189416 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.189398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.189632 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.189615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.189779 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.189759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.198662 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.198643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-254ng\" (UniqueName: \"kubernetes.io/projected/9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe-kube-api-access-254ng\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-8jf2k\" (UID: \"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.264816 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.264793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:22.293433 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.293402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.385282 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.385248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.400435 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.400413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"]
Jul 27 17:33:22.402397 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:33:22.402372    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9701a6ca_3ed0_4ab4_8ddf_11e4b1d9e5fe.slice/crio-01811da7c1d43f1a5354feece5b7c8d670e18420889329148befe1f2031816ef WatchSource:0}: Error finding container 01811da7c1d43f1a5354feece5b7c8d670e18420889329148befe1f2031816ef: Status 404 returned error can't find the container with id 01811da7c1d43f1a5354feece5b7c8d670e18420889329148befe1f2031816ef
Jul 27 17:33:22.486426 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.486395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.557796 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.557768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k" event={"ID":"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe","Type":"ContainerStarted","Data":"01811da7c1d43f1a5354feece5b7c8d670e18420889329148befe1f2031816ef"}
Jul 27 17:33:22.587742 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.587714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.688064 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:22.688036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:26.580732 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:26.580694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k" event={"ID":"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe","Type":"ContainerStarted","Data":"5416047cbecb714774dfa6fe53e66b2c8bb8bd21d64ff2b3cbe57c04250d4238"}
Jul 27 17:33:27.592830 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:27.592728    2564 generic.go:356] "Generic (PLEG): container finished" podID="9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe" containerID="5416047cbecb714774dfa6fe53e66b2c8bb8bd21d64ff2b3cbe57c04250d4238" exitCode=0
Jul 27 17:33:27.593295 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:27.592838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k" event={"ID":"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe","Type":"ContainerDied","Data":"5416047cbecb714774dfa6fe53e66b2c8bb8bd21d64ff2b3cbe57c04250d4238"}
Jul 27 17:33:27.690854 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:27.690819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:27.786150 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:27.786120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:28.600538 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:28.600506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k" event={"ID":"9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe","Type":"ContainerStarted","Data":"47a6b8f24a5be2d3e49f047b544e30d7f227eed61fb5b484f876e078ab4a6f66"}
Jul 27 17:33:28.600974 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:28.600602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:28.628258 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:28.628211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k" podStartSLOduration=2.510781781 podStartE2EDuration="7.628195882s" totalImagesPullingTime="4.114484844s" totalInitContainerRuntime="1.002929257s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:28.625529634 +0000 UTC m=+504.502730860" watchObservedRunningTime="2026-07-27 17:33:28.628195882 +0000 UTC m=+504.505397077"
Jul 27 17:33:33.856362 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:33.856324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:33.962385 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:33.962353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:39.607402 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:39.607370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-8jf2k"
Jul 27 17:33:40.077661 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.077626    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"]
Jul 27 17:33:40.083233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.083210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.086093 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.086070    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 17:33:40.087533 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.087513    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dmthm\""
Jul 27 17:33:40.087671 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.087570    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:33:40.087960 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.087773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 17:33:40.088082 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.087847    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 17:33:40.088149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.087998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 17:33:40.091042 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.090674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"]
Jul 27 17:33:40.144500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.144467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.144612 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.144508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.144612 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.144593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhp9k\" (UniqueName: \"kubernetes.io/projected/794f6572-3a54-4d49-b7c6-c4195ae8e242-kube-api-access-qhp9k\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.144697 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.144671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/794f6572-3a54-4d49-b7c6-c4195ae8e242-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.245374 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.245347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/794f6572-3a54-4d49-b7c6-c4195ae8e242-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.245520 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.245382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.245520 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.245405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.245520 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.245442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhp9k\" (UniqueName: \"kubernetes.io/projected/794f6572-3a54-4d49-b7c6-c4195ae8e242-kube-api-access-qhp9k\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.245977 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.245957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/794f6572-3a54-4d49-b7c6-c4195ae8e242-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.247845 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.247823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.247920 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.247911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/794f6572-3a54-4d49-b7c6-c4195ae8e242-cert\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.253955 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.253936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhp9k\" (UniqueName: \"kubernetes.io/projected/794f6572-3a54-4d49-b7c6-c4195ae8e242-kube-api-access-qhp9k\") pod \"lws-controller-manager-7bbdc85ff6-ckvkv\" (UID: \"794f6572-3a54-4d49-b7c6-c4195ae8e242\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.393366 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.393288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:40.544269 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.544235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"]
Jul 27 17:33:40.545258 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:33:40.545233    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794f6572_3a54_4d49_b7c6_c4195ae8e242.slice/crio-f5775513e16f28b1aae374dcd85d99698d22844fb9ff57169626aa49a6364708 WatchSource:0}: Error finding container f5775513e16f28b1aae374dcd85d99698d22844fb9ff57169626aa49a6364708: Status 404 returned error can't find the container with id f5775513e16f28b1aae374dcd85d99698d22844fb9ff57169626aa49a6364708
Jul 27 17:33:40.656969 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:40.656889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv" event={"ID":"794f6572-3a54-4d49-b7c6-c4195ae8e242","Type":"ContainerStarted","Data":"f5775513e16f28b1aae374dcd85d99698d22844fb9ff57169626aa49a6364708"}
Jul 27 17:33:41.706127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:41.706073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:41.828825 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:41.828789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:42.488361 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.488285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:42.616510 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.616486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:42.671091 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.671064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv" event={"ID":"794f6572-3a54-4d49-b7c6-c4195ae8e242","Type":"ContainerStarted","Data":"bddc5895f6837723d995dab16fa06a83adbb99bcc78f6fb5fda48a2eb0db70d4"}
Jul 27 17:33:42.671245 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.671174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:42.690397 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.690347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv" podStartSLOduration=0.646931342 podStartE2EDuration="2.690329874s" totalImagesPullingTime="2.043398532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:42.689040193 +0000 UTC m=+518.566241397" watchObservedRunningTime="2026-07-27 17:33:42.690329874 +0000 UTC m=+518.567531077"
Jul 27 17:33:42.696906 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.696877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:42.784069 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.783986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:42.875917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:42.875885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:43.548210 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:43.548163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:43.726983 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:43.726949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:43.803025 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:43.802928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:44.753532 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:44.753500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:49.428700 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.428666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:49.512811 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.512773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:49.874696 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.874657    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"]
Jul 27 17:33:49.877651 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.877634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.880863 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.880833    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 17:33:49.881000 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.880873    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 17:33:49.881000 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.880989    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mpt8w\""
Jul 27 17:33:49.881164 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.881141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 17:33:49.881484 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.881467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 17:33:49.893137 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.893111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"]
Jul 27 17:33:49.930631 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d78d7b21-4aa3-4b2b-877e-18838eb4db29-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930760 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930836 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930836 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930836 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4qw\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-kube-api-access-sj4qw\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:49.930927 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:49.930877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031737 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031737 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4qw\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-kube-api-access-sj4qw\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d78d7b21-4aa3-4b2b-877e-18838eb4db29-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.031949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.031901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.032580 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.032553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.034241 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.034214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.034342 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.034250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.034342 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.034249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d78d7b21-4aa3-4b2b-877e-18838eb4db29-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.034431 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.034410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.039607 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.039581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.039702 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.039680    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4qw\" (UniqueName: \"kubernetes.io/projected/d78d7b21-4aa3-4b2b-877e-18838eb4db29-kube-api-access-sj4qw\") pod \"istiod-openshift-gateway-5677ccb49b-whvn6\" (UID: \"d78d7b21-4aa3-4b2b-877e-18838eb4db29\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.187686 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.187608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:50.225694 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.225652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:50.340542 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.340519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"]
Jul 27 17:33:50.342564 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:33:50.342522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78d7b21_4aa3_4b2b_877e_18838eb4db29.slice/crio-7ab3dd4275e2ab60b3f777544f6e517b44dd65be3bea08f8153b11ce96117964 WatchSource:0}: Error finding container 7ab3dd4275e2ab60b3f777544f6e517b44dd65be3bea08f8153b11ce96117964: Status 404 returned error can't find the container with id 7ab3dd4275e2ab60b3f777544f6e517b44dd65be3bea08f8153b11ce96117964
Jul 27 17:33:50.519750 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.519716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:50.619943 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.619909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:50.712683 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:50.712648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6" event={"ID":"d78d7b21-4aa3-4b2b-877e-18838eb4db29","Type":"ContainerStarted","Data":"7ab3dd4275e2ab60b3f777544f6e517b44dd65be3bea08f8153b11ce96117964"}
Jul 27 17:33:52.618844 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:52.618805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:52.758778 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:52.758746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:52.995315 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:52.995277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:53.114350 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:53.114312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:53.682635 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:53.682601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:33:54.011018 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.010983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:54.125250 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.125207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:54.219652 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.219601    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:54.219748 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.219692    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:54.735570 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.735536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6" event={"ID":"d78d7b21-4aa3-4b2b-877e-18838eb4db29","Type":"ContainerStarted","Data":"66c09379bc3de110dbd3dfff6ecaa2e45e49c56f2024499c2f89af40e0ef050b"}
Jul 27 17:33:54.735987 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.735642    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:54.798000 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:54.797942    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6" podStartSLOduration=1.923656008 podStartE2EDuration="5.797925805s" totalImagesPullingTime="3.874269797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:54.79500219 +0000 UTC m=+530.672203395" watchObservedRunningTime="2026-07-27 17:33:54.797925805 +0000 UTC m=+530.675127008"
Jul 27 17:33:55.742754 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:55.742723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-whvn6"
Jul 27 17:33:56.763068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:33:56.762993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:10.586902 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:10.586864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:10.649260 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:10.649230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:12.531257 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:12.531208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:12.632272 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:12.632235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:29.022443 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:29.022411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:43.110331 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:43.110299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:43.208067 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:43.208030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:43.297291 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:43.297264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:44.038123 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:44.038093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:44.247171 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:44.247139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:50.787940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:50.787904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:50.845051 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:34:50.845023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:00.620766 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.620726    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"]
Jul 27 17:35:00.624347 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.624328    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.627108 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.627073    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:35:00.627229 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.627169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-js8m8\""
Jul 27 17:35:00.628573 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.628553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:35:00.631245 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.631224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"]
Jul 27 17:35:00.719658 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.719626    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"]
Jul 27 17:35:00.723076 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.723056    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.731080 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.731062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"]
Jul 27 17:35:00.760508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.760487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.760614 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.760519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gldw\" (UniqueName: \"kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.760614 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.760567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.825954 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.825926    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"]
Jul 27 17:35:00.829332 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.829313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:00.836557 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.836536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"]
Jul 27 17:35:00.861964 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.861942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.862085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.861974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg5s9\" (UniqueName: \"kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.862085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.861996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gldw\" (UniqueName: \"kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.862085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.862029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.862085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.862051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.862349 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.862121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.862410 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.862356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.862410 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.862368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.871064 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.871010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gldw\" (UniqueName: \"kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.924262 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.924231    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"]
Jul 27 17:35:00.927755 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.927737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:00.934675 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.934653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:00.935881 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.935862    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"]
Jul 27 17:35:00.963014 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.962991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:00.963129 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ppzq\" (UniqueName: \"kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:00.963129 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg5s9\" (UniqueName: \"kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.963324 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.963324 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:00.963324 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.963552 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.963657 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.963632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:00.972468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:00.972442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg5s9\" (UniqueName: \"kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:01.032509 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.032478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:01.064232 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064206    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"]
Jul 27 17:35:01.064609 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.064699 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.064757 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.064810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dbw\" (UniqueName: \"kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.064866 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ppzq\" (UniqueName: \"kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.064989 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.064966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.065104 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.065001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.065104 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.065007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.065317 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:35:01.065299    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90849639_0d7e_4dea_a99f_c421d1c12726.slice/crio-e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635 WatchSource:0}: Error finding container e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635: Status 404 returned error can't find the container with id e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635
Jul 27 17:35:01.073797 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.073780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ppzq\" (UniqueName: \"kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.139079 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.139046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:01.166357 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.166328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.166472 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.166366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dbw\" (UniqueName: \"kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.166472 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.166409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.166777 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.166758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.166936 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.166903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.174740 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.174683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"]
Jul 27 17:35:01.175871 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:35:01.175843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5017a89_ba1b_4769_b1d8_fa87480eac60.slice/crio-a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d WatchSource:0}: Error finding container a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d: Status 404 returned error can't find the container with id a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d
Jul 27 17:35:01.176020 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.176000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dbw\" (UniqueName: \"kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.238119 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.237873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:01.287104 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.287075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"]
Jul 27 17:35:01.289780 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:35:01.289744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0fb4c7_c38c_4a47_9bf1_8fd70fbdbab4.slice/crio-b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a WatchSource:0}: Error finding container b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a: Status 404 returned error can't find the container with id b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a
Jul 27 17:35:01.381423 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:01.381396    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"]
Jul 27 17:35:01.383008 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:35:01.382980    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be1c994_c76d_49b2_9d18_5a3c845de86a.slice/crio-ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d WatchSource:0}: Error finding container ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d: Status 404 returned error can't find the container with id ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d
Jul 27 17:35:02.060625 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.060586    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerID="c3462d4f5bbef8031b8fd5a38279914bbe5a3b48a371dcc533ae4ae072b75e55" exitCode=0
Jul 27 17:35:02.061110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.060627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x" event={"ID":"3be1c994-c76d-49b2-9d18-5a3c845de86a","Type":"ContainerDied","Data":"c3462d4f5bbef8031b8fd5a38279914bbe5a3b48a371dcc533ae4ae072b75e55"}
Jul 27 17:35:02.061110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.060718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x" event={"ID":"3be1c994-c76d-49b2-9d18-5a3c845de86a","Type":"ContainerStarted","Data":"ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d"}
Jul 27 17:35:02.062250 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.062231    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerID="a016940f5187a4fd486328a77e75c13fab115efd2dc7a2902260045344598c53" exitCode=0
Jul 27 17:35:02.062364 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.062251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs" event={"ID":"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4","Type":"ContainerDied","Data":"a016940f5187a4fd486328a77e75c13fab115efd2dc7a2902260045344598c53"}
Jul 27 17:35:02.062364 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.062288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs" event={"ID":"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4","Type":"ContainerStarted","Data":"b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a"}
Jul 27 17:35:02.063732 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.063701    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerID="150c338e069153c46e2fb984d0c9e34327988d15844253d3e01f184a50a23a74" exitCode=0
Jul 27 17:35:02.063826 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.063785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd" event={"ID":"e5017a89-ba1b-4769-b1d8-fa87480eac60","Type":"ContainerDied","Data":"150c338e069153c46e2fb984d0c9e34327988d15844253d3e01f184a50a23a74"}
Jul 27 17:35:02.063895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.063823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd" event={"ID":"e5017a89-ba1b-4769-b1d8-fa87480eac60","Type":"ContainerStarted","Data":"a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d"}
Jul 27 17:35:02.065378 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.065358    2564 generic.go:356] "Generic (PLEG): container finished" podID="90849639-0d7e-4dea-a99f-c421d1c12726" containerID="76a993e5f0dcc22f7a4d8050ac003f5347c93485163a095ab7e2bc2b30494564" exitCode=0
Jul 27 17:35:02.065475 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.065415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp" event={"ID":"90849639-0d7e-4dea-a99f-c421d1c12726","Type":"ContainerDied","Data":"76a993e5f0dcc22f7a4d8050ac003f5347c93485163a095ab7e2bc2b30494564"}
Jul 27 17:35:02.065475 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:02.065448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp" event={"ID":"90849639-0d7e-4dea-a99f-c421d1c12726","Type":"ContainerStarted","Data":"e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635"}
Jul 27 17:35:04.078586 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.078558    2564 generic.go:356] "Generic (PLEG): container finished" podID="90849639-0d7e-4dea-a99f-c421d1c12726" containerID="d9877e1effca9bf1a451d27ef449a8ca01748d6e02af38549c8af3bf82deb694" exitCode=0
Jul 27 17:35:04.079036 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.078646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp" event={"ID":"90849639-0d7e-4dea-a99f-c421d1c12726","Type":"ContainerDied","Data":"d9877e1effca9bf1a451d27ef449a8ca01748d6e02af38549c8af3bf82deb694"}
Jul 27 17:35:04.080531 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.080507    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerID="cfe68d445808c77535383d0c682e52bbc87fe5f2254115b04a78667208cac9d6" exitCode=0
Jul 27 17:35:04.080619 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.080537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x" event={"ID":"3be1c994-c76d-49b2-9d18-5a3c845de86a","Type":"ContainerDied","Data":"cfe68d445808c77535383d0c682e52bbc87fe5f2254115b04a78667208cac9d6"}
Jul 27 17:35:04.082511 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.082490    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerID="833dea90f572fccdbc34c84dd0e90e122731e0ae1fa3d8cf17b0f4a29beb6873" exitCode=0
Jul 27 17:35:04.082588 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.082513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs" event={"ID":"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4","Type":"ContainerDied","Data":"833dea90f572fccdbc34c84dd0e90e122731e0ae1fa3d8cf17b0f4a29beb6873"}
Jul 27 17:35:04.084613 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.084593    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerID="7845b5834ea5c2a042fd3bf75044b997619922a1c45f8f8dce7c1bfd188990e3" exitCode=0
Jul 27 17:35:04.084707 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:04.084620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd" event={"ID":"e5017a89-ba1b-4769-b1d8-fa87480eac60","Type":"ContainerDied","Data":"7845b5834ea5c2a042fd3bf75044b997619922a1c45f8f8dce7c1bfd188990e3"}
Jul 27 17:35:05.090948 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.090916    2564 generic.go:356] "Generic (PLEG): container finished" podID="90849639-0d7e-4dea-a99f-c421d1c12726" containerID="2659a491d7cd6f33917a1361f412afe912cf47368081610026c702e84c971f61" exitCode=0
Jul 27 17:35:05.091384 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.091002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp" event={"ID":"90849639-0d7e-4dea-a99f-c421d1c12726","Type":"ContainerDied","Data":"2659a491d7cd6f33917a1361f412afe912cf47368081610026c702e84c971f61"}
Jul 27 17:35:05.092917 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.092897    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerID="a640dcf3c0ed85a91c3919a73a5bd17ff8fa5594bbb7a9548dd385db08607928" exitCode=0
Jul 27 17:35:05.093047 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.092965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x" event={"ID":"3be1c994-c76d-49b2-9d18-5a3c845de86a","Type":"ContainerDied","Data":"a640dcf3c0ed85a91c3919a73a5bd17ff8fa5594bbb7a9548dd385db08607928"}
Jul 27 17:35:05.094702 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.094680    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerID="7393d0c4a1c518fe1439ac07d11edadb145836a64586e24511076d5e27719a54" exitCode=0
Jul 27 17:35:05.094790 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.094757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs" event={"ID":"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4","Type":"ContainerDied","Data":"7393d0c4a1c518fe1439ac07d11edadb145836a64586e24511076d5e27719a54"}
Jul 27 17:35:05.096777 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.096756    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerID="cee6cfb99d0dd83b1ce824dce56f6e12f5630369ee4b6526d274a640f4e9da80" exitCode=0
Jul 27 17:35:05.096856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:05.096822    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd" event={"ID":"e5017a89-ba1b-4769-b1d8-fa87480eac60","Type":"ContainerDied","Data":"cee6cfb99d0dd83b1ce824dce56f6e12f5630369ee4b6526d274a640f4e9da80"}
Jul 27 17:35:06.250366 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.250031    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:06.296611 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.296589    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:06.299447 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.299427    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:06.314856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.314834    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util\") pod \"e5017a89-ba1b-4769-b1d8-fa87480eac60\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") "
Jul 27 17:35:06.314969 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.314873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle\") pod \"e5017a89-ba1b-4769-b1d8-fa87480eac60\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") "
Jul 27 17:35:06.315041 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315008    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2dbw\" (UniqueName: \"kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw\") pod \"3be1c994-c76d-49b2-9d18-5a3c845de86a\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") "
Jul 27 17:35:06.315097 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315062    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle\") pod \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") "
Jul 27 17:35:06.315149 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg5s9\" (UniqueName: \"kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9\") pod \"e5017a89-ba1b-4769-b1d8-fa87480eac60\" (UID: \"e5017a89-ba1b-4769-b1d8-fa87480eac60\") "
Jul 27 17:35:06.315670 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315215    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ppzq\" (UniqueName: \"kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq\") pod \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") "
Jul 27 17:35:06.315670 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315262    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util\") pod \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\" (UID: \"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4\") "
Jul 27 17:35:06.315670 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle\") pod \"3be1c994-c76d-49b2-9d18-5a3c845de86a\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") "
Jul 27 17:35:06.315670 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.315350    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util\") pod \"3be1c994-c76d-49b2-9d18-5a3c845de86a\" (UID: \"3be1c994-c76d-49b2-9d18-5a3c845de86a\") "
Jul 27 17:35:06.316469 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.316425    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle" (OuterVolumeSpecName: "bundle") pod "e5017a89-ba1b-4769-b1d8-fa87480eac60" (UID: "e5017a89-ba1b-4769-b1d8-fa87480eac60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.316621 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.316596    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle" (OuterVolumeSpecName: "bundle") pod "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" (UID: "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.316837 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.316797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle" (OuterVolumeSpecName: "bundle") pod "3be1c994-c76d-49b2-9d18-5a3c845de86a" (UID: "3be1c994-c76d-49b2-9d18-5a3c845de86a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.319834 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.319791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq" (OuterVolumeSpecName: "kube-api-access-4ppzq") pod "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" (UID: "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4"). InnerVolumeSpecName "kube-api-access-4ppzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:06.320007 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.319983    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw" (OuterVolumeSpecName: "kube-api-access-k2dbw") pod "3be1c994-c76d-49b2-9d18-5a3c845de86a" (UID: "3be1c994-c76d-49b2-9d18-5a3c845de86a"). InnerVolumeSpecName "kube-api-access-k2dbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:06.320202 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.320152    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9" (OuterVolumeSpecName: "kube-api-access-zg5s9") pod "e5017a89-ba1b-4769-b1d8-fa87480eac60" (UID: "e5017a89-ba1b-4769-b1d8-fa87480eac60"). InnerVolumeSpecName "kube-api-access-zg5s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:06.320925 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.320904    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:06.322378 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.322356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util" (OuterVolumeSpecName: "util") pod "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" (UID: "1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.323326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.323307    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util" (OuterVolumeSpecName: "util") pod "3be1c994-c76d-49b2-9d18-5a3c845de86a" (UID: "3be1c994-c76d-49b2-9d18-5a3c845de86a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.325313 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.325289    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util" (OuterVolumeSpecName: "util") pod "e5017a89-ba1b-4769-b1d8-fa87480eac60" (UID: "e5017a89-ba1b-4769-b1d8-fa87480eac60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.416067 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.415995    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle\") pod \"90849639-0d7e-4dea-a99f-c421d1c12726\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") "
Jul 27 17:35:06.416067 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416062    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util\") pod \"90849639-0d7e-4dea-a99f-c421d1c12726\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") "
Jul 27 17:35:06.416299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416096    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gldw\" (UniqueName: \"kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw\") pod \"90849639-0d7e-4dea-a99f-c421d1c12726\" (UID: \"90849639-0d7e-4dea-a99f-c421d1c12726\") "
Jul 27 17:35:06.416299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416269    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416278    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be1c994-c76d-49b2-9d18-5a3c845de86a-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416286    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416294    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5017a89-ba1b-4769-b1d8-fa87480eac60-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416303    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2dbw\" (UniqueName: \"kubernetes.io/projected/3be1c994-c76d-49b2-9d18-5a3c845de86a-kube-api-access-k2dbw\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416312    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416320    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg5s9\" (UniqueName: \"kubernetes.io/projected/e5017a89-ba1b-4769-b1d8-fa87480eac60-kube-api-access-zg5s9\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416328    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ppzq\" (UniqueName: \"kubernetes.io/projected/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-kube-api-access-4ppzq\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416470 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416335    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.416630 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.416509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle" (OuterVolumeSpecName: "bundle") pod "90849639-0d7e-4dea-a99f-c421d1c12726" (UID: "90849639-0d7e-4dea-a99f-c421d1c12726"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.418136 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.418117    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw" (OuterVolumeSpecName: "kube-api-access-4gldw") pod "90849639-0d7e-4dea-a99f-c421d1c12726" (UID: "90849639-0d7e-4dea-a99f-c421d1c12726"). InnerVolumeSpecName "kube-api-access-4gldw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:06.421076 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.421054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util" (OuterVolumeSpecName: "util") pod "90849639-0d7e-4dea-a99f-c421d1c12726" (UID: "90849639-0d7e-4dea-a99f-c421d1c12726"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:06.517338 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.517296    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-util\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.517338 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.517329    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gldw\" (UniqueName: \"kubernetes.io/projected/90849639-0d7e-4dea-a99f-c421d1c12726-kube-api-access-4gldw\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:06.517338 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:06.517340    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90849639-0d7e-4dea-a99f-c421d1c12726-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:35:07.112908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.112879    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd"
Jul 27 17:35:07.112908 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.112886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd" event={"ID":"e5017a89-ba1b-4769-b1d8-fa87480eac60","Type":"ContainerDied","Data":"a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d"}
Jul 27 17:35:07.113159 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.112942    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0adb2625183618f236511fb0623be07a88804009f8493d3ca6b44f74860ff1d"
Jul 27 17:35:07.114821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.114792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp"
Jul 27 17:35:07.114821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.114798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp" event={"ID":"90849639-0d7e-4dea-a99f-c421d1c12726","Type":"ContainerDied","Data":"e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635"}
Jul 27 17:35:07.115005 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.114871    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1b3749f1d54f552595c5b538e005b41b21c488a9c46bbd570165428a37c1635"
Jul 27 17:35:07.117099 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.117069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x" event={"ID":"3be1c994-c76d-49b2-9d18-5a3c845de86a","Type":"ContainerDied","Data":"ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d"}
Jul 27 17:35:07.117099 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.117085    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x"
Jul 27 17:35:07.117306 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.117108    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac10ff96b59061f395c9b941af7cfaf0f8d618c82bc788bdbde1e0702d95341d"
Jul 27 17:35:07.119337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.119310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs" event={"ID":"1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4","Type":"ContainerDied","Data":"b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a"}
Jul 27 17:35:07.119460 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.119347    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6cf0b0ed5a1c638ac0972ef92a1d847e6116bf4ecb6146622fe41b34337c13a"
Jul 27 17:35:07.119533 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:07.119489    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs"
Jul 27 17:35:13.098142 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:13.098108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:16.508128 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:16.508080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:18.477421 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:18.477386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:20.273339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:20.273303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:20.680713 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:20.680641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:21.713572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:21.713534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:23.886170 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:23.886136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:24.138238 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:24.138122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:26.118664 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:26.118627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:27.630980 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:27.630949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:27.975207 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:27.975154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:28.473712 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:28.473683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:28.557535 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:28.557508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:36.890223 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:36.890187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:36.986408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:36.986330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:39.607813 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.607775    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608121    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="util"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608133    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="util"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608148    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="util"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="util"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608158    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="pull"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608164    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="pull"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608169    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="pull"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608173    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="pull"
Jul 27 17:35:39.608195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608198    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="util"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608204    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="util"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608212    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="pull"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608217    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="pull"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608226    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="util"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608234    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="util"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608245    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608251    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608256    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608267    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="pull"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608276    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="pull"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608283    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608288    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608294    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608298    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608364    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be1c994-c76d-49b2-9d18-5a3c845de86a" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608374    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="90849639-0d7e-4dea-a99f-c421d1c12726" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608379    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4" containerName="extract"
Jul 27 17:35:39.608468 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.608384    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5017a89-ba1b-4769-b1d8-fa87480eac60" containerName="extract"
Jul 27 17:35:39.611377 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.611359    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.618094 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.617741    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:35:39.618094 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.618039    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:35:39.618094 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.618053    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fv9v\""
Jul 27 17:35:39.634250 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.634225    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:35:39.706279 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.706247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.706448 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.706313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccsx7\" (UniqueName: \"kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.807565 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.807528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.807729 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.807608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccsx7\" (UniqueName: \"kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.807932 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.807877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.819658 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.819636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccsx7\" (UniqueName: \"kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7\") pod \"kuadrant-operator-controller-manager-86878c769f-zpncz\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:39.921623 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:39.921555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:40.052110 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:40.052083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:35:40.054228 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:35:40.054203    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bf1f16_4047_498c_b5b0_c0fdc5d0d147.slice/crio-acdad0225e5822c44345c2d328c51c3aae1f3f3524b03dd3ce9ee5392b5b8bba WatchSource:0}: Error finding container acdad0225e5822c44345c2d328c51c3aae1f3f3524b03dd3ce9ee5392b5b8bba: Status 404 returned error can't find the container with id acdad0225e5822c44345c2d328c51c3aae1f3f3524b03dd3ce9ee5392b5b8bba
Jul 27 17:35:40.286781 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:40.286744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" event={"ID":"29bf1f16-4047-498c-b5b0-c0fdc5d0d147","Type":"ContainerStarted","Data":"acdad0225e5822c44345c2d328c51c3aae1f3f3524b03dd3ce9ee5392b5b8bba"}
Jul 27 17:35:41.738954 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:41.738908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:41.857254 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:41.857214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:44.135526 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:44.135481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:44.193459 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:44.193394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:45.321380 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:45.321349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" event={"ID":"29bf1f16-4047-498c-b5b0-c0fdc5d0d147","Type":"ContainerStarted","Data":"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"}
Jul 27 17:35:45.321814 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:45.321432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:45.345653 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:45.345602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" podStartSLOduration=1.256669542 podStartE2EDuration="6.345578765s" totalImagesPullingTime="5.088909223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:45.343928312 +0000 UTC m=+641.221129517" watchObservedRunningTime="2026-07-27 17:35:45.345578765 +0000 UTC m=+641.222779971"
Jul 27 17:35:49.894082 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:49.894044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:49.947288 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:49.947259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:56.329529 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:56.329499    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:35:56.794998 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:56.794964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:56.897376 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:56.897303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:59.488420 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:59.488382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:59.589093 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:35:59.589065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:04.095870 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:04.095838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:04.156969 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:04.156930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:04.686658 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:04.686622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:04.788142 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:04.788115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:08.284700 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:08.284667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:08.385045 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:08.385012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:12.748469 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:12.748436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:12.994883 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:12.994850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:15.266866 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:15.266835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:15.373621 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:15.373584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:15.474971 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:15.474941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:16.225127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:16.225091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:16.387372 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:16.387336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:30.126895 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:30.126859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:36.389453 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:36.389415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:36.491512 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:36.491482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:36.834624 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:36.834592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:48.690098 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:48.690065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:48.857726 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:48.857696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:54.988824 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:54.988788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:55.086529 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:55.086497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:55.170495 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:55.170463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:58.832064 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:58.831977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:58.931977 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:36:58.931934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:31.569159 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:31.569127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:32.399985 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:32.399948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:32.499476 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:32.499430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:32.604063 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:32.604030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:32.699746 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:32.699717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:32.810197 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:32.810149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:42.627352 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:42.627318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:42.725486 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:42.725455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:53.621887 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:37:53.621847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:06.203438 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.203403    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"]
Jul 27 17:38:06.206884 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.206862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.211085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.211063    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khxw9\""
Jul 27 17:38:06.211216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.211063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 17:38:06.211216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.211111    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 17:38:06.211216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.211111    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 17:38:06.216912 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.216890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"]
Jul 27 17:38:06.231913 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.231884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:06.377839 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.377803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.377839 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.377839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tscpm\" (UniqueName: \"kubernetes.io/projected/08d3615c-9a7f-4b9b-9b7a-445cec261602-kube-api-access-tscpm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.378116 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.377873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.378116 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.377917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.378116 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.377932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3615c-9a7f-4b9b-9b7a-445cec261602-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.378116 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.378009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.470243 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.470155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:06.479441 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3615c-9a7f-4b9b-9b7a-445cec261602-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tscpm\" (UniqueName: \"kubernetes.io/projected/08d3615c-9a7f-4b9b-9b7a-445cec261602-kube-api-access-tscpm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479776 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479903 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479972 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.479972 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.479952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.481802 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.481768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d3615c-9a7f-4b9b-9b7a-445cec261602-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.482019 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.482004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3615c-9a7f-4b9b-9b7a-445cec261602-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.488674 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.488646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tscpm\" (UniqueName: \"kubernetes.io/projected/08d3615c-9a7f-4b9b-9b7a-445cec261602-kube-api-access-tscpm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-75l82\" (UID: \"08d3615c-9a7f-4b9b-9b7a-445cec261602\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.517681 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.517648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:06.652347 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.652322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"]
Jul 27 17:38:06.653857 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:38:06.653831    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d3615c_9a7f_4b9b_9b7a_445cec261602.slice/crio-9077c3e82b28a71fb27a5b02ce596f221ce4f1182edfa90fe5ee15a263c96d73 WatchSource:0}: Error finding container 9077c3e82b28a71fb27a5b02ce596f221ce4f1182edfa90fe5ee15a263c96d73: Status 404 returned error can't find the container with id 9077c3e82b28a71fb27a5b02ce596f221ce4f1182edfa90fe5ee15a263c96d73
Jul 27 17:38:06.655502 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:06.655485    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:38:07.041367 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:07.041335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82" event={"ID":"08d3615c-9a7f-4b9b-9b7a-445cec261602","Type":"ContainerStarted","Data":"9077c3e82b28a71fb27a5b02ce596f221ce4f1182edfa90fe5ee15a263c96d73"}
Jul 27 17:38:08.049814 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:08.049720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82" event={"ID":"08d3615c-9a7f-4b9b-9b7a-445cec261602","Type":"ContainerStarted","Data":"0e51d5203cf8ae3778d59fc02261876c99a8bcb2987f53d04d0cc8a37c4989b7"}
Jul 27 17:38:08.070235 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:08.070175    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82" podStartSLOduration=1.033707242 podStartE2EDuration="2.070159485s" totalImagesPullingTime="1.036452243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:38:08.068777762 +0000 UTC m=+783.945978967" watchObservedRunningTime="2026-07-27 17:38:08.070159485 +0000 UTC m=+783.947360687"
Jul 27 17:38:12.249356 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:12.249324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:16.232316 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:16.232282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:16.518164 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:16.518069    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:16.518164 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:16.518139    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:16.531174 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:16.531148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:17.063143 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:17.063111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:17.115138 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:17.115111    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-75l82"
Jul 27 17:38:23.973963 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:23.973920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:35.297706 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.297625    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"]
Jul 27 17:38:35.305259 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.303464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.307221 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.307164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 17:38:35.312795 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.312770    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"]
Jul 27 17:38:35.348098 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.348069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:35.428312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.428473 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.428473 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.428473 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7fn\" (UniqueName: \"kubernetes.io/projected/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-kube-api-access-ps7fn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.428473 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.428473 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.428449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.529940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.529893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.529940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.529950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.529970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7fn\" (UniqueName: \"kubernetes.io/projected/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-kube-api-access-ps7fn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530443 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530443 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.530554 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.530538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.532204 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.532162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.532586 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.532566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.538728 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.538709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7fn\" (UniqueName: \"kubernetes.io/projected/bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6-kube-api-access-ps7fn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xs88s\" (UID: \"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.619334 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.619272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:35.752624 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:35.752600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"]
Jul 27 17:38:35.753870 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:38:35.753839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdf73cc_3d09_4ca2_9b69_f11fd7b674c6.slice/crio-e32df80e413d1d8aff18a8a7d8d5ededcea99758e688c9c875b9f886e407901d WatchSource:0}: Error finding container e32df80e413d1d8aff18a8a7d8d5ededcea99758e688c9c875b9f886e407901d: Status 404 returned error can't find the container with id e32df80e413d1d8aff18a8a7d8d5ededcea99758e688c9c875b9f886e407901d
Jul 27 17:38:36.207263 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:36.207227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s" event={"ID":"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6","Type":"ContainerStarted","Data":"f00e62dda08a1105608b2771c71524bff5aec89bf03277964cc187bb624342f9"}
Jul 27 17:38:36.207395 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:36.207295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s" event={"ID":"bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6","Type":"ContainerStarted","Data":"e32df80e413d1d8aff18a8a7d8d5ededcea99758e688c9c875b9f886e407901d"}
Jul 27 17:38:36.228270 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:36.228227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s" podStartSLOduration=0.850434626 podStartE2EDuration="1.228211722s" totalImagesPullingTime="377.777096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:38:36.226652505 +0000 UTC m=+812.103853708" watchObservedRunningTime="2026-07-27 17:38:36.228211722 +0000 UTC m=+812.105412916"
Jul 27 17:38:36.787308 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:36.787278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:45.619836 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:45.619791    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:45.620337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:45.619857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:45.632050 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:45.632017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:46.274717 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:46.274671    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xs88s"
Jul 27 17:38:55.634408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:38:55.634378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:39:51.741485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:39:51.741455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:39:52.952842 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:39:52.952784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:30.274009 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:41:30.273926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:36.875070 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:41:36.875039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:40.359478 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:41:40.359445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:57.372948 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:41:57.372914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:58.580287 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:41:58.580251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:31.990102 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:31.990060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:32.089235 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:32.089201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:32.307776 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:32.307666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:38.411297 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:38.411257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:38.477579 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:38.477548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:38.566219 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:38.566158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:38.665949 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:38.665857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:38.765594 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:38.765555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:44.826966 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:44.826932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:44.928743 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:42:44.928711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:44:30.023052 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:44:30.022975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:46:35.710360 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:35.710320    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:46:35.713020 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:35.710560    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" podUID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" containerName="manager" containerID="cri-o://ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c" gracePeriod=10
Jul 27 17:46:39.164126 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.164100    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:46:39.253775 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.253702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume\") pod \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") "
Jul 27 17:46:39.253935 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.253782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccsx7\" (UniqueName: \"kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7\") pod \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\" (UID: \"29bf1f16-4047-498c-b5b0-c0fdc5d0d147\") "
Jul 27 17:46:39.254106 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.254084    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29bf1f16-4047-498c-b5b0-c0fdc5d0d147" (UID: "29bf1f16-4047-498c-b5b0-c0fdc5d0d147"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:46:39.255752 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.255727    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7" (OuterVolumeSpecName: "kube-api-access-ccsx7") pod "29bf1f16-4047-498c-b5b0-c0fdc5d0d147" (UID: "29bf1f16-4047-498c-b5b0-c0fdc5d0d147"). InnerVolumeSpecName "kube-api-access-ccsx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:46:39.354728 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.354703    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-extensions-socket-volume\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:46:39.354728 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.354725    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccsx7\" (UniqueName: \"kubernetes.io/projected/29bf1f16-4047-498c-b5b0-c0fdc5d0d147-kube-api-access-ccsx7\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:46:39.757902 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.757867    2564 generic.go:356] "Generic (PLEG): container finished" podID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" containerID="ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c" exitCode=0
Jul 27 17:46:39.758061 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.757915    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"
Jul 27 17:46:39.758061 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.757947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" event={"ID":"29bf1f16-4047-498c-b5b0-c0fdc5d0d147","Type":"ContainerDied","Data":"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"}
Jul 27 17:46:39.758061 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.757997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz" event={"ID":"29bf1f16-4047-498c-b5b0-c0fdc5d0d147","Type":"ContainerDied","Data":"acdad0225e5822c44345c2d328c51c3aae1f3f3524b03dd3ce9ee5392b5b8bba"}
Jul 27 17:46:39.758061 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.758019    2564 scope.go:117] "RemoveContainer" containerID="ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"
Jul 27 17:46:39.769483 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.769467    2564 scope.go:117] "RemoveContainer" containerID="ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"
Jul 27 17:46:39.769712 ip-10-0-143-96 kubenswrapper[2564]: E0727 17:46:39.769692    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c\": container with ID starting with ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c not found: ID does not exist" containerID="ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"
Jul 27 17:46:39.769787 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.769719    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c"} err="failed to get container status \"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c\": rpc error: code = NotFound desc = could not find container \"ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c\": container with ID starting with ca5829518bdcb441506bd1433d97984d5d86e7ae92e08208fc4ffa0c366b6b2c not found: ID does not exist"
Jul 27 17:46:39.782755 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.782734    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:46:39.786744 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:39.786724    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpncz"]
Jul 27 17:46:40.668469 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:46:40.668437    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" path="/var/lib/kubelet/pods/29bf1f16-4047-498c-b5b0-c0fdc5d0d147/volumes"
Jul 27 17:47:03.638551 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:03.638498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:47:06.425197 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:06.425150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:47:36.853015 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.852942    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"]
Jul 27 17:47:36.853481 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.853299    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" containerName="manager"
Jul 27 17:47:36.853481 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.853312    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" containerName="manager"
Jul 27 17:47:36.853481 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.853378    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bf1f16-4047-498c-b5b0-c0fdc5d0d147" containerName="manager"
Jul 27 17:47:36.856304 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.856286    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:36.860289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.860268    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fv9v\""
Jul 27 17:47:36.860634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.860618    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:47:36.860711 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.860672    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:47:36.867082 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.867057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"]
Jul 27 17:47:36.942030 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.941996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a57360-5dfa-4258-b7aa-5c7dfd339b79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:36.942204 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:36.942097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mjg\" (UniqueName: \"kubernetes.io/projected/20a57360-5dfa-4258-b7aa-5c7dfd339b79-kube-api-access-49mjg\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.042983 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.042952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mjg\" (UniqueName: \"kubernetes.io/projected/20a57360-5dfa-4258-b7aa-5c7dfd339b79-kube-api-access-49mjg\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.043127 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.043016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a57360-5dfa-4258-b7aa-5c7dfd339b79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.043390 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.043373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a57360-5dfa-4258-b7aa-5c7dfd339b79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.052783 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.052754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mjg\" (UniqueName: \"kubernetes.io/projected/20a57360-5dfa-4258-b7aa-5c7dfd339b79-kube-api-access-49mjg\") pod \"kuadrant-operator-controller-manager-86878c769f-zjjlc\" (UID: \"20a57360-5dfa-4258-b7aa-5c7dfd339b79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.167151 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.167075    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:37.303725 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:37.303695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"]
Jul 27 17:47:37.304812 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:47:37.304787    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a57360_5dfa_4258_b7aa_5c7dfd339b79.slice/crio-26ed1d40d032339b79dc1cfac4367334f55e18384d785ebbfafe1b6606345367 WatchSource:0}: Error finding container 26ed1d40d032339b79dc1cfac4367334f55e18384d785ebbfafe1b6606345367: Status 404 returned error can't find the container with id 26ed1d40d032339b79dc1cfac4367334f55e18384d785ebbfafe1b6606345367
Jul 27 17:47:38.063273 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:38.063220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc" event={"ID":"20a57360-5dfa-4258-b7aa-5c7dfd339b79","Type":"ContainerStarted","Data":"62ae7325ca5ce787856978c02105f19bcf5ad95a3bdd70fdcec91898169b5048"}
Jul 27 17:47:38.063750 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:38.063292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc" event={"ID":"20a57360-5dfa-4258-b7aa-5c7dfd339b79","Type":"ContainerStarted","Data":"26ed1d40d032339b79dc1cfac4367334f55e18384d785ebbfafe1b6606345367"}
Jul 27 17:47:38.063750 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:38.063327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:47:38.090331 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:38.090284    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc" podStartSLOduration=2.090270194 podStartE2EDuration="2.090270194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:38.087727844 +0000 UTC m=+1353.964929048" watchObservedRunningTime="2026-07-27 17:47:38.090270194 +0000 UTC m=+1353.967471396"
Jul 27 17:47:49.070936 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:47:49.070905    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zjjlc"
Jul 27 17:49:56.308524 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:49:56.308487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:50:31.216177 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:50:31.216098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:50:44.035523 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:50:44.035494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:51:06.853353 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:51:06.853314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:51:08.394372 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:51:08.394333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:09.808778 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:09.808729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:20.929672 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:20.929639    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:31.058535 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:31.058493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:34.010741 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:34.010702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:34.109499 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:34.109465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:34.440391 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:34.440357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:40.143514 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:40.143475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:40.243604 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:40.243571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:40.351977 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:40.351945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:40.662974 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:40.662932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:40.940883 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:40.940854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:42.893876 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:42.893831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:42.972046 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:42.972014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:43.134684 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:43.134653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:43.555305 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:43.555271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:43.664842 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:54:43.664810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:08.449391 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.449358    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"]
Jul 27 17:55:08.452719 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.452703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:08.455634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.455611    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 17:55:08.455634 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.455632    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:55:08.460221 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.460194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"]
Jul 27 17:55:08.502912 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.502881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7\" (UID: \"7d311759-a2a0-4d45-a711-99d21fc1def0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:08.604317 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.604284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7\" (UID: \"7d311759-a2a0-4d45-a711-99d21fc1def0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:08.604903 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.604885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7\" (UID: \"7d311759-a2a0-4d45-a711-99d21fc1def0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:08.764347 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.764272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:08.897122 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.897088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"]
Jul 27 17:55:08.897886 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:55:08.897859    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d311759_a2a0_4d45_a711_99d21fc1def0.slice/crio-f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1 WatchSource:0}: Error finding container f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1: Status 404 returned error can't find the container with id f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1
Jul 27 17:55:08.899745 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:08.899728    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:55:09.435508 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:09.435471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7" event={"ID":"7d311759-a2a0-4d45-a711-99d21fc1def0","Type":"ContainerStarted","Data":"f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1"}
Jul 27 17:55:12.454678 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:12.454648    2564 generic.go:356] "Generic (PLEG): container finished" podID="7d311759-a2a0-4d45-a711-99d21fc1def0" containerID="82d5938d5fd30584d6d0d4299aa2ec6ef2e358cd645044a6e355f4c3e93945e9" exitCode=0
Jul 27 17:55:12.455068 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:12.454733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7" event={"ID":"7d311759-a2a0-4d45-a711-99d21fc1def0","Type":"ContainerDied","Data":"82d5938d5fd30584d6d0d4299aa2ec6ef2e358cd645044a6e355f4c3e93945e9"}
Jul 27 17:55:13.602192 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:13.602147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:13.749880 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:13.749799    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca\") pod \"7d311759-a2a0-4d45-a711-99d21fc1def0\" (UID: \"7d311759-a2a0-4d45-a711-99d21fc1def0\") "
Jul 27 17:55:13.750132 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:13.750110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d311759-a2a0-4d45-a711-99d21fc1def0" (UID: "7d311759-a2a0-4d45-a711-99d21fc1def0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:13.850871 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:13.850840    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d311759-a2a0-4d45-a711-99d21fc1def0-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:55:14.466835 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:14.466805    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"
Jul 27 17:55:14.467008 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:14.466802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7" event={"ID":"7d311759-a2a0-4d45-a711-99d21fc1def0","Type":"ContainerDied","Data":"f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1"}
Jul 27 17:55:14.467008 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:14.466937    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f94b628aca28aba0baaad7bf9813e20462a244955cc7eb1191a23bb2bc5705d1"
Jul 27 17:55:18.819164 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:18.819114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:18.898017 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:18.897980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:18.958911 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:18.958883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:23.513500 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:23.513470    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"]
Jul 27 17:55:23.515232 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:23.515206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:23.516004 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:23.515981    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0bc6c8fc-2mhz7"]
Jul 27 17:55:23.660257 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:23.660223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:23.905447 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:23.905362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:24.147080 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.147043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:24.248645 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.248612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:24.355886 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.355852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:24.668240 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.668126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:24.669105 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.669077    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d311759-a2a0-4d45-a711-99d21fc1def0" path="/var/lib/kubelet/pods/7d311759-a2a0-4d45-a711-99d21fc1def0/volumes"
Jul 27 17:55:24.823408 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:24.823378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:27.261407 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:27.261363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:27.534289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:27.534204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:27.945073 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:27.945042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:28.095665 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:28.095616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:28.193232 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:28.193196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:52.237340 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.237301    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"]
Jul 27 17:55:52.237852 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.237832    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d311759-a2a0-4d45-a711-99d21fc1def0" containerName="revoke-keys"
Jul 27 17:55:52.237956 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.237855    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d311759-a2a0-4d45-a711-99d21fc1def0" containerName="revoke-keys"
Jul 27 17:55:52.238014 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.237994    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d311759-a2a0-4d45-a711-99d21fc1def0" containerName="revoke-keys"
Jul 27 17:55:52.245849 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.245819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:52.246872 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.246845    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"]
Jul 27 17:55:52.248940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.248818    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:55:52.248940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.248852    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 17:55:52.278958 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.278931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-83680a8c-9h758\" (UID: \"491adcc6-6cba-437a-b011-c3a4cc4759d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:52.380389 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.380359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-83680a8c-9h758\" (UID: \"491adcc6-6cba-437a-b011-c3a4cc4759d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:52.380937 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.380919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-83680a8c-9h758\" (UID: \"491adcc6-6cba-437a-b011-c3a4cc4759d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:52.559289 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.559227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:52.686664 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:52.686638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"]
Jul 27 17:55:52.687837 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:55:52.687812    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491adcc6_6cba_437a_b011_c3a4cc4759d6.slice/crio-3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e WatchSource:0}: Error finding container 3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e: Status 404 returned error can't find the container with id 3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e
Jul 27 17:55:53.688664 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:53.688637    2564 generic.go:356] "Generic (PLEG): container finished" podID="491adcc6-6cba-437a-b011-c3a4cc4759d6" containerID="cb008156b676874a4ccee6294ecc05c6a0b47e3dadbf29462813e8bb77e23e68" exitCode=0
Jul 27 17:55:53.689019 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:53.688722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758" event={"ID":"491adcc6-6cba-437a-b011-c3a4cc4759d6","Type":"ContainerDied","Data":"cb008156b676874a4ccee6294ecc05c6a0b47e3dadbf29462813e8bb77e23e68"}
Jul 27 17:55:53.689019 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:53.688771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758" event={"ID":"491adcc6-6cba-437a-b011-c3a4cc4759d6","Type":"ContainerStarted","Data":"3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e"}
Jul 27 17:55:54.825233 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:54.825208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:55:54.903098 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:54.903070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca\") pod \"491adcc6-6cba-437a-b011-c3a4cc4759d6\" (UID: \"491adcc6-6cba-437a-b011-c3a4cc4759d6\") "
Jul 27 17:55:54.903466 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:54.903444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "491adcc6-6cba-437a-b011-c3a4cc4759d6" (UID: "491adcc6-6cba-437a-b011-c3a4cc4759d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:55.003934 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:55.003859    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/491adcc6-6cba-437a-b011-c3a4cc4759d6-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:55:55.699877 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:55.699842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758" event={"ID":"491adcc6-6cba-437a-b011-c3a4cc4759d6","Type":"ContainerDied","Data":"3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e"}
Jul 27 17:55:55.700049 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:55.699890    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ba736fdd684e5d70a72912cd209024be8cfaa16a5964967b7ede6e9cd049f0e"
Jul 27 17:55:55.700049 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:55:55.699851    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"
Jul 27 17:56:02.783715 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:02.783678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:02.892772 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:02.892732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:02.957519 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:02.957486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:07.316700 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.316661    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"]
Jul 27 17:56:07.319226 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.319202    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-83680a8c-9h758"]
Jul 27 17:56:07.326580 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.326557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:07.457782 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.457747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:07.685133 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.685049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:07.910162 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:07.910132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:08.229297 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:08.229259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:08.440329 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:08.440293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:08.670218 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:08.670131    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491adcc6-6cba-437a-b011-c3a4cc4759d6" path="/var/lib/kubelet/pods/491adcc6-6cba-437a-b011-c3a4cc4759d6/volumes"
Jul 27 17:56:10.417165 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:10.417125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:10.619507 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:10.619472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:10.721793 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:10.721747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:10.974339 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:10.974257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:11.069088 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:11.069046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:36.180831 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.180788    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"]
Jul 27 17:56:36.181337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.181152    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491adcc6-6cba-437a-b011-c3a4cc4759d6" containerName="revoke-keys"
Jul 27 17:56:36.181337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.181164    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="491adcc6-6cba-437a-b011-c3a4cc4759d6" containerName="revoke-keys"
Jul 27 17:56:36.181337 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.181252    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="491adcc6-6cba-437a-b011-c3a4cc4759d6" containerName="revoke-keys"
Jul 27 17:56:36.184419 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.184404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:36.187156 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.187131    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:56:36.187429 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.187165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 17:56:36.191237 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.191164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"]
Jul 27 17:56:36.265615 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.265585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv\" (UID: \"0e42f507-cc70-40c7-ab63-37cc24835e17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:36.366340 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.366309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv\" (UID: \"0e42f507-cc70-40c7-ab63-37cc24835e17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:36.366897 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.366878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv\" (UID: \"0e42f507-cc70-40c7-ab63-37cc24835e17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:36.496664 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.496638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:36.625927 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.625886    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"]
Jul 27 17:56:36.626757 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:56:36.626731    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e42f507_cc70_40c7_ab63_37cc24835e17.slice/crio-1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9 WatchSource:0}: Error finding container 1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9: Status 404 returned error can't find the container with id 1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9
Jul 27 17:56:36.924434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:36.924401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv" event={"ID":"0e42f507-cc70-40c7-ab63-37cc24835e17","Type":"ContainerStarted","Data":"1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9"}
Jul 27 17:56:37.933699 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:37.933664    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e42f507-cc70-40c7-ab63-37cc24835e17" containerID="a552d2abd383687f5e9461cab9f63a34d6d997062fb5b5f0915a7c161261efd9" exitCode=0
Jul 27 17:56:37.934096 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:37.933744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv" event={"ID":"0e42f507-cc70-40c7-ab63-37cc24835e17","Type":"ContainerDied","Data":"a552d2abd383687f5e9461cab9f63a34d6d997062fb5b5f0915a7c161261efd9"}
Jul 27 17:56:39.089083 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.089058    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:39.190131 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.190102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca\") pod \"0e42f507-cc70-40c7-ab63-37cc24835e17\" (UID: \"0e42f507-cc70-40c7-ab63-37cc24835e17\") "
Jul 27 17:56:39.190472 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.190426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e42f507-cc70-40c7-ab63-37cc24835e17" (UID: "0e42f507-cc70-40c7-ab63-37cc24835e17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:39.291449 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.291421    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e42f507-cc70-40c7-ab63-37cc24835e17-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:56:39.946085 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.946054    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"
Jul 27 17:56:39.946273 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.946083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv" event={"ID":"0e42f507-cc70-40c7-ab63-37cc24835e17","Type":"ContainerDied","Data":"1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9"}
Jul 27 17:56:39.946273 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:39.946134    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac620ba91c761329390820a23d5b78f8e313332d0f23e2f3c4e4f87a06ea7c9"
Jul 27 17:56:46.547810 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:46.547780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:46.623783 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:46.623745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:47.020143 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:47.020098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:51.248385 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:51.248350    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"]
Jul 27 17:56:51.250586 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:51.250552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:51.250723 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:51.250678    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83640ff2-h7dxv"]
Jul 27 17:56:52.432528 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:52.432483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:52.651023 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:52.650988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:52.668718 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:52.668682    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e42f507-cc70-40c7-ab63-37cc24835e17" path="/var/lib/kubelet/pods/0e42f507-cc70-40c7-ab63-37cc24835e17/volumes"
Jul 27 17:56:52.875243 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:52.875166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:53.169511 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:53.169424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:53.266124 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:53.266085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:55.686484 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:55.686428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:55.884428 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:55.884397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:55.988488 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:55.988455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:56.086746 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:56.086714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:56.462214 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:56.462161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:56.564956 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:56:56.564880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:11.133377 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:11.133335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:11.233090 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:11.233057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:20.525441 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.525409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"]
Jul 27 17:57:20.525821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.525771    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e42f507-cc70-40c7-ab63-37cc24835e17" containerName="revoke-keys"
Jul 27 17:57:20.525821 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.525782    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e42f507-cc70-40c7-ab63-37cc24835e17" containerName="revoke-keys"
Jul 27 17:57:20.525904 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.525841    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e42f507-cc70-40c7-ab63-37cc24835e17" containerName="revoke-keys"
Jul 27 17:57:20.528943 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.528927    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:20.532048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.531876    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:57:20.532048 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.531938    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 17:57:20.536326 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.536301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"]
Jul 27 17:57:20.563284 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.563255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-79618e13-2qhf8\" (UID: \"af0599f0-a189-4cd5-b555-ed3c421a6247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:20.664109 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.664072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-79618e13-2qhf8\" (UID: \"af0599f0-a189-4cd5-b555-ed3c421a6247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:20.664717 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.664693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-79618e13-2qhf8\" (UID: \"af0599f0-a189-4cd5-b555-ed3c421a6247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:20.840911 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.840836    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:20.976082 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:20.976052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"]
Jul 27 17:57:20.977627 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:57:20.977597    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0599f0_a189_4cd5_b555_ed3c421a6247.slice/crio-1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715 WatchSource:0}: Error finding container 1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715: Status 404 returned error can't find the container with id 1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715
Jul 27 17:57:21.170434 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:21.170365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8" event={"ID":"af0599f0-a189-4cd5-b555-ed3c421a6247","Type":"ContainerStarted","Data":"1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715"}
Jul 27 17:57:22.176800 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:22.176771    2564 generic.go:356] "Generic (PLEG): container finished" podID="af0599f0-a189-4cd5-b555-ed3c421a6247" containerID="ae812231c1fd04dccfd37fb0d50cf8878997a53b3bea56170c995bb5624d4adf" exitCode=0
Jul 27 17:57:22.177167 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:22.176832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8" event={"ID":"af0599f0-a189-4cd5-b555-ed3c421a6247","Type":"ContainerDied","Data":"ae812231c1fd04dccfd37fb0d50cf8878997a53b3bea56170c995bb5624d4adf"}
Jul 27 17:57:23.310286 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:23.310257    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:23.385923 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:23.385895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca\") pod \"af0599f0-a189-4cd5-b555-ed3c421a6247\" (UID: \"af0599f0-a189-4cd5-b555-ed3c421a6247\") "
Jul 27 17:57:23.386263 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:23.386236    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af0599f0-a189-4cd5-b555-ed3c421a6247" (UID: "af0599f0-a189-4cd5-b555-ed3c421a6247"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:57:23.487498 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:23.487470    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0599f0-a189-4cd5-b555-ed3c421a6247-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:57:24.189119 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:24.189088    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"
Jul 27 17:57:24.189299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:24.189113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8" event={"ID":"af0599f0-a189-4cd5-b555-ed3c421a6247","Type":"ContainerDied","Data":"1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715"}
Jul 27 17:57:24.189299 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:24.189167    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1295489835ef9ec05d1e936924fd9b02b5d53a8027f00a0fa8beef901637f715"
Jul 27 17:57:30.872231 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:30.872168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:30.936546 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:30.936509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:31.001383 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:31.001353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:35.598878 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:35.598839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:35.606137 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:35.606105    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"]
Jul 27 17:57:35.608214 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:35.608194    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-79618e13-2qhf8"]
Jul 27 17:57:35.762793 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:35.762754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:36.022154 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:36.022121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:36.494851 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:36.494816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:36.594079 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:36.594051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:36.668530 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:36.668493    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0599f0-a189-4cd5-b555-ed3c421a6247" path="/var/lib/kubelet/pods/af0599f0-a189-4cd5-b555-ed3c421a6247/volumes"
Jul 27 17:57:36.691906 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:36.691882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:38.127248 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:38.127210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:43.759093 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:43.759006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:43.861577 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:43.861533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:43.960212 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:43.960160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:44.018692 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:44.018601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:44.463117 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:57:44.463083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:10.442195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:10.442096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:16.842492 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:16.842458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:16.947818 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:16.947788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:17.043927 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:17.043870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:32.922802 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:32.922770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:38.706382 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:38.706337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:38.810469 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:38.810425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:38.905349 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:38.905311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:49.433871 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:49.433831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:50.227227 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:50.227173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:56.667879 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:56.667842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:56.770487 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:56.770450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:56.868417 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:56.868378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:56.979918 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:56.979879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:57.786132 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:57.786077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:57.956580 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:57.956543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:58:59.527485 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:58:59.527447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:06.556402 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:06.556359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:06.656041 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:06.656003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:07.171540 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:07.171505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:12.910782 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:12.910748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:15.528741 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:15.528704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:16.316716 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:16.316661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:16.423933 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:16.423892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:16.502916 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:16.502883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:16.915282 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:16.915239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:17.006366 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:17.006330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:17.110219 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:17.110169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:17.993216 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:17.993162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:20.892195 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:20.892153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:21.623837 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:21.623792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:21.728953 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:21.728919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:22.148402 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:22.148368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:27.851413 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:27.851335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:27.914246 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:27.914204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:28.214724 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.214690    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"]
Jul 27 17:59:28.215155 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.215136    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0599f0-a189-4cd5-b555-ed3c421a6247" containerName="revoke-keys"
Jul 27 17:59:28.215276 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.215158    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0599f0-a189-4cd5-b555-ed3c421a6247" containerName="revoke-keys"
Jul 27 17:59:28.215276 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.215272    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0599f0-a189-4cd5-b555-ed3c421a6247" containerName="revoke-keys"
Jul 27 17:59:28.218416 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.218395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:28.221276 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.221228    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:59:28.221740 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.221716    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 17:59:28.227136 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.226618    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"]
Jul 27 17:59:28.386422 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.386385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65\" (UID: \"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:28.486993 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.486907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65\" (UID: \"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:28.487626 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.487603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65\" (UID: \"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:28.530927 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.530895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:28.663152 ip-10-0-143-96 kubenswrapper[2564]: W0727 17:59:28.663119    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce821fa_5d6c_45c6_a3e0_cf2781a367f1.slice/crio-5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b WatchSource:0}: Error finding container 5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b: Status 404 returned error can't find the container with id 5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b
Jul 27 17:59:28.669193 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.669157    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"]
Jul 27 17:59:28.856312 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:28.856238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65" event={"ID":"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1","Type":"ContainerStarted","Data":"5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b"}
Jul 27 17:59:29.863882 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:29.863788    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" containerID="0962b8645a0e0caf7cca16fa374327d89b140a65ba360118ffe1977a100d7271" exitCode=0
Jul 27 17:59:29.863882 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:29.863839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65" event={"ID":"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1","Type":"ContainerDied","Data":"0962b8645a0e0caf7cca16fa374327d89b140a65ba360118ffe1977a100d7271"}
Jul 27 17:59:30.999940 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:30.999911    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:31.109643 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.109613    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca\") pod \"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1\" (UID: \"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1\") "
Jul 27 17:59:31.110022 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.109997    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" (UID: "6ce821fa-5d6c-45c6-a3e0-cf2781a367f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:59:31.210736 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.210702    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 17:59:31.878393 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.878357    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"
Jul 27 17:59:31.878557 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.878393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65" event={"ID":"6ce821fa-5d6c-45c6-a3e0-cf2781a367f1","Type":"ContainerDied","Data":"5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b"}
Jul 27 17:59:31.878557 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:31.878439    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dc359443d180b883e06e6c27f5dd87b0e92e3ef0fb8d4b701fd3ae68a5b520b"
Jul 27 17:59:38.559657 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:38.559603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:38.659952 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:38.659920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:38.711768 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:38.711735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:43.279597 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:43.279564    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"]
Jul 27 17:59:43.281596 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:43.281573    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ea7cbb1a-hrj65"]
Jul 27 17:59:43.283054 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:43.283023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:43.719084 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:43.719052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:44.482164 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:44.482124    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" podUID="7f14f156ce10e05bbdf20bfb209f82c0" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 27 17:59:44.668791 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:44.668749    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" path="/var/lib/kubelet/pods/6ce821fa-5d6c-45c6-a3e0-cf2781a367f1/volumes"
Jul 27 17:59:44.948379 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:44.948352    2564 generic.go:356] "Generic (PLEG): container finished" podID="794f6572-3a54-4d49-b7c6-c4195ae8e242" containerID="bddc5895f6837723d995dab16fa06a83adbb99bcc78f6fb5fda48a2eb0db70d4" exitCode=1
Jul 27 17:59:44.948544 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:44.948415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv" event={"ID":"794f6572-3a54-4d49-b7c6-c4195ae8e242","Type":"ContainerDied","Data":"bddc5895f6837723d995dab16fa06a83adbb99bcc78f6fb5fda48a2eb0db70d4"}
Jul 27 17:59:44.948734 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:44.948722    2564 scope.go:117] "RemoveContainer" containerID="bddc5895f6837723d995dab16fa06a83adbb99bcc78f6fb5fda48a2eb0db70d4"
Jul 27 17:59:45.955386 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:45.955350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv" event={"ID":"794f6572-3a54-4d49-b7c6-c4195ae8e242","Type":"ContainerStarted","Data":"5745f6fe188a4120c724cdc83d8f01968f256774e2076977c73b04a80a2b89f6"}
Jul 27 17:59:45.955804 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:45.955563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 17:59:49.470544 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:49.470506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:49.570998 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:49.570961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:49.751422 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:49.751330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:49.984698 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:49.984660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:50.116572 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:50.116490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:50.210128 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:50.210090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:50.421856 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:50.421780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:56.355731 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:56.355666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:56.469607 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:56.469566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:56.563959 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:56.563928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:56.717647 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:56.717612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 17:59:56.963414 ip-10-0-143-96 kubenswrapper[2564]: I0727 17:59:56.963384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-ckvkv"
Jul 27 18:00:01.678647 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:01.678608    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:02.708987 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:02.708953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:02.809211 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:02.809168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:09.357645 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:09.357605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:20.129897 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:20.129847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:20.411789 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:20.411680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:23.356840 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:23.356722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:23.452554 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:23.452525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:23.550934 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:23.550897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:24.014490 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:24.014456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:24.124586 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:24.124545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:24.222194 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:24.222156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:27.872888 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:27.872851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:33.853335 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:33.853292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:43.135382 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:00:43.135345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:01:14.251916 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:01:14.251835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:02:04.773506 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:02:04.773471    2564 scope.go:117] "RemoveContainer" containerID="cb008156b676874a4ccee6294ecc05c6a0b47e3dadbf29462813e8bb77e23e68"
Jul 27 18:02:04.782153 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:02:04.782135    2564 scope.go:117] "RemoveContainer" containerID="82d5938d5fd30584d6d0d4299aa2ec6ef2e358cd645044a6e355f4c3e93945e9"
Jul 27 18:02:55.399454 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:02:55.399368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:01.347321 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:03:01.347282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:04.804399 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:03:04.804368    2564 scope.go:117] "RemoveContainer" containerID="a552d2abd383687f5e9461cab9f63a34d6d997062fb5b5f0915a7c161261efd9"
Jul 27 18:03:32.916805 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:03:32.916765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:04.824448 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.824370    2564 scope.go:117] "RemoveContainer" containerID="ae812231c1fd04dccfd37fb0d50cf8878997a53b3bea56170c995bb5624d4adf"
Jul 27 18:04:04.847132 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.847107    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"]
Jul 27 18:04:04.847471 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.847458    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" containerName="revoke-keys"
Jul 27 18:04:04.847524 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.847473    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" containerName="revoke-keys"
Jul 27 18:04:04.847561 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.847550    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce821fa-5d6c-45c6-a3e0-cf2781a367f1" containerName="revoke-keys"
Jul 27 18:04:04.851808 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.851791    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:04.854925 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.854906    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:04:04.855026 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.855010    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:04:04.865663 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.865640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"]
Jul 27 18:04:04.976522 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:04.976495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t\" (UID: \"4764bc2a-5999-4b6e-b57e-f94d1c478899\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:05.077865 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:05.077786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t\" (UID: \"4764bc2a-5999-4b6e-b57e-f94d1c478899\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:05.078427 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:05.078409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t\" (UID: \"4764bc2a-5999-4b6e-b57e-f94d1c478899\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:05.160965 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:05.160935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:05.307095 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:05.307064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"]
Jul 27 18:04:05.308071 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:04:05.308039    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4764bc2a_5999_4b6e_b57e_f94d1c478899.slice/crio-084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979 WatchSource:0}: Error finding container 084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979: Status 404 returned error can't find the container with id 084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979
Jul 27 18:04:05.355063 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:05.355036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t" event={"ID":"4764bc2a-5999-4b6e-b57e-f94d1c478899","Type":"ContainerStarted","Data":"084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979"}
Jul 27 18:04:06.361379 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:06.361297    2564 generic.go:356] "Generic (PLEG): container finished" podID="4764bc2a-5999-4b6e-b57e-f94d1c478899" containerID="894f1e8e5d4325690f5a81470b6221feb5d2340d30ae0942d475de400ad5bf8f" exitCode=0
Jul 27 18:04:06.361379 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:06.361339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t" event={"ID":"4764bc2a-5999-4b6e-b57e-f94d1c478899","Type":"ContainerDied","Data":"894f1e8e5d4325690f5a81470b6221feb5d2340d30ae0942d475de400ad5bf8f"}
Jul 27 18:04:07.502790 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:07.502765    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:07.598462 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:07.598424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca\") pod \"4764bc2a-5999-4b6e-b57e-f94d1c478899\" (UID: \"4764bc2a-5999-4b6e-b57e-f94d1c478899\") "
Jul 27 18:04:07.598774 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:07.598752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4764bc2a-5999-4b6e-b57e-f94d1c478899" (UID: "4764bc2a-5999-4b6e-b57e-f94d1c478899"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:04:07.699549 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:07.699521    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4764bc2a-5999-4b6e-b57e-f94d1c478899-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:04:08.372813 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:08.372785    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"
Jul 27 18:04:08.373008 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:08.372827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t" event={"ID":"4764bc2a-5999-4b6e-b57e-f94d1c478899","Type":"ContainerDied","Data":"084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979"}
Jul 27 18:04:08.373008 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:08.372874    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084026b7cf72ec53d184200e9eb84e1fe16e1a9938b36981c4a3d3e694964979"
Jul 27 18:04:20.468174 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:20.468134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:24.777570 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:24.777537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:24.952392 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:24.952360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:24.968340 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:24.968314    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"]
Jul 27 18:04:24.971899 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:24.971873    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a616d7-rmk7t"]
Jul 27 18:04:25.361042 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:25.361010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:26.670170 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:26.670134    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4764bc2a-5999-4b6e-b57e-f94d1c478899" path="/var/lib/kubelet/pods/4764bc2a-5999-4b6e-b57e-f94d1c478899/volumes"
Jul 27 18:04:30.418959 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:30.418925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:38.899133 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:38.899094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:38.960107 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:04:38.960071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:06.599952 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:06.599904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:07.381297 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:07.381260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:13.081527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:13.081488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:27.290933 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:27.290840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:27.390436 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:27.390401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:27.633977 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:27.633880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:27.780283 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:27.780249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:28.943114 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:28.943075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:29.042099 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:29.042071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:29.213873 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:29.213799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:29.852839 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:29.852801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:29.948750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:29.948717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:30.048826 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:30.048793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:31.428078 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:31.428038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:37.434129 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:37.434090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:37.542047 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:37.542010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:38.138236 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:38.138201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:44.832624 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:44.832591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:44.946957 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:44.946923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:45.037291 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:45.037257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:48.305411 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:48.305372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:48.409990 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:48.409953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:55.573355 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:55.573317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:55.966949 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:05:55.966913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:04.852866 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:04.852834    2564 scope.go:117] "RemoveContainer" containerID="0962b8645a0e0caf7cca16fa374327d89b140a65ba360118ffe1977a100d7271"
Jul 27 18:06:26.913595 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:26.913558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:33.048875 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:33.048832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:33.148986 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:33.148954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:33.248141 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:33.248103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:33.419032 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:33.418945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:33.742413 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:33.742378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:34.415523 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:34.415493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:36.313129 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:36.313086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:36.411990 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:36.411959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:36.532621 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:36.532587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:36.967895 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:36.967855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:37.077286 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:37.077232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:37.146609 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:37.146578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:38.221549 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:38.221515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:40.806195 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:40.806153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:41.157298 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:41.157212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:41.479076 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:41.479036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:41.562730 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:41.562698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.230730 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.230692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.334278 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.334245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.420365 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.420323    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:06:44.420744 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.420717    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4764bc2a-5999-4b6e-b57e-f94d1c478899" containerName="revoke-keys"
Jul 27 18:06:44.420744 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.420738    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4764bc2a-5999-4b6e-b57e-f94d1c478899" containerName="revoke-keys"
Jul 27 18:06:44.420910 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.420825    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4764bc2a-5999-4b6e-b57e-f94d1c478899" containerName="revoke-keys"
Jul 27 18:06:44.423898 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.423876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.426612 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.426595    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:06:44.426714 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.426679    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\""
Jul 27 18:06:44.428050 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.428029    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-36c68f-serving-cert\""
Jul 27 18:06:44.428155 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.428034    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 18:06:44.435231 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.435209    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:06:44.457628 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.457605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.478737 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.478708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clnqz\" (UniqueName: \"kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.478839 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.478741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.478839 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.478782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.579603 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.579532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.579769 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.579660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clnqz\" (UniqueName: \"kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.579769 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.579690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.580466 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.580441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.582048 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.582023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.589097 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.589071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clnqz\" (UniqueName: \"kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz\") pod \"maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.626704 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.626672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.735326 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.735304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:44.870746 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.870716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:06:44.871485 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:06:44.871451    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e18a8fb_74ce_4970_b4c8_375335355e1a.slice/crio-07367e9763a3c88a42577c815005f56a997b6e1bde1b2f8bcce594bccaaede50 WatchSource:0}: Error finding container 07367e9763a3c88a42577c815005f56a997b6e1bde1b2f8bcce594bccaaede50: Status 404 returned error can't find the container with id 07367e9763a3c88a42577c815005f56a997b6e1bde1b2f8bcce594bccaaede50
Jul 27 18:06:44.878966 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.878931    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:06:44.927114 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:44.927089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:45.023805 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.023776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:45.101939 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.101907    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:06:45.106458 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.106440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.109613 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.109589    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-36c68f\""
Jul 27 18:06:45.109726 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.109592    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-36c68f-dockercfg-lnttk\""
Jul 27 18:06:45.116119 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.116096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:06:45.186007 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.185928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkrf\" (UniqueName: \"kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.186007 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.185969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.212011 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.211970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" event={"ID":"9e18a8fb-74ce-4970-b4c8-375335355e1a","Type":"ContainerStarted","Data":"07367e9763a3c88a42577c815005f56a997b6e1bde1b2f8bcce594bccaaede50"}
Jul 27 18:06:45.287372 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.287337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkrf\" (UniqueName: \"kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.287755 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.287388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.288138 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.288117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.297398 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.297376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkrf\" (UniqueName: \"kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf\") pod \"payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.419244 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.419209    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:45.595106 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:45.595056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:06:45.596652 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:06:45.596619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6789af7_1daf_449e_b298_6408af2d338b.slice/crio-88d85d46a930bcc9656217470bfd2f74d453022b3668cd4ec35e0878e99f436c WatchSource:0}: Error finding container 88d85d46a930bcc9656217470bfd2f74d453022b3668cd4ec35e0878e99f436c: Status 404 returned error can't find the container with id 88d85d46a930bcc9656217470bfd2f74d453022b3668cd4ec35e0878e99f436c
Jul 27 18:06:46.220444 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:46.220407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" event={"ID":"b6789af7-1daf-449e-b298-6408af2d338b","Type":"ContainerStarted","Data":"88d85d46a930bcc9656217470bfd2f74d453022b3668cd4ec35e0878e99f436c"}
Jul 27 18:06:48.234165 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:48.234133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" event={"ID":"9e18a8fb-74ce-4970-b4c8-375335355e1a","Type":"ContainerStarted","Data":"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"}
Jul 27 18:06:48.234611 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:48.234284    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:06:48.252230 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:48.252157    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" podStartSLOduration=1.952851173 podStartE2EDuration="4.25214427s" totalImagesPullingTime="2.299293097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:48.25148663 +0000 UTC m=+2504.128687835" watchObservedRunningTime="2026-07-27 18:06:48.25214427 +0000 UTC m=+2504.129345472"
Jul 27 18:06:48.725359 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:48.725321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:49.240559 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:49.240520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" event={"ID":"b6789af7-1daf-449e-b298-6408af2d338b","Type":"ContainerStarted","Data":"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"}
Jul 27 18:06:49.240954 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:49.240684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:06:49.260555 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:49.260508    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" podStartSLOduration=1.5827052190000002 podStartE2EDuration="4.260493129s" totalImagesPullingTime="2.67778791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:49.25903657 +0000 UTC m=+2505.136237776" watchObservedRunningTime="2026-07-27 18:06:49.260493129 +0000 UTC m=+2505.137694331"
Jul 27 18:06:54.246773 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:06:54.246745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:07:00.248269 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:07:00.248173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:07:03.241117 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:07:03.241084    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:34.866149 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:07:34.866101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:23.593625 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:23.593582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:24.448288 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.448243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:24.585664 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.585631    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"]
Jul 27 18:08:24.588867 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.588849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:24.591698 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.591670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:08:24.595672 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.595605    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"]
Jul 27 18:08:24.663437 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.663378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l\" (UID: \"ee44862c-176e-4c6a-be5d-46e7c8d264d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:24.764550 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.764467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l\" (UID: \"ee44862c-176e-4c6a-be5d-46e7c8d264d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:24.765103 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.765080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l\" (UID: \"ee44862c-176e-4c6a-be5d-46e7c8d264d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:24.900786 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:24.900761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:25.031825 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:25.031795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"]
Jul 27 18:08:25.033769 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:08:25.033742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee44862c_176e_4c6a_be5d_46e7c8d264d9.slice/crio-0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32 WatchSource:0}: Error finding container 0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32: Status 404 returned error can't find the container with id 0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32
Jul 27 18:08:25.760749 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:25.760708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l" event={"ID":"ee44862c-176e-4c6a-be5d-46e7c8d264d9","Type":"ContainerStarted","Data":"cbb77c5adc7d3aafa1d13c9878accaacc4f792576b74e790c9cfc0ca41499154"}
Jul 27 18:08:25.761213 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:25.760780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l" event={"ID":"ee44862c-176e-4c6a-be5d-46e7c8d264d9","Type":"ContainerStarted","Data":"0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32"}
Jul 27 18:08:25.777008 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:25.776954    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l" podStartSLOduration=1.776935225 podStartE2EDuration="1.776935225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:08:25.776621578 +0000 UTC m=+2601.653822783" watchObservedRunningTime="2026-07-27 18:08:25.776935225 +0000 UTC m=+2601.654136429"
Jul 27 18:08:26.768281 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:26.768200    2564 generic.go:356] "Generic (PLEG): container finished" podID="ee44862c-176e-4c6a-be5d-46e7c8d264d9" containerID="cbb77c5adc7d3aafa1d13c9878accaacc4f792576b74e790c9cfc0ca41499154" exitCode=0
Jul 27 18:08:26.768705 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:26.768277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l" event={"ID":"ee44862c-176e-4c6a-be5d-46e7c8d264d9","Type":"ContainerDied","Data":"cbb77c5adc7d3aafa1d13c9878accaacc4f792576b74e790c9cfc0ca41499154"}
Jul 27 18:08:27.915143 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:27.915118    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:27.992514 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:27.992479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca\") pod \"ee44862c-176e-4c6a-be5d-46e7c8d264d9\" (UID: \"ee44862c-176e-4c6a-be5d-46e7c8d264d9\") "
Jul 27 18:08:27.992787 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:27.992764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee44862c-176e-4c6a-be5d-46e7c8d264d9" (UID: "ee44862c-176e-4c6a-be5d-46e7c8d264d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:27.992878 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:27.992836    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44862c-176e-4c6a-be5d-46e7c8d264d9-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:28.782064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:28.782029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l" event={"ID":"ee44862c-176e-4c6a-be5d-46e7c8d264d9","Type":"ContainerDied","Data":"0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32"}
Jul 27 18:08:28.782064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:28.782065    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"
Jul 27 18:08:28.782324 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:28.782077    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aba6b50d4d9bdddc92e9b97e9b0d6913c2318af21e17446a3f5055d91bf7e32"
Jul 27 18:08:35.083768 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:35.083731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:35.542032 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:35.542001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:35.963810 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:35.963777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:39.653687 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:39.653653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:39.667702 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:39.667663    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"]
Jul 27 18:08:39.670431 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:39.670410    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3a1577-vrl9l"]
Jul 27 18:08:40.045118 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:40.045081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:40.668797 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:40.668767    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee44862c-176e-4c6a-be5d-46e7c8d264d9" path="/var/lib/kubelet/pods/ee44862c-176e-4c6a-be5d-46e7c8d264d9/volumes"
Jul 27 18:08:45.894124 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:45.894090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:45.967657 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:45.967622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:46.160307 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.160216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:46.376099 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.376063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:46.498483 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.498444    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"]
Jul 27 18:08:46.498864 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.498850    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee44862c-176e-4c6a-be5d-46e7c8d264d9" containerName="revoke-keys"
Jul 27 18:08:46.498913 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.498866    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee44862c-176e-4c6a-be5d-46e7c8d264d9" containerName="revoke-keys"
Jul 27 18:08:46.498955 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.498945    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee44862c-176e-4c6a-be5d-46e7c8d264d9" containerName="revoke-keys"
Jul 27 18:08:46.502191 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.502161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:46.505102 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.505075    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:08:46.509037 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.509013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"]
Jul 27 18:08:46.657538 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.657508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs\" (UID: \"7720ed9a-0c17-408e-bd88-b486b76c0595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:46.758278 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.758164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs\" (UID: \"7720ed9a-0c17-408e-bd88-b486b76c0595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:46.758805 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.758778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs\" (UID: \"7720ed9a-0c17-408e-bd88-b486b76c0595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:46.815978 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.815950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:46.950573 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:46.950545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"]
Jul 27 18:08:46.951907 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:08:46.951870    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7720ed9a_0c17_408e_bd88_b486b76c0595.slice/crio-5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7 WatchSource:0}: Error finding container 5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7: Status 404 returned error can't find the container with id 5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7
Jul 27 18:08:47.890705 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:47.890672    2564 generic.go:356] "Generic (PLEG): container finished" podID="7720ed9a-0c17-408e-bd88-b486b76c0595" containerID="8b4657fc0d7800c776faf99bdcb3cebbed915ba2d9dcfd074b29f034706b88d6" exitCode=0
Jul 27 18:08:47.890847 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:47.890718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs" event={"ID":"7720ed9a-0c17-408e-bd88-b486b76c0595","Type":"ContainerDied","Data":"8b4657fc0d7800c776faf99bdcb3cebbed915ba2d9dcfd074b29f034706b88d6"}
Jul 27 18:08:47.890847 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:47.890759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs" event={"ID":"7720ed9a-0c17-408e-bd88-b486b76c0595","Type":"ContainerStarted","Data":"5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7"}
Jul 27 18:08:49.024089 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.024065    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:49.181067 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.180992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca\") pod \"7720ed9a-0c17-408e-bd88-b486b76c0595\" (UID: \"7720ed9a-0c17-408e-bd88-b486b76c0595\") "
Jul 27 18:08:49.181347 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.181327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7720ed9a-0c17-408e-bd88-b486b76c0595" (UID: "7720ed9a-0c17-408e-bd88-b486b76c0595"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:49.281561 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.281534    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7720ed9a-0c17-408e-bd88-b486b76c0595-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:49.905129 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.905091    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"
Jul 27 18:08:49.905334 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.905130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs" event={"ID":"7720ed9a-0c17-408e-bd88-b486b76c0595","Type":"ContainerDied","Data":"5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7"}
Jul 27 18:08:49.905334 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:49.905197    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f41cdb2d0a78d8425c01c437d40e3e50b48d5bff0bf755b77ffb489dbf001b7"
Jul 27 18:08:56.963518 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:56.963485    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:08:56.964006 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:56.963690    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" podUID="9e18a8fb-74ce-4970-b4c8-375335355e1a" containerName="maas-api" containerID="cri-o://046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce" gracePeriod=30
Jul 27 18:08:56.987024 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:56.986995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:57.020241 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.020206    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:08:57.020482 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.020455    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" podUID="b6789af7-1daf-449e-b298-6408af2d338b" containerName="payload-pre-processing" containerID="cri-o://9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8" gracePeriod=30
Jul 27 18:08:57.109010 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.108975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:57.172793 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.172760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:57.267640 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.267614    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:08:57.298851 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.298828    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:08:57.352588 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.352563    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca\") pod \"9e18a8fb-74ce-4970-b4c8-375335355e1a\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") "
Jul 27 18:08:57.352734 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.352607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls\") pod \"9e18a8fb-74ce-4970-b4c8-375335355e1a\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") "
Jul 27 18:08:57.352734 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.352628    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clnqz\" (UniqueName: \"kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz\") pod \"9e18a8fb-74ce-4970-b4c8-375335355e1a\" (UID: \"9e18a8fb-74ce-4970-b4c8-375335355e1a\") "
Jul 27 18:08:57.352932 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.352908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e18a8fb-74ce-4970-b4c8-375335355e1a" (UID: "9e18a8fb-74ce-4970-b4c8-375335355e1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:57.354738 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.354719    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz" (OuterVolumeSpecName: "kube-api-access-clnqz") pod "9e18a8fb-74ce-4970-b4c8-375335355e1a" (UID: "9e18a8fb-74ce-4970-b4c8-375335355e1a"). InnerVolumeSpecName "kube-api-access-clnqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:57.354797 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.354784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e18a8fb-74ce-4970-b4c8-375335355e1a" (UID: "9e18a8fb-74ce-4970-b4c8-375335355e1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:08:57.453654 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.453628    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume\") pod \"b6789af7-1daf-449e-b298-6408af2d338b\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") "
Jul 27 18:08:57.453826 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.453707    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njkrf\" (UniqueName: \"kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf\") pod \"b6789af7-1daf-449e-b298-6408af2d338b\" (UID: \"b6789af7-1daf-449e-b298-6408af2d338b\") "
Jul 27 18:08:57.453997 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.453974    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6789af7-1daf-449e-b298-6408af2d338b" (UID: "b6789af7-1daf-449e-b298-6408af2d338b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:57.454064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.453996    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18a8fb-74ce-4970-b4c8-375335355e1a-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.454064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.454015    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e18a8fb-74ce-4970-b4c8-375335355e1a-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.454064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.454030    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clnqz\" (UniqueName: \"kubernetes.io/projected/9e18a8fb-74ce-4970-b4c8-375335355e1a-kube-api-access-clnqz\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.455722 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.455702    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf" (OuterVolumeSpecName: "kube-api-access-njkrf") pod "b6789af7-1daf-449e-b298-6408af2d338b" (UID: "b6789af7-1daf-449e-b298-6408af2d338b"). InnerVolumeSpecName "kube-api-access-njkrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:57.554924 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.554857    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6789af7-1daf-449e-b298-6408af2d338b-plugins-config-volume\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.554924 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.554882    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njkrf\" (UniqueName: \"kubernetes.io/projected/b6789af7-1daf-449e-b298-6408af2d338b-kube-api-access-njkrf\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.959413 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.959378    2564 generic.go:356] "Generic (PLEG): container finished" podID="9e18a8fb-74ce-4970-b4c8-375335355e1a" containerID="046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce" exitCode=0
Jul 27 18:08:57.959575 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.959428    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"
Jul 27 18:08:57.959575 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.959464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" event={"ID":"9e18a8fb-74ce-4970-b4c8-375335355e1a","Type":"ContainerDied","Data":"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"}
Jul 27 18:08:57.959575 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.959545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h" event={"ID":"9e18a8fb-74ce-4970-b4c8-375335355e1a","Type":"ContainerDied","Data":"07367e9763a3c88a42577c815005f56a997b6e1bde1b2f8bcce594bccaaede50"}
Jul 27 18:08:57.959575 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.959574    2564 scope.go:117] "RemoveContainer" containerID="046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"
Jul 27 18:08:57.960816 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.960797    2564 generic.go:356] "Generic (PLEG): container finished" podID="b6789af7-1daf-449e-b298-6408af2d338b" containerID="9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8" exitCode=0
Jul 27 18:08:57.960886 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.960848    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"
Jul 27 18:08:57.960946 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.960888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" event={"ID":"b6789af7-1daf-449e-b298-6408af2d338b","Type":"ContainerDied","Data":"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"}
Jul 27 18:08:57.960996 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.960943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq" event={"ID":"b6789af7-1daf-449e-b298-6408af2d338b","Type":"ContainerDied","Data":"88d85d46a930bcc9656217470bfd2f74d453022b3668cd4ec35e0878e99f436c"}
Jul 27 18:08:57.969825 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.969642    2564 scope.go:117] "RemoveContainer" containerID="046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"
Jul 27 18:08:57.970089 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:08:57.969913    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce\": container with ID starting with 046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce not found: ID does not exist" containerID="046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"
Jul 27 18:08:57.970089 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.969936    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce"} err="failed to get container status \"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce\": rpc error: code = NotFound desc = could not find container \"046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce\": container with ID starting with 046387994b82af6c44532b6a7fa1bac01ecade5a6897369e46115d1296cf2bce not found: ID does not exist"
Jul 27 18:08:57.970089 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.969953    2564 scope.go:117] "RemoveContainer" containerID="9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"
Jul 27 18:08:57.985828 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.985810    2564 scope.go:117] "RemoveContainer" containerID="9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"
Jul 27 18:08:57.986124 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:08:57.986107    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8\": container with ID starting with 9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8 not found: ID does not exist" containerID="9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"
Jul 27 18:08:57.986172 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.986130    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8"} err="failed to get container status \"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8\": rpc error: code = NotFound desc = could not find container \"9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8\": container with ID starting with 9941b49d4391cd20193a0bf052f729fa8e4b7889eec2ccbc8785730be27eb8f8 not found: ID does not exist"
Jul 27 18:08:57.986235 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.986201    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:08:57.991607 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:57.991587    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c68f-5c8b6db596-2qd9h"]
Jul 27 18:08:58.002520 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:58.002491    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:08:58.009011 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:58.008991    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-36c68f-57c8bf6c68-whktq"]
Jul 27 18:08:58.668700 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:58.668667    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e18a8fb-74ce-4970-b4c8-375335355e1a" path="/var/lib/kubelet/pods/9e18a8fb-74ce-4970-b4c8-375335355e1a/volumes"
Jul 27 18:08:58.669093 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:08:58.669070    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6789af7-1daf-449e-b298-6408af2d338b" path="/var/lib/kubelet/pods/b6789af7-1daf-449e-b298-6408af2d338b/volumes"
Jul 27 18:09:01.562882 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:01.562851    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"]
Jul 27 18:09:01.565701 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:01.565667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:01.566431 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:01.566406    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c68f-g8dqs"]
Jul 27 18:09:01.990638 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:01.990593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:02.668801 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:02.668767    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7720ed9a-0c17-408e-bd88-b486b76c0595" path="/var/lib/kubelet/pods/7720ed9a-0c17-408e-bd88-b486b76c0595/volumes"
Jul 27 18:09:07.691049 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:07.691019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:07.788759 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:07.788724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:07.963103 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:07.963007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:08.233751 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:08.233662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:08.506289 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:08.506204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:08.905439 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:08.905345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:09.122299 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:09.122251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.012756 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.012721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.082914 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.082875    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:12.083243 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083229    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7720ed9a-0c17-408e-bd88-b486b76c0595" containerName="revoke-keys"
Jul 27 18:09:12.083322 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083244    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7720ed9a-0c17-408e-bd88-b486b76c0595" containerName="revoke-keys"
Jul 27 18:09:12.083322 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083257    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6789af7-1daf-449e-b298-6408af2d338b" containerName="payload-pre-processing"
Jul 27 18:09:12.083322 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083262    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6789af7-1daf-449e-b298-6408af2d338b" containerName="payload-pre-processing"
Jul 27 18:09:12.083322 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083276    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e18a8fb-74ce-4970-b4c8-375335355e1a" containerName="maas-api"
Jul 27 18:09:12.083322 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083281    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e18a8fb-74ce-4970-b4c8-375335355e1a" containerName="maas-api"
Jul 27 18:09:12.083593 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083347    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6789af7-1daf-449e-b298-6408af2d338b" containerName="payload-pre-processing"
Jul 27 18:09:12.083593 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083356    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e18a8fb-74ce-4970-b4c8-375335355e1a" containerName="maas-api"
Jul 27 18:09:12.083593 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.083363    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7720ed9a-0c17-408e-bd88-b486b76c0595" containerName="revoke-keys"
Jul 27 18:09:12.086409 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.086387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.089401 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.089377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-0a1799-serving-cert\""
Jul 27 18:09:12.089522 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.089385    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:09:12.089522 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.089473    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 18:09:12.090768 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.090754    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\""
Jul 27 18:09:12.095253 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.095227    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:12.097101 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.097069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.159951 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.159918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.183673 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.183644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.183854 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.183832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq69w\" (UniqueName: \"kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.183919 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.183874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.284610 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.284522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq69w\" (UniqueName: \"kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.284610 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.284558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.284610 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.284576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.284821 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:09:12.284750    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-serving-cert: secret "maas-api-e2e-api-a-0a1799-serving-cert" not found
Jul 27 18:09:12.284821 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:09:12.284811    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls podName:1e000009-4bab-4f9e-8a8c-43edc9d9af05 nodeName:}" failed. No retries permitted until 2026-07-27 18:09:12.784792718 +0000 UTC m=+2648.661993907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls") pod "maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" (UID: "1e000009-4bab-4f9e-8a8c-43edc9d9af05") : secret "maas-api-e2e-api-a-0a1799-serving-cert" not found
Jul 27 18:09:12.285236 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.285217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.296046 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.296020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq69w\" (UniqueName: \"kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.400020 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.399993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.584312 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.584228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.679330 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.679289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:12.789920 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.789870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:12.792370 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:12.792347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") pod \"maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:13.000247 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:13.000201    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:13.339935 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:13.339913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:13.340974 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:09:13.340948    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e000009_4bab_4f9e_8a8c_43edc9d9af05.slice/crio-2b1c263e6caabfee9289a3b6495a045b79349878284eb482f11de0925c1261c9 WatchSource:0}: Error finding container 2b1c263e6caabfee9289a3b6495a045b79349878284eb482f11de0925c1261c9: Status 404 returned error can't find the container with id 2b1c263e6caabfee9289a3b6495a045b79349878284eb482f11de0925c1261c9
Jul 27 18:09:14.061109 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:14.061072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" event={"ID":"1e000009-4bab-4f9e-8a8c-43edc9d9af05","Type":"ContainerStarted","Data":"4a8383a4e5c3b18c03497dc0adedd5dc9cc8e0fe8418d538033fc11079cf96dd"}
Jul 27 18:09:14.061325 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:14.061141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" event={"ID":"1e000009-4bab-4f9e-8a8c-43edc9d9af05","Type":"ContainerStarted","Data":"2b1c263e6caabfee9289a3b6495a045b79349878284eb482f11de0925c1261c9"}
Jul 27 18:09:14.061325 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:14.061174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:14.080413 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:14.080367    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" podStartSLOduration=1.50441979 podStartE2EDuration="2.080350797s" totalImagesPullingTime="575.931007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:14.078297055 +0000 UTC m=+2649.955498286" watchObservedRunningTime="2026-07-27 18:09:14.080350797 +0000 UTC m=+2649.957551999"
Jul 27 18:09:16.509118 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:16.509077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:16.981751 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:16.981718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:17.303840 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:17.303746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:17.918161 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:17.918118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.072641 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.072616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:20.143292 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.143257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.236487 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.236440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.237959 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.237899    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:09:20.242428 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.242405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.245278 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.245256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-47ce04-serving-cert\""
Jul 27 18:09:20.254828 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.254805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:09:20.310794 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.310761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.359515 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.359442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.359515 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.359473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbvpt\" (UniqueName: \"kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.359515 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.359496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.417063 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.417022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.460229 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.460200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.460375 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.460231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbvpt\" (UniqueName: \"kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.460375 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.460263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.460780 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.460761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.462812 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.462788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.468697 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.468672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbvpt\" (UniqueName: \"kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt\") pod \"maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.553827 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.553799    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:20.769437 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.769401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.866818 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.866783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:20.909101 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:20.909068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:09:20.909939 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:09:20.909907    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224ba9f3_c5b5_4a3b_878a_51492da495ef.slice/crio-64e64ddd3c14540b1f88e1af2099010b29c7304309f67601e0e74804ea8cea8a WatchSource:0}: Error finding container 64e64ddd3c14540b1f88e1af2099010b29c7304309f67601e0e74804ea8cea8a: Status 404 returned error can't find the container with id 64e64ddd3c14540b1f88e1af2099010b29c7304309f67601e0e74804ea8cea8a
Jul 27 18:09:21.103296 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:21.103260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" event={"ID":"224ba9f3-c5b5-4a3b-878a-51492da495ef","Type":"ContainerStarted","Data":"64e64ddd3c14540b1f88e1af2099010b29c7304309f67601e0e74804ea8cea8a"}
Jul 27 18:09:22.111399 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:22.111361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" event={"ID":"224ba9f3-c5b5-4a3b-878a-51492da495ef","Type":"ContainerStarted","Data":"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"}
Jul 27 18:09:22.111869 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:22.111479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:22.134244 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:22.134198    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" podStartSLOduration=1.700432325 podStartE2EDuration="2.134173986s" totalImagesPullingTime="433.741661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:22.131606437 +0000 UTC m=+2658.008807637" watchObservedRunningTime="2026-07-27 18:09:22.134173986 +0000 UTC m=+2658.011375189"
Jul 27 18:09:24.553456 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:24.553420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:28.122096 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:28.122063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:09:32.534619 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.534585    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"]
Jul 27 18:09:32.538432 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.538414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:32.541374 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.541347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:09:32.544738 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.544702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"]
Jul 27 18:09:32.670735 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.670699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj\" (UID: \"7c136275-41f6-4119-9d5b-dfbd0beffef0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:32.771584 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.771557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj\" (UID: \"7c136275-41f6-4119-9d5b-dfbd0beffef0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:32.772153 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.772133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj\" (UID: \"7c136275-41f6-4119-9d5b-dfbd0beffef0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:32.851416 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:32.851345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:33.193110 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:33.193073    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"]
Jul 27 18:09:33.193996 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:09:33.193968    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c136275_41f6_4119_9d5b_dfbd0beffef0.slice/crio-8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7 WatchSource:0}: Error finding container 8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7: Status 404 returned error can't find the container with id 8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7
Jul 27 18:09:34.178014 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:34.177919    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c136275-41f6-4119-9d5b-dfbd0beffef0" containerID="2e4cae923c1c72a151a4ec5714e54eaeff82820f6396c3d6384a6e3aa005e2ac" exitCode=0
Jul 27 18:09:34.178405 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:34.178013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj" event={"ID":"7c136275-41f6-4119-9d5b-dfbd0beffef0","Type":"ContainerDied","Data":"2e4cae923c1c72a151a4ec5714e54eaeff82820f6396c3d6384a6e3aa005e2ac"}
Jul 27 18:09:34.178405 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:34.178075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj" event={"ID":"7c136275-41f6-4119-9d5b-dfbd0beffef0","Type":"ContainerStarted","Data":"8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7"}
Jul 27 18:09:35.324817 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:35.324789    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:35.394724 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:35.394696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca\") pod \"7c136275-41f6-4119-9d5b-dfbd0beffef0\" (UID: \"7c136275-41f6-4119-9d5b-dfbd0beffef0\") "
Jul 27 18:09:35.395047 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:35.395024    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c136275-41f6-4119-9d5b-dfbd0beffef0" (UID: "7c136275-41f6-4119-9d5b-dfbd0beffef0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:09:35.496465 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:35.496430    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c136275-41f6-4119-9d5b-dfbd0beffef0-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:09:36.190740 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:36.190707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"
Jul 27 18:09:36.190740 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:36.190714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj" event={"ID":"7c136275-41f6-4119-9d5b-dfbd0beffef0","Type":"ContainerDied","Data":"8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7"}
Jul 27 18:09:36.190950 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:36.190755    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8567c8080e0e837c3b8a378cdea97e7773d062a5a2abaa3521cf2a3d3d4400e7"
Jul 27 18:09:48.127334 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.127289    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:48.127830 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.127559    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" podUID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" containerName="maas-api" containerID="cri-o://4a8383a4e5c3b18c03497dc0adedd5dc9cc8e0fe8418d538033fc11079cf96dd" gracePeriod=30
Jul 27 18:09:48.156708 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.156674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:48.257946 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.257905    2564 generic.go:356] "Generic (PLEG): container finished" podID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" containerID="4a8383a4e5c3b18c03497dc0adedd5dc9cc8e0fe8418d538033fc11079cf96dd" exitCode=0
Jul 27 18:09:48.258113 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.257965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" event={"ID":"1e000009-4bab-4f9e-8a8c-43edc9d9af05","Type":"ContainerDied","Data":"4a8383a4e5c3b18c03497dc0adedd5dc9cc8e0fe8418d538033fc11079cf96dd"}
Jul 27 18:09:48.387882 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.387818    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:48.510894 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.510864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") pod \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") "
Jul 27 18:09:48.511028 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.510956    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca\") pod \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") "
Jul 27 18:09:48.511080 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.511029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq69w\" (UniqueName: \"kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w\") pod \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\" (UID: \"1e000009-4bab-4f9e-8a8c-43edc9d9af05\") "
Jul 27 18:09:48.511349 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.511322    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e000009-4bab-4f9e-8a8c-43edc9d9af05" (UID: "1e000009-4bab-4f9e-8a8c-43edc9d9af05"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:09:48.512978 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.512950    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e000009-4bab-4f9e-8a8c-43edc9d9af05" (UID: "1e000009-4bab-4f9e-8a8c-43edc9d9af05"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:09:48.513058 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.512995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w" (OuterVolumeSpecName: "kube-api-access-gq69w") pod "1e000009-4bab-4f9e-8a8c-43edc9d9af05" (UID: "1e000009-4bab-4f9e-8a8c-43edc9d9af05"). InnerVolumeSpecName "kube-api-access-gq69w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:09:48.612249 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.612218    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e000009-4bab-4f9e-8a8c-43edc9d9af05-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:09:48.612249 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.612246    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e000009-4bab-4f9e-8a8c-43edc9d9af05-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:09:48.612400 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:48.612260    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq69w\" (UniqueName: \"kubernetes.io/projected/1e000009-4bab-4f9e-8a8c-43edc9d9af05-kube-api-access-gq69w\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:09:49.264689 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:49.264652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79" event={"ID":"1e000009-4bab-4f9e-8a8c-43edc9d9af05","Type":"ContainerDied","Data":"2b1c263e6caabfee9289a3b6495a045b79349878284eb482f11de0925c1261c9"}
Jul 27 18:09:49.264689 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:49.264683    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"
Jul 27 18:09:49.265215 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:49.264707    2564 scope.go:117] "RemoveContainer" containerID="4a8383a4e5c3b18c03497dc0adedd5dc9cc8e0fe8418d538033fc11079cf96dd"
Jul 27 18:09:49.282536 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:49.282504    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:49.288439 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:49.288417    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0a1799-7c64d686c9-jsf79"]
Jul 27 18:09:50.669379 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:50.669344    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" path="/var/lib/kubelet/pods/1e000009-4bab-4f9e-8a8c-43edc9d9af05/volumes"
Jul 27 18:09:51.402405 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:51.402367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:52.601578 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:52.601543    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"]
Jul 27 18:09:52.603895 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:52.603865    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0a1799-kmgsj"]
Jul 27 18:09:52.606455 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:52.606421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:52.669392 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:52.669359    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c136275-41f6-4119-9d5b-dfbd0beffef0" path="/var/lib/kubelet/pods/7c136275-41f6-4119-9d5b-dfbd0beffef0/volumes"
Jul 27 18:09:52.978909 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:52.978876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:58.791137 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:58.791054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:58.865100 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:58.865065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:59.063003 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.062904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:59.303724 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.303691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:09:59.396847 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.396766    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"]
Jul 27 18:09:59.397167 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397154    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c136275-41f6-4119-9d5b-dfbd0beffef0" containerName="revoke-keys"
Jul 27 18:09:59.397242 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397168    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c136275-41f6-4119-9d5b-dfbd0beffef0" containerName="revoke-keys"
Jul 27 18:09:59.397242 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397210    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" containerName="maas-api"
Jul 27 18:09:59.397242 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397216    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" containerName="maas-api"
Jul 27 18:09:59.397344 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397280    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e000009-4bab-4f9e-8a8c-43edc9d9af05" containerName="maas-api"
Jul 27 18:09:59.397344 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.397287    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c136275-41f6-4119-9d5b-dfbd0beffef0" containerName="revoke-keys"
Jul 27 18:09:59.401394 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.401377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:09:59.404200 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.404158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-47ce04-b868w\" (UID: \"87e8d229-269b-4862-812c-0fa2e971f3cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:09:59.404466 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.404446    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:09:59.407640 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.407615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"]
Jul 27 18:09:59.504999 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.504954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-47ce04-b868w\" (UID: \"87e8d229-269b-4862-812c-0fa2e971f3cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:09:59.505607 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.505589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-47ce04-b868w\" (UID: \"87e8d229-269b-4862-812c-0fa2e971f3cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:09:59.712950 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:09:59.712920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:10:00.055778 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:00.055753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"]
Jul 27 18:10:00.058062 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:10:00.058036    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e8d229_269b_4862_812c_0fa2e971f3cb.slice/crio-9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4 WatchSource:0}: Error finding container 9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4: Status 404 returned error can't find the container with id 9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4
Jul 27 18:10:00.327820 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:00.327736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w" event={"ID":"87e8d229-269b-4862-812c-0fa2e971f3cb","Type":"ContainerStarted","Data":"9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4"}
Jul 27 18:10:01.334402 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:01.334369    2564 generic.go:356] "Generic (PLEG): container finished" podID="87e8d229-269b-4862-812c-0fa2e971f3cb" containerID="b6adcb51552a4a3deb34b730eba3b2db1db884680ebf4cd4b483dfa05493926d" exitCode=0
Jul 27 18:10:01.334824 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:01.334455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w" event={"ID":"87e8d229-269b-4862-812c-0fa2e971f3cb","Type":"ContainerDied","Data":"b6adcb51552a4a3deb34b730eba3b2db1db884680ebf4cd4b483dfa05493926d"}
Jul 27 18:10:02.483928 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:02.483902    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:10:02.528580 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:02.528552    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca\") pod \"87e8d229-269b-4862-812c-0fa2e971f3cb\" (UID: \"87e8d229-269b-4862-812c-0fa2e971f3cb\") "
Jul 27 18:10:02.528870 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:02.528848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87e8d229-269b-4862-812c-0fa2e971f3cb" (UID: "87e8d229-269b-4862-812c-0fa2e971f3cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:02.629337 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:02.629261    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87e8d229-269b-4862-812c-0fa2e971f3cb-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:10:03.347198 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:03.347150    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"
Jul 27 18:10:03.347198 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:03.347169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w" event={"ID":"87e8d229-269b-4862-812c-0fa2e971f3cb","Type":"ContainerDied","Data":"9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4"}
Jul 27 18:10:03.347415 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:03.347243    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c6f15edf6bc1a9d45b7c1e9b4df001fac1fd7bfa41ded44b4d3d14d415d30b4"
Jul 27 18:10:14.866059 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:14.866023    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:10:14.867105 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:14.867072    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" podUID="224ba9f3-c5b5-4a3b-878a-51492da495ef" containerName="maas-api" containerID="cri-o://b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a" gracePeriod=30
Jul 27 18:10:14.905684 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:14.905652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:15.005325 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.005292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:15.120395 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.120335    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:10:15.236859 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.236831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbvpt\" (UniqueName: \"kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt\") pod \"224ba9f3-c5b5-4a3b-878a-51492da495ef\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") "
Jul 27 18:10:15.237001 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.236894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca\") pod \"224ba9f3-c5b5-4a3b-878a-51492da495ef\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") "
Jul 27 18:10:15.237001 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.236927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls\") pod \"224ba9f3-c5b5-4a3b-878a-51492da495ef\" (UID: \"224ba9f3-c5b5-4a3b-878a-51492da495ef\") "
Jul 27 18:10:15.237307 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.237283    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "224ba9f3-c5b5-4a3b-878a-51492da495ef" (UID: "224ba9f3-c5b5-4a3b-878a-51492da495ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:15.239048 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.239011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "224ba9f3-c5b5-4a3b-878a-51492da495ef" (UID: "224ba9f3-c5b5-4a3b-878a-51492da495ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:10:15.239048 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.239022    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt" (OuterVolumeSpecName: "kube-api-access-vbvpt") pod "224ba9f3-c5b5-4a3b-878a-51492da495ef" (UID: "224ba9f3-c5b5-4a3b-878a-51492da495ef"). InnerVolumeSpecName "kube-api-access-vbvpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:15.338020 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.337985    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224ba9f3-c5b5-4a3b-878a-51492da495ef-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.338020 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.338012    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224ba9f3-c5b5-4a3b-878a-51492da495ef-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.338020 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.338021    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbvpt\" (UniqueName: \"kubernetes.io/projected/224ba9f3-c5b5-4a3b-878a-51492da495ef-kube-api-access-vbvpt\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.420040 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.419965    2564 generic.go:356] "Generic (PLEG): container finished" podID="224ba9f3-c5b5-4a3b-878a-51492da495ef" containerID="b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a" exitCode=0
Jul 27 18:10:15.420040 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.420003    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"
Jul 27 18:10:15.420040 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.420040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" event={"ID":"224ba9f3-c5b5-4a3b-878a-51492da495ef","Type":"ContainerDied","Data":"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"}
Jul 27 18:10:15.420292 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.420084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l" event={"ID":"224ba9f3-c5b5-4a3b-878a-51492da495ef","Type":"ContainerDied","Data":"64e64ddd3c14540b1f88e1af2099010b29c7304309f67601e0e74804ea8cea8a"}
Jul 27 18:10:15.420292 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.420109    2564 scope.go:117] "RemoveContainer" containerID="b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"
Jul 27 18:10:15.429703 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.429684    2564 scope.go:117] "RemoveContainer" containerID="b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"
Jul 27 18:10:15.429947 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:10:15.429927    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a\": container with ID starting with b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a not found: ID does not exist" containerID="b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"
Jul 27 18:10:15.430001 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.429955    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a"} err="failed to get container status \"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a\": rpc error: code = NotFound desc = could not find container \"b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a\": container with ID starting with b91ab9bd69cdf35a63b870a017d6662d95d685d9cd0d655994b046163554413a not found: ID does not exist"
Jul 27 18:10:15.442024 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.442002    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:10:15.446094 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:15.446074    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47ce04-f9f9b598b-9x68l"]
Jul 27 18:10:16.668906 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:16.668876    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224ba9f3-c5b5-4a3b-878a-51492da495ef" path="/var/lib/kubelet/pods/224ba9f3-c5b5-4a3b-878a-51492da495ef/volumes"
Jul 27 18:10:19.472773 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:19.472742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:19.474275 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:19.474251    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"]
Jul 27 18:10:19.476469 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:19.476448    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-47ce04-b868w"]
Jul 27 18:10:19.851871 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:19.851778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:20.668517 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:20.668476    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e8d229-269b-4862-812c-0fa2e971f3cb" path="/var/lib/kubelet/pods/87e8d229-269b-4862-812c-0fa2e971f3cb/volumes"
Jul 27 18:10:25.755509 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:25.755475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:25.856615 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:25.856563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:26.043290 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:26.043201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:26.270031 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:26.269976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:26.610729 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:26.610690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:26.941528 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:26.941497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:27.151138 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:27.151103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:29.484672 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.484631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:29.554087 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554058    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:10:29.554605 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554589    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e8d229-269b-4862-812c-0fa2e971f3cb" containerName="revoke-keys"
Jul 27 18:10:29.554685 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554608    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e8d229-269b-4862-812c-0fa2e971f3cb" containerName="revoke-keys"
Jul 27 18:10:29.554685 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554624    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224ba9f3-c5b5-4a3b-878a-51492da495ef" containerName="maas-api"
Jul 27 18:10:29.554685 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554633    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="224ba9f3-c5b5-4a3b-878a-51492da495ef" containerName="maas-api"
Jul 27 18:10:29.554785 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554748    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e8d229-269b-4862-812c-0fa2e971f3cb" containerName="revoke-keys"
Jul 27 18:10:29.554785 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.554761    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="224ba9f3-c5b5-4a3b-878a-51492da495ef" containerName="maas-api"
Jul 27 18:10:29.559458 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.559440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.562586 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.562560    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 18:10:29.562712 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.562615    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-addd0c-serving-cert\""
Jul 27 18:10:29.562712 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.562702    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:10:29.563974 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.563958    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\""
Jul 27 18:10:29.570496 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.570466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:10:29.573907 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.573883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:29.638277 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.638246    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:29.661030 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.660990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.661214 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.661084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klssq\" (UniqueName: \"kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.661214 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.661155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.742294 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.742204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:29.762626 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.762589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.762788 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.762644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klssq\" (UniqueName: \"kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.762788 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.762713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.763637 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.763615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.765236 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.765219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.770611 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.770588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klssq\" (UniqueName: \"kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq\") pod \"maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:29.874504 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:29.874478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:30.013389 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:30.013360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:10:30.015510 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:10:30.015472    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffff087_af83_4e04_ac63_64bbf9cc08b7.slice/crio-5f3280de933d3e9d09bbb002b763e7ab08ef888b111e91a5c6c5492dac65c41a WatchSource:0}: Error finding container 5f3280de933d3e9d09bbb002b763e7ab08ef888b111e91a5c6c5492dac65c41a: Status 404 returned error can't find the container with id 5f3280de933d3e9d09bbb002b763e7ab08ef888b111e91a5c6c5492dac65c41a
Jul 27 18:10:30.050226 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:30.050200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:30.143404 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:30.143373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:30.507272 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:30.507238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" event={"ID":"affff087-af83-4e04-ac63-64bbf9cc08b7","Type":"ContainerStarted","Data":"5f3280de933d3e9d09bbb002b763e7ab08ef888b111e91a5c6c5492dac65c41a"}
Jul 27 18:10:31.515599 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:31.515560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" event={"ID":"affff087-af83-4e04-ac63-64bbf9cc08b7","Type":"ContainerStarted","Data":"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"}
Jul 27 18:10:31.516078 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:31.515681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:31.543189 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:31.543117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" podStartSLOduration=1.86052997 podStartE2EDuration="2.543097583s" totalImagesPullingTime="682.567613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:31.539947426 +0000 UTC m=+2727.417148630" watchObservedRunningTime="2026-07-27 18:10:31.543097583 +0000 UTC m=+2727.420298787"
Jul 27 18:10:33.962982 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:33.962946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:34.291331 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:34.291236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:34.596656 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:34.596565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:34.874477 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:34.874393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:37.526829 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.526801    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:10:37.530985 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.530955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:37.628268 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.628235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:37.738405 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.738371    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:10:37.742195 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.742157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.745015 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.744994    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1706dd-serving-cert\""
Jul 27 18:10:37.751977 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.751954    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:10:37.767724 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.767692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:37.838017 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.837942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.838017 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.838011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x89v\" (UniqueName: \"kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.838253 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.838065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.938568 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.938530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.938750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.938606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.938750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.938678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x89v\" (UniqueName: \"kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.938750 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:10:37.938688    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-serving-cert: secret "maas-api-e2e-shared-b-1706dd-serving-cert" not found
Jul 27 18:10:37.938750 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:10:37.938749    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls podName:05073575-8fe1-43ff-86bd-f0e9922ffd69 nodeName:}" failed. No retries permitted until 2026-07-27 18:10:38.438731958 +0000 UTC m=+2734.315933139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls") pod "maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" (UID: "05073575-8fe1-43ff-86bd-f0e9922ffd69") : secret "maas-api-e2e-shared-b-1706dd-serving-cert" not found
Jul 27 18:10:37.939319 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.939297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:37.947982 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:37.947962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x89v\" (UniqueName: \"kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:38.082226 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.082173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:38.315806 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.315772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:38.413623 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.413588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:38.443124 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.443088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:38.445550 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.445525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") pod \"maas-api-e2e-shared-b-1706dd-b87c5689d-4677r\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:38.653946 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:38.653854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:39.012718 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:39.012691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:10:39.013779 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:10:39.013752    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05073575_8fe1_43ff_86bd_f0e9922ffd69.slice/crio-f54665e7ede81d9ebd80ae2c732fb6adb87e61e1356a1f6d9671bcaad9e4645f WatchSource:0}: Error finding container f54665e7ede81d9ebd80ae2c732fb6adb87e61e1356a1f6d9671bcaad9e4645f: Status 404 returned error can't find the container with id f54665e7ede81d9ebd80ae2c732fb6adb87e61e1356a1f6d9671bcaad9e4645f
Jul 27 18:10:39.562357 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:39.562321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" event={"ID":"05073575-8fe1-43ff-86bd-f0e9922ffd69","Type":"ContainerStarted","Data":"86e43383f0a1c543123e771fab28cf0c908370001afd467e13ef9c6bccb408f2"}
Jul 27 18:10:39.562655 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:39.562386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:39.562655 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:39.562412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" event={"ID":"05073575-8fe1-43ff-86bd-f0e9922ffd69","Type":"ContainerStarted","Data":"f54665e7ede81d9ebd80ae2c732fb6adb87e61e1356a1f6d9671bcaad9e4645f"}
Jul 27 18:10:39.582925 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:39.582839    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" podStartSLOduration=2.281067281 podStartE2EDuration="2.582825043s" totalImagesPullingTime="301.757762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:39.58082951 +0000 UTC m=+2735.458030741" watchObservedRunningTime="2026-07-27 18:10:39.582825043 +0000 UTC m=+2735.460026246"
Jul 27 18:10:41.982463 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:41.982429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:45.574762 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:45.574733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:10:53.202809 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:10:53.202777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:04.922585 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:11:04.922557    2564 scope.go:117] "RemoveContainer" containerID="894f1e8e5d4325690f5a81470b6221feb5d2340d30ae0942d475de400ad5bf8f"
Jul 27 18:11:08.689230 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:11:08.689151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:15.117798 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:11:15.117758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:50.299358 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:11:50.299270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:50.968239 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:11:50.968203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:26.527533 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:12:26.527491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:27.358135 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:12:27.358104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:01.361471 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:14:01.361435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:15:04.976406 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:04.976368    2564 scope.go:117] "RemoveContainer" containerID="cbb77c5adc7d3aafa1d13c9878accaacc4f792576b74e790c9cfc0ca41499154"
Jul 27 18:15:04.985064 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:04.985040    2564 scope.go:117] "RemoveContainer" containerID="8b4657fc0d7800c776faf99bdcb3cebbed915ba2d9dcfd074b29f034706b88d6"
Jul 27 18:15:29.597837 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:29.597804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:15:31.796775 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:31.796740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:15:39.511744 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:39.511706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:15:55.332321 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:55.332277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:15:55.433490 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:15:55.433454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:16:05.009510 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:16:05.009442    2564 scope.go:117] "RemoveContainer" containerID="2e4cae923c1c72a151a4ec5714e54eaeff82820f6396c3d6384a6e3aa005e2ac"
Jul 27 18:16:05.017987 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:16:05.017967    2564 scope.go:117] "RemoveContainer" containerID="b6adcb51552a4a3deb34b730eba3b2db1db884680ebf4cd4b483dfa05493926d"
Jul 27 18:16:12.187759 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:16:12.187722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:16:13.225699 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:16:13.225662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:17:14.704859 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:17:14.704817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:17:15.694512 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:17:15.694481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:17:40.440296 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:17:40.440258    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:18:05.240514 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:18:05.240483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:18:12.908821 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:18:12.908790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:18:20.664431 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:18:20.664382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:11.776141 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:11.776058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:12.518967 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:12.518900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:32.497812 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:32.497769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:32.686249 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:32.686208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:33.236162 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:33.236133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:35.311780 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.311746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:35.386480 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.386448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:35.388030 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.387994    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:19:35.391524 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.391502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.394925 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.394904    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-f4a7a7-serving-cert\""
Jul 27 18:19:35.404001 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.403844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:19:35.467661 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.467615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:35.483956 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.483925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.484132 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.483976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554dq\" (UniqueName: \"kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.484132 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.484075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.584779 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.584689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.584779 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.584732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554dq\" (UniqueName: \"kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.585013 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:19:35.584839    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-serving-cert: secret "maas-api-e2e-ipp-a-f4a7a7-serving-cert" not found
Jul 27 18:19:35.585013 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:19:35.584907    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls podName:47714c13-4e3c-4fa1-b8b5-290c92edb814 nodeName:}" failed. No retries permitted until 2026-07-27 18:19:36.084886469 +0000 UTC m=+3271.962087666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls") pod "maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" (UID: "47714c13-4e3c-4fa1-b8b5-290c92edb814") : secret "maas-api-e2e-ipp-a-f4a7a7-serving-cert" not found
Jul 27 18:19:35.585013 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.584990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.585796 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.585772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:35.593752 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:35.593731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554dq\" (UniqueName: \"kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:36.011519 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.011477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:36.089515 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.089483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:36.091877 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.091851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:36.113978 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.113949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:36.196290 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.196259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:36.306040 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.305960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:36.446477 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.446448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:19:36.447371 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:19:36.447332    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47714c13_4e3c_4fa1_b8b5_290c92edb814.slice/crio-3e9236ee46cc06867c716736c17ec753189e4b10f57f347b077780e536468fd5 WatchSource:0}: Error finding container 3e9236ee46cc06867c716736c17ec753189e4b10f57f347b077780e536468fd5: Status 404 returned error can't find the container with id 3e9236ee46cc06867c716736c17ec753189e4b10f57f347b077780e536468fd5
Jul 27 18:19:36.448826 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.448806    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:19:36.487696 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:36.487669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" event={"ID":"47714c13-4e3c-4fa1-b8b5-290c92edb814","Type":"ContainerStarted","Data":"3e9236ee46cc06867c716736c17ec753189e4b10f57f347b077780e536468fd5"}
Jul 27 18:19:37.494369 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:37.494337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" event={"ID":"47714c13-4e3c-4fa1-b8b5-290c92edb814","Type":"ContainerStarted","Data":"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"}
Jul 27 18:19:37.494686 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:37.494510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:37.516633 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:37.516590    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" podStartSLOduration=1.564557959 podStartE2EDuration="2.516576886s" totalImagesPullingTime="952.018927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:37.514105205 +0000 UTC m=+3273.391306400" watchObservedRunningTime="2026-07-27 18:19:37.516576886 +0000 UTC m=+3273.393778088"
Jul 27 18:19:39.784240 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:39.784209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:43.404264 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.404229    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:43.407867 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.407852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:43.410715 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.410691    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gk66w\""
Jul 27 18:19:43.415533 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.415507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:43.462434 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.462407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnm4s\" (UniqueName: \"kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s\") pod \"kuadrant-operator-catalog-6b27z\" (UID: \"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0\") " pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:43.504959 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.504935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:19:43.563815 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.563777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnm4s\" (UniqueName: \"kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s\") pod \"kuadrant-operator-catalog-6b27z\" (UID: \"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0\") " pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:43.573141 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.573115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnm4s\" (UniqueName: \"kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s\") pod \"kuadrant-operator-catalog-6b27z\" (UID: \"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0\") " pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:43.717248 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.717212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:43.852581 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:43.852553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:43.854102 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:19:43.854069    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9a18b1_b829_4ad6_b18d_44a254c4f1e0.slice/crio-63125681779fec9de2d1752db0e49047924752ef2dc723631fa4b56e59e0c769 WatchSource:0}: Error finding container 63125681779fec9de2d1752db0e49047924752ef2dc723631fa4b56e59e0c769: Status 404 returned error can't find the container with id 63125681779fec9de2d1752db0e49047924752ef2dc723631fa4b56e59e0c769
Jul 27 18:19:44.542568 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:44.542531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" event={"ID":"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0","Type":"ContainerStarted","Data":"63125681779fec9de2d1752db0e49047924752ef2dc723631fa4b56e59e0c769"}
Jul 27 18:19:46.554582 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:46.554546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" event={"ID":"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0","Type":"ContainerStarted","Data":"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"}
Jul 27 18:19:46.571548 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:46.571503    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" podStartSLOduration=1.828290676 podStartE2EDuration="3.571489312s" totalImagesPullingTime="1.743198636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:46.569620936 +0000 UTC m=+3282.446822140" watchObservedRunningTime="2026-07-27 18:19:46.571489312 +0000 UTC m=+3282.448690515"
Jul 27 18:19:50.702854 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:50.702817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:51.032622 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:51.032546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:51.401991 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:51.401920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:53.717475 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:53.717443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:53.717886 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:53.717502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:53.739131 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:53.739108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:54.619575 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:54.619549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:54.660822 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:54.660795    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:56.608601 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:56.608551    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" podUID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" containerName="registry-server" containerID="cri-o://09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c" gracePeriod=2
Jul 27 18:19:56.868511 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:56.868441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:56.972596 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:56.972554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnm4s\" (UniqueName: \"kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s\") pod \"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0\" (UID: \"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0\") "
Jul 27 18:19:56.974629 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:56.974605    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s" (OuterVolumeSpecName: "kube-api-access-fnm4s") pod "cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" (UID: "cc9a18b1-b829-4ad6-b18d-44a254c4f1e0"). InnerVolumeSpecName "kube-api-access-fnm4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:57.073678 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.073645    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnm4s\" (UniqueName: \"kubernetes.io/projected/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0-kube-api-access-fnm4s\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:19:57.614621 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.614588    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" containerID="09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c" exitCode=0
Jul 27 18:19:57.615051 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.614640    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6b27z"
Jul 27 18:19:57.615051 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.614680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" event={"ID":"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0","Type":"ContainerDied","Data":"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"}
Jul 27 18:19:57.615051 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.614752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6b27z" event={"ID":"cc9a18b1-b829-4ad6-b18d-44a254c4f1e0","Type":"ContainerDied","Data":"63125681779fec9de2d1752db0e49047924752ef2dc723631fa4b56e59e0c769"}
Jul 27 18:19:57.615051 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.614773    2564 scope.go:117] "RemoveContainer" containerID="09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"
Jul 27 18:19:57.624576 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.624560    2564 scope.go:117] "RemoveContainer" containerID="09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"
Jul 27 18:19:57.624816 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:19:57.624799    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c\": container with ID starting with 09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c not found: ID does not exist" containerID="09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"
Jul 27 18:19:57.624868 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.624824    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c"} err="failed to get container status \"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c\": rpc error: code = NotFound desc = could not find container \"09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c\": container with ID starting with 09050af2ff66d5a7496a9319a03335f7cbee925c01af07852fb1a357ee4fdd5c not found: ID does not exist"
Jul 27 18:19:57.636855 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.636833    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:57.640572 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.640552    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6b27z"]
Jul 27 18:19:57.847029 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.847001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:57.944913 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:57.944885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:58.023085 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.023051    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:19:58.023473 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.023459    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" containerName="registry-server"
Jul 27 18:19:58.023531 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.023475    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" containerName="registry-server"
Jul 27 18:19:58.023572 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.023541    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" containerName="registry-server"
Jul 27 18:19:58.027956 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.027935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.030891 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.030868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-5cb9b7-serving-cert\""
Jul 27 18:19:58.042865 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.042840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:19:58.068465 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.068423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:58.083262 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.083236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.083377 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.083297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.083377 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.083358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvzp\" (UniqueName: \"kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.183829 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.183798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.183981 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.183859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.183981 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.183893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvzp\" (UniqueName: \"kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.183981 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:19:58.183954    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-serving-cert: secret "maas-api-e2e-ipp-b-5cb9b7-serving-cert" not found
Jul 27 18:19:58.184093 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:19:58.184018    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls podName:734578ac-58d8-4724-9263-2886ad6b66a7 nodeName:}" failed. No retries permitted until 2026-07-27 18:19:58.684003007 +0000 UTC m=+3294.561204188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls") pod "maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" (UID: "734578ac-58d8-4724-9263-2886ad6b66a7") : secret "maas-api-e2e-ipp-b-5cb9b7-serving-cert" not found
Jul 27 18:19:58.184506 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.184486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.192530 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.192513    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvzp\" (UniqueName: \"kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.285097 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.285008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:58.530157 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.530073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:58.637087 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.637007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:58.671111 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.671082    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9a18b1-b829-4ad6-b18d-44a254c4f1e0" path="/var/lib/kubelet/pods/cc9a18b1-b829-4ad6-b18d-44a254c4f1e0/volumes"
Jul 27 18:19:58.687997 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.687967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.690511 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.690490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:58.703140 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.703116    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:19:58.707873 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.707856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.710928 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.710907    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5cb9b7\""
Jul 27 18:19:58.711112 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.710982    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5cb9b7-dockercfg-gvjvm\""
Jul 27 18:19:58.713134 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.713110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:19:58.789461 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.789430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.789622 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.789541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gccgv\" (UniqueName: \"kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.889995 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.889900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gccgv\" (UniqueName: \"kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.890130 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.889997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.890782 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.890753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.899016 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.898989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gccgv\" (UniqueName: \"kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv\") pod \"payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:58.938277 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:58.938256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:19:59.021518 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.021483    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:59.109724 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.109691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:19:59.110859 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:19:59.110834    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734578ac_58d8_4724_9263_2886ad6b66a7.slice/crio-f2cf0c26791d287eae1bfb5dad2c01a4fd0b530ce0303d9584b567fe5f8db1b6 WatchSource:0}: Error finding container f2cf0c26791d287eae1bfb5dad2c01a4fd0b530ce0303d9584b567fe5f8db1b6: Status 404 returned error can't find the container with id f2cf0c26791d287eae1bfb5dad2c01a4fd0b530ce0303d9584b567fe5f8db1b6
Jul 27 18:19:59.183326 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.183293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:19:59.184703 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:19:59.184668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa392488_e95c_4b1b_8eaa_37eac7605d34.slice/crio-9648db9184a7077faeb6daef06f604b72c999c2cff0ef245b5b90d0551aa877e WatchSource:0}: Error finding container 9648db9184a7077faeb6daef06f604b72c999c2cff0ef245b5b90d0551aa877e: Status 404 returned error can't find the container with id 9648db9184a7077faeb6daef06f604b72c999c2cff0ef245b5b90d0551aa877e
Jul 27 18:19:59.627963 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.627924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" event={"ID":"fa392488-e95c-4b1b-8eaa-37eac7605d34","Type":"ContainerStarted","Data":"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"}
Jul 27 18:19:59.628144 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.627988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" event={"ID":"fa392488-e95c-4b1b-8eaa-37eac7605d34","Type":"ContainerStarted","Data":"9648db9184a7077faeb6daef06f604b72c999c2cff0ef245b5b90d0551aa877e"}
Jul 27 18:19:59.628144 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.628037    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:19:59.629220 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.629202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" event={"ID":"734578ac-58d8-4724-9263-2886ad6b66a7","Type":"ContainerStarted","Data":"f2cf0c26791d287eae1bfb5dad2c01a4fd0b530ce0303d9584b567fe5f8db1b6"}
Jul 27 18:19:59.647289 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:19:59.647239    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" podStartSLOduration=1.647227153 podStartE2EDuration="1.647227153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:59.645450255 +0000 UTC m=+3295.522651458" watchObservedRunningTime="2026-07-27 18:19:59.647227153 +0000 UTC m=+3295.524428355"
Jul 27 18:20:00.636386 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:00.636348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" event={"ID":"734578ac-58d8-4724-9263-2886ad6b66a7","Type":"ContainerStarted","Data":"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"}
Jul 27 18:20:00.636671 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:00.636649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:20:00.656033 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:00.655985    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" podStartSLOduration=1.706712298 podStartE2EDuration="2.655971708s" totalImagesPullingTime="949.25941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:20:00.654064727 +0000 UTC m=+3296.531265941" watchObservedRunningTime="2026-07-27 18:20:00.655971708 +0000 UTC m=+3296.533172910"
Jul 27 18:20:02.263050 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:02.263017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:20:05.853303 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:05.853264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:20:06.648546 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:06.648514    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:20:10.638702 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:10.638672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:20:21.482628 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:21.482593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:20:31.921891 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:20:31.921806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:05.267543 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:05.267508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:13.878168 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:13.878130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:17.161442 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:17.161405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:18.158372 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:18.158335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:18.234156 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:18.234100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.158832 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.158794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.236680 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.236653    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:20.239325 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.239305    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.242219 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.242198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-605142-serving-cert\""
Jul 27 18:21:20.244754 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.244728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.251003 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.250980    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:20.310403 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.310372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.326529 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.326501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.326656 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.326546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229vn\" (UniqueName: \"kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.326656 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.326621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.427803 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.427714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.427979 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.427813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.427979 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.427854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229vn\" (UniqueName: \"kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.427979 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:21:20.427959    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-serving-cert: secret "maas-api-e2e-ipp-cleanup-605142-serving-cert" not found
Jul 27 18:21:20.428159 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:21:20.428017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls podName:95a6a34d-55f1-4bfb-9a16-f54160a18ea7 nodeName:}" failed. No retries permitted until 2026-07-27 18:21:20.927999942 +0000 UTC m=+3376.805201129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" (UID: "95a6a34d-55f1-4bfb-9a16-f54160a18ea7") : secret "maas-api-e2e-ipp-cleanup-605142-serving-cert" not found
Jul 27 18:21:20.428512 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.428487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.437921 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.437895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229vn\" (UniqueName: \"kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.568679 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.568643    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.724684 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.724652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.820351 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.820318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:20.932576 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.932540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:20.935025 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:20.934995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:21.151809 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:21.151727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:21.289810 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:21.289775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:21.290605 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:21:21.290579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a6a34d_55f1_4bfb_9a16_f54160a18ea7.slice/crio-54b6d2cf2e1d85b4d82ede358322797dc4d9b81f2d16def7e7b76438145f8244 WatchSource:0}: Error finding container 54b6d2cf2e1d85b4d82ede358322797dc4d9b81f2d16def7e7b76438145f8244: Status 404 returned error can't find the container with id 54b6d2cf2e1d85b4d82ede358322797dc4d9b81f2d16def7e7b76438145f8244
Jul 27 18:21:22.081762 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:22.081733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" event={"ID":"95a6a34d-55f1-4bfb-9a16-f54160a18ea7","Type":"ContainerStarted","Data":"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"}
Jul 27 18:21:22.081935 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:22.081782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" event={"ID":"95a6a34d-55f1-4bfb-9a16-f54160a18ea7","Type":"ContainerStarted","Data":"54b6d2cf2e1d85b4d82ede358322797dc4d9b81f2d16def7e7b76438145f8244"}
Jul 27 18:21:22.081935 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:22.081813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:22.108591 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:22.108525    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" podStartSLOduration=1.517394946 podStartE2EDuration="2.108506237s" totalImagesPullingTime="591.111291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:21:22.103831071 +0000 UTC m=+3377.981032275" watchObservedRunningTime="2026-07-27 18:21:22.108506237 +0000 UTC m=+3377.985707442"
Jul 27 18:21:24.625636 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:24.625601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:25.490564 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:25.490532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:28.093329 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:28.093300    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:35.564587 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.564558    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"]
Jul 27 18:21:35.568730 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.568707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:35.572046 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.572023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:21:35.576284 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.576163    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"]
Jul 27 18:21:35.670077 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.670046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg\" (UID: \"5cde59b6-af2f-42c7-be20-5e4fda9f111f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:35.771230 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.771202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg\" (UID: \"5cde59b6-af2f-42c7-be20-5e4fda9f111f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:35.771780 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.771760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg\" (UID: \"5cde59b6-af2f-42c7-be20-5e4fda9f111f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:35.883314 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:35.883238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:36.015049 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:36.015017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"]
Jul 27 18:21:36.015739 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:21:36.015705    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cde59b6_af2f_42c7_be20_5e4fda9f111f.slice/crio-4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7 WatchSource:0}: Error finding container 4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7: Status 404 returned error can't find the container with id 4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7
Jul 27 18:21:36.160146 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:36.160073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg" event={"ID":"5cde59b6-af2f-42c7-be20-5e4fda9f111f","Type":"ContainerStarted","Data":"4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7"}
Jul 27 18:21:37.166860 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:37.166830    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cde59b6-af2f-42c7-be20-5e4fda9f111f" containerID="61b18dcf4f432d0c1cf3c3351fc67e7b30b987241c8927e6a91b5775b69e28d9" exitCode=0
Jul 27 18:21:37.167273 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:37.166918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg" event={"ID":"5cde59b6-af2f-42c7-be20-5e4fda9f111f","Type":"ContainerDied","Data":"61b18dcf4f432d0c1cf3c3351fc67e7b30b987241c8927e6a91b5775b69e28d9"}
Jul 27 18:21:38.314628 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:38.314602    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:38.398292 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:38.398256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca\") pod \"5cde59b6-af2f-42c7-be20-5e4fda9f111f\" (UID: \"5cde59b6-af2f-42c7-be20-5e4fda9f111f\") "
Jul 27 18:21:38.398664 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:38.398644    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5cde59b6-af2f-42c7-be20-5e4fda9f111f" (UID: "5cde59b6-af2f-42c7-be20-5e4fda9f111f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:21:38.499137 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:38.499103    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cde59b6-af2f-42c7-be20-5e4fda9f111f-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:21:39.179492 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:39.179465    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"
Jul 27 18:21:39.179686 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:39.179497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg" event={"ID":"5cde59b6-af2f-42c7-be20-5e4fda9f111f","Type":"ContainerDied","Data":"4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7"}
Jul 27 18:21:39.179686 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:39.179544    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e5cf62656224d3574d32bf7dc916e95c489e79b0bf1a2a96cef14a9e26845b7"
Jul 27 18:21:45.893515 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:45.893476    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:45.894005 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:45.893751    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" podUID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" containerName="maas-api" containerID="cri-o://c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0" gracePeriod=30
Jul 27 18:21:45.933319 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:45.933296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:46.033211 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.033173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:46.155599 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.155535    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:46.219034 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.218997    2564 generic.go:356] "Generic (PLEG): container finished" podID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" containerID="c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0" exitCode=0
Jul 27 18:21:46.219034 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.219038    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"
Jul 27 18:21:46.219324 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.219032    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" event={"ID":"95a6a34d-55f1-4bfb-9a16-f54160a18ea7","Type":"ContainerDied","Data":"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"}
Jul 27 18:21:46.219324 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.219165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2" event={"ID":"95a6a34d-55f1-4bfb-9a16-f54160a18ea7","Type":"ContainerDied","Data":"54b6d2cf2e1d85b4d82ede358322797dc4d9b81f2d16def7e7b76438145f8244"}
Jul 27 18:21:46.219324 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.219217    2564 scope.go:117] "RemoveContainer" containerID="c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"
Jul 27 18:21:46.237328 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.237297    2564 scope.go:117] "RemoveContainer" containerID="c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"
Jul 27 18:21:46.237646 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:21:46.237623    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0\": container with ID starting with c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0 not found: ID does not exist" containerID="c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"
Jul 27 18:21:46.237711 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.237659    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0"} err="failed to get container status \"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0\": rpc error: code = NotFound desc = could not find container \"c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0\": container with ID starting with c6d706028670ea8115ece1db2e41195f6621a5cd1dd0505811c78ec9684615c0 not found: ID does not exist"
Jul 27 18:21:46.270444 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.270414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-229vn\" (UniqueName: \"kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn\") pod \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") "
Jul 27 18:21:46.270588 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.270560    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca\") pod \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") "
Jul 27 18:21:46.270650 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.270603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") pod \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\" (UID: \"95a6a34d-55f1-4bfb-9a16-f54160a18ea7\") "
Jul 27 18:21:46.270932 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.270908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95a6a34d-55f1-4bfb-9a16-f54160a18ea7" (UID: "95a6a34d-55f1-4bfb-9a16-f54160a18ea7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:21:46.272687 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.272662    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95a6a34d-55f1-4bfb-9a16-f54160a18ea7" (UID: "95a6a34d-55f1-4bfb-9a16-f54160a18ea7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:21:46.272804 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.272782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn" (OuterVolumeSpecName: "kube-api-access-229vn") pod "95a6a34d-55f1-4bfb-9a16-f54160a18ea7" (UID: "95a6a34d-55f1-4bfb-9a16-f54160a18ea7"). InnerVolumeSpecName "kube-api-access-229vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:21:46.371384 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.371345    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-229vn\" (UniqueName: \"kubernetes.io/projected/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-kube-api-access-229vn\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.371384 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.371378    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.371384 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.371388    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95a6a34d-55f1-4bfb-9a16-f54160a18ea7-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.542169 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.542137    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:46.547824 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.547798    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-605142-5b8795b4cd-w5zv2"]
Jul 27 18:21:46.669459 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:46.669421    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" path="/var/lib/kubelet/pods/95a6a34d-55f1-4bfb-9a16-f54160a18ea7/volumes"
Jul 27 18:21:50.624721 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:50.624656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"]
Jul 27 18:21:50.627023 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:50.626993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:50.627587 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:50.627567    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-605142-cm7sg"]
Jul 27 18:21:50.668660 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:50.668626    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cde59b6-af2f-42c7-be20-5e4fda9f111f" path="/var/lib/kubelet/pods/5cde59b6-af2f-42c7-be20-5e4fda9f111f/volumes"
Jul 27 18:21:51.007353 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:51.007318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:56.955878 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:56.955794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:57.026415 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:57.026382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:57.219459 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:57.219379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:21:57.510641 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:21:57.510567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:00.861397 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.861360    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"]
Jul 27 18:22:00.861974 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.861955    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cde59b6-af2f-42c7-be20-5e4fda9f111f" containerName="revoke-keys"
Jul 27 18:22:00.861974 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.861976    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cde59b6-af2f-42c7-be20-5e4fda9f111f" containerName="revoke-keys"
Jul 27 18:22:00.862130 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.861999    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" containerName="maas-api"
Jul 27 18:22:00.862130 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.862007    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" containerName="maas-api"
Jul 27 18:22:00.862285 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.862133    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95a6a34d-55f1-4bfb-9a16-f54160a18ea7" containerName="maas-api"
Jul 27 18:22:00.862285 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.862151    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cde59b6-af2f-42c7-be20-5e4fda9f111f" containerName="revoke-keys"
Jul 27 18:22:00.865726 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.865705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:00.869308 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.869286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:22:00.874645 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.872971    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"]
Jul 27 18:22:00.899351 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:00.899313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb\" (UID: \"1b22fa48-3a34-4d62-8a39-9437546109ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:01.000548 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:01.000521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb\" (UID: \"1b22fa48-3a34-4d62-8a39-9437546109ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:01.001121 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:01.001102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb\" (UID: \"1b22fa48-3a34-4d62-8a39-9437546109ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:01.179259 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:01.179151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:01.319761 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:01.319730    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"]
Jul 27 18:22:01.320870 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:22:01.320842    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b22fa48_3a34_4d62_8a39_9437546109ac.slice/crio-bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3 WatchSource:0}: Error finding container bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3: Status 404 returned error can't find the container with id bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3
Jul 27 18:22:02.310312 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:02.310221    2564 generic.go:356] "Generic (PLEG): container finished" podID="1b22fa48-3a34-4d62-8a39-9437546109ac" containerID="66ce1552f20b59f0cb04fdf4f6ca8c290ba247c169cc8ea6240924cf785c8335" exitCode=0
Jul 27 18:22:02.310312 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:02.310282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb" event={"ID":"1b22fa48-3a34-4d62-8a39-9437546109ac","Type":"ContainerDied","Data":"66ce1552f20b59f0cb04fdf4f6ca8c290ba247c169cc8ea6240924cf785c8335"}
Jul 27 18:22:02.310748 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:02.310321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb" event={"ID":"1b22fa48-3a34-4d62-8a39-9437546109ac","Type":"ContainerStarted","Data":"bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3"}
Jul 27 18:22:03.458062 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:03.458038    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:03.525512 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:03.525478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca\") pod \"1b22fa48-3a34-4d62-8a39-9437546109ac\" (UID: \"1b22fa48-3a34-4d62-8a39-9437546109ac\") "
Jul 27 18:22:03.525836 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:03.525815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b22fa48-3a34-4d62-8a39-9437546109ac" (UID: "1b22fa48-3a34-4d62-8a39-9437546109ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:22:03.627154 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:03.627078    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b22fa48-3a34-4d62-8a39-9437546109ac-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:22:04.323295 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:04.323268    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"
Jul 27 18:22:04.323473 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:04.323316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb" event={"ID":"1b22fa48-3a34-4d62-8a39-9437546109ac","Type":"ContainerDied","Data":"bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3"}
Jul 27 18:22:04.323473 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:04.323367    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc3222e3d2532eeedd398762c3cda2446b1fefb2466d22f400912e1f9b00f7e3"
Jul 27 18:22:16.359931 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.359894    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:22:16.362457 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.360102    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" podUID="47714c13-4e3c-4fa1-b8b5-290c92edb814" containerName="maas-api" containerID="cri-o://0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4" gracePeriod=30
Jul 27 18:22:16.390162 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.390137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:16.456060 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.456028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:16.619265 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.619203    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:22:16.746531 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.746498    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-554dq\" (UniqueName: \"kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq\") pod \"47714c13-4e3c-4fa1-b8b5-290c92edb814\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") "
Jul 27 18:22:16.746696 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.746579    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") pod \"47714c13-4e3c-4fa1-b8b5-290c92edb814\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") "
Jul 27 18:22:16.746696 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.746657    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca\") pod \"47714c13-4e3c-4fa1-b8b5-290c92edb814\" (UID: \"47714c13-4e3c-4fa1-b8b5-290c92edb814\") "
Jul 27 18:22:16.747022 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.746991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "47714c13-4e3c-4fa1-b8b5-290c92edb814" (UID: "47714c13-4e3c-4fa1-b8b5-290c92edb814"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:22:16.748690 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.748664    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq" (OuterVolumeSpecName: "kube-api-access-554dq") pod "47714c13-4e3c-4fa1-b8b5-290c92edb814" (UID: "47714c13-4e3c-4fa1-b8b5-290c92edb814"). InnerVolumeSpecName "kube-api-access-554dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:16.748778 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.748696    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "47714c13-4e3c-4fa1-b8b5-290c92edb814" (UID: "47714c13-4e3c-4fa1-b8b5-290c92edb814"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:22:16.847951 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.847921    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47714c13-4e3c-4fa1-b8b5-290c92edb814-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:22:16.847951 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.847946    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-554dq\" (UniqueName: \"kubernetes.io/projected/47714c13-4e3c-4fa1-b8b5-290c92edb814-kube-api-access-554dq\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:22:16.847951 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:16.847956    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47714c13-4e3c-4fa1-b8b5-290c92edb814-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:22:17.397817 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.397783    2564 generic.go:356] "Generic (PLEG): container finished" podID="47714c13-4e3c-4fa1-b8b5-290c92edb814" containerID="0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4" exitCode=0
Jul 27 18:22:17.398266 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.397834    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"
Jul 27 18:22:17.398266 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.397864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" event={"ID":"47714c13-4e3c-4fa1-b8b5-290c92edb814","Type":"ContainerDied","Data":"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"}
Jul 27 18:22:17.398266 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.397927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck" event={"ID":"47714c13-4e3c-4fa1-b8b5-290c92edb814","Type":"ContainerDied","Data":"3e9236ee46cc06867c716736c17ec753189e4b10f57f347b077780e536468fd5"}
Jul 27 18:22:17.398266 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.397948    2564 scope.go:117] "RemoveContainer" containerID="0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"
Jul 27 18:22:17.408168 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.408150    2564 scope.go:117] "RemoveContainer" containerID="0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"
Jul 27 18:22:17.408457 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:22:17.408430    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4\": container with ID starting with 0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4 not found: ID does not exist" containerID="0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"
Jul 27 18:22:17.408517 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.408470    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4"} err="failed to get container status \"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4\": rpc error: code = NotFound desc = could not find container \"0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4\": container with ID starting with 0af75eade761f9ef1367aa17d6a04a0a881ff922d82289aab56ce5751cfdd0a4 not found: ID does not exist"
Jul 27 18:22:17.420479 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.420447    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:22:17.424634 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:17.424613    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f4a7a7-dc86c7657-kbmck"]
Jul 27 18:22:18.669286 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:18.669257    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47714c13-4e3c-4fa1-b8b5-290c92edb814" path="/var/lib/kubelet/pods/47714c13-4e3c-4fa1-b8b5-290c92edb814/volumes"
Jul 27 18:22:20.935392 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:20.935358    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"]
Jul 27 18:22:20.937943 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:20.937915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:20.939126 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:20.939105    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f4a7a7-5sfgb"]
Jul 27 18:22:21.305169 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:21.305124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:22.668113 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:22.668084    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b22fa48-3a34-4d62-8a39-9437546109ac" path="/var/lib/kubelet/pods/1b22fa48-3a34-4d62-8a39-9437546109ac/volumes"
Jul 27 18:22:26.383364 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:26.383324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:22:49.726254 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:22:49.726220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:02.625320 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:02.625282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:03.688732 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:03.688700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:09.132441 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:09.132405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:23.372625 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.372579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:23.473082 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.473037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:23.617391 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.617359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:23.852652 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.852616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:23.966804 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.966771    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"]
Jul 27 18:23:23.967293 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967273    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47714c13-4e3c-4fa1-b8b5-290c92edb814" containerName="maas-api"
Jul 27 18:23:23.967293 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967295    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="47714c13-4e3c-4fa1-b8b5-290c92edb814" containerName="maas-api"
Jul 27 18:23:23.967479 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967322    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b22fa48-3a34-4d62-8a39-9437546109ac" containerName="revoke-keys"
Jul 27 18:23:23.967479 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967331    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b22fa48-3a34-4d62-8a39-9437546109ac" containerName="revoke-keys"
Jul 27 18:23:23.967479 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967443    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="47714c13-4e3c-4fa1-b8b5-290c92edb814" containerName="maas-api"
Jul 27 18:23:23.967479 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.967462    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b22fa48-3a34-4d62-8a39-9437546109ac" containerName="revoke-keys"
Jul 27 18:23:23.970761 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.970742    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:23.974256 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.974234    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:23:23.977769 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:23.977745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"]
Jul 27 18:23:24.164231 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.164125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l\" (UID: \"06d89095-505a-4e0b-9b1b-8e76514c50c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:24.265516 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.265482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l\" (UID: \"06d89095-505a-4e0b-9b1b-8e76514c50c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:24.266343 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.266318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l\" (UID: \"06d89095-505a-4e0b-9b1b-8e76514c50c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:24.284391 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.284367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:24.420392 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.420361    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"]
Jul 27 18:23:24.422016 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:23:24.421985    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d89095_505a_4e0b_9b1b_8e76514c50c4.slice/crio-19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2 WatchSource:0}: Error finding container 19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2: Status 404 returned error can't find the container with id 19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2
Jul 27 18:23:24.772709 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:24.772676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l" event={"ID":"06d89095-505a-4e0b-9b1b-8e76514c50c4","Type":"ContainerStarted","Data":"19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2"}
Jul 27 18:23:25.780243 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:25.780211    2564 generic.go:356] "Generic (PLEG): container finished" podID="06d89095-505a-4e0b-9b1b-8e76514c50c4" containerID="ba9822f326f81c39cfc8d1ec49488030e583f0806d57aaefee63b1a5e6959454" exitCode=0
Jul 27 18:23:25.780629 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:25.780306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l" event={"ID":"06d89095-505a-4e0b-9b1b-8e76514c50c4","Type":"ContainerDied","Data":"ba9822f326f81c39cfc8d1ec49488030e583f0806d57aaefee63b1a5e6959454"}
Jul 27 18:23:26.917718 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:26.917694    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:26.987402 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:26.987375    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca\") pod \"06d89095-505a-4e0b-9b1b-8e76514c50c4\" (UID: \"06d89095-505a-4e0b-9b1b-8e76514c50c4\") "
Jul 27 18:23:26.987713 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:26.987690    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06d89095-505a-4e0b-9b1b-8e76514c50c4" (UID: "06d89095-505a-4e0b-9b1b-8e76514c50c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:27.088583 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:27.088519    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d89095-505a-4e0b-9b1b-8e76514c50c4-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:27.792342 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:27.792315    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"
Jul 27 18:23:27.792542 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:27.792302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l" event={"ID":"06d89095-505a-4e0b-9b1b-8e76514c50c4","Type":"ContainerDied","Data":"19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2"}
Jul 27 18:23:27.792542 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:27.792449    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19fff340a9e408c9ae86632942c9db4de7755fe367f2a123ebd082fb5739fbe2"
Jul 27 18:23:34.401643 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.401609    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:23:34.402100 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.401878    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" podUID="734578ac-58d8-4724-9263-2886ad6b66a7" containerName="maas-api" containerID="cri-o://4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b" gracePeriod=30
Jul 27 18:23:34.439892 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.439865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:34.461791 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.461759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:23:34.462101 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.462052    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" podUID="fa392488-e95c-4b1b-8eaa-37eac7605d34" containerName="payload-pre-processing" containerID="cri-o://50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f" gracePeriod=30
Jul 27 18:23:34.537433 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.537406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:34.716906 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.716881    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:23:34.751673 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.751643    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:23:34.757462 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.757439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgvzp\" (UniqueName: \"kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp\") pod \"734578ac-58d8-4724-9263-2886ad6b66a7\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") "
Jul 27 18:23:34.757594 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.757534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") pod \"734578ac-58d8-4724-9263-2886ad6b66a7\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") "
Jul 27 18:23:34.757594 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.757583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca\") pod \"734578ac-58d8-4724-9263-2886ad6b66a7\" (UID: \"734578ac-58d8-4724-9263-2886ad6b66a7\") "
Jul 27 18:23:34.758053 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.757995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "734578ac-58d8-4724-9263-2886ad6b66a7" (UID: "734578ac-58d8-4724-9263-2886ad6b66a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:34.759680 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.759651    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "734578ac-58d8-4724-9263-2886ad6b66a7" (UID: "734578ac-58d8-4724-9263-2886ad6b66a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:23:34.759763 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.759707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp" (OuterVolumeSpecName: "kube-api-access-hgvzp") pod "734578ac-58d8-4724-9263-2886ad6b66a7" (UID: "734578ac-58d8-4724-9263-2886ad6b66a7"). InnerVolumeSpecName "kube-api-access-hgvzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:34.830331 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.830299    2564 generic.go:356] "Generic (PLEG): container finished" podID="fa392488-e95c-4b1b-8eaa-37eac7605d34" containerID="50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f" exitCode=0
Jul 27 18:23:34.830499 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.830347    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"
Jul 27 18:23:34.830499 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.830372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" event={"ID":"fa392488-e95c-4b1b-8eaa-37eac7605d34","Type":"ContainerDied","Data":"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"}
Jul 27 18:23:34.830499 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.830418    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9" event={"ID":"fa392488-e95c-4b1b-8eaa-37eac7605d34","Type":"ContainerDied","Data":"9648db9184a7077faeb6daef06f604b72c999c2cff0ef245b5b90d0551aa877e"}
Jul 27 18:23:34.830499 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.830445    2564 scope.go:117] "RemoveContainer" containerID="50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"
Jul 27 18:23:34.831749 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.831725    2564 generic.go:356] "Generic (PLEG): container finished" podID="734578ac-58d8-4724-9263-2886ad6b66a7" containerID="4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b" exitCode=0
Jul 27 18:23:34.831858 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.831788    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"
Jul 27 18:23:34.831858 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.831797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" event={"ID":"734578ac-58d8-4724-9263-2886ad6b66a7","Type":"ContainerDied","Data":"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"}
Jul 27 18:23:34.831858 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.831838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d" event={"ID":"734578ac-58d8-4724-9263-2886ad6b66a7","Type":"ContainerDied","Data":"f2cf0c26791d287eae1bfb5dad2c01a4fd0b530ce0303d9584b567fe5f8db1b6"}
Jul 27 18:23:34.840360 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.840340    2564 scope.go:117] "RemoveContainer" containerID="50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"
Jul 27 18:23:34.840622 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:23:34.840600    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f\": container with ID starting with 50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f not found: ID does not exist" containerID="50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"
Jul 27 18:23:34.840695 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.840635    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f"} err="failed to get container status \"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f\": rpc error: code = NotFound desc = could not find container \"50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f\": container with ID starting with 50289cf19136e6e007afcc56f51b24e34437f270fba4d5ecbf139b0c5ac4151f not found: ID does not exist"
Jul 27 18:23:34.840695 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.840659    2564 scope.go:117] "RemoveContainer" containerID="4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"
Jul 27 18:23:34.848647 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.848624    2564 scope.go:117] "RemoveContainer" containerID="4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"
Jul 27 18:23:34.848898 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:23:34.848878    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b\": container with ID starting with 4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b not found: ID does not exist" containerID="4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"
Jul 27 18:23:34.848943 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.848904    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b"} err="failed to get container status \"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b\": rpc error: code = NotFound desc = could not find container \"4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b\": container with ID starting with 4993fbe0fcbfd6a62b9bdcb47d680daa57d4161366725fa2845ae487b9f1151b not found: ID does not exist"
Jul 27 18:23:34.856893 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.856870    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:23:34.858778 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.858759    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume\") pod \"fa392488-e95c-4b1b-8eaa-37eac7605d34\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") "
Jul 27 18:23:34.858873 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.858826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gccgv\" (UniqueName: \"kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv\") pod \"fa392488-e95c-4b1b-8eaa-37eac7605d34\" (UID: \"fa392488-e95c-4b1b-8eaa-37eac7605d34\") "
Jul 27 18:23:34.859021 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.859010    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/734578ac-58d8-4724-9263-2886ad6b66a7-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:34.859067 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.859023    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgvzp\" (UniqueName: \"kubernetes.io/projected/734578ac-58d8-4724-9263-2886ad6b66a7-kube-api-access-hgvzp\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:34.859067 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.859032    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/734578ac-58d8-4724-9263-2886ad6b66a7-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:34.859136 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.859074    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa392488-e95c-4b1b-8eaa-37eac7605d34" (UID: "fa392488-e95c-4b1b-8eaa-37eac7605d34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:34.860207 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.860173    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5cb9b7-56599d7748-8s77d"]
Jul 27 18:23:34.860701 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.860683    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv" (OuterVolumeSpecName: "kube-api-access-gccgv") pod "fa392488-e95c-4b1b-8eaa-37eac7605d34" (UID: "fa392488-e95c-4b1b-8eaa-37eac7605d34"). InnerVolumeSpecName "kube-api-access-gccgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:34.959859 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.959829    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gccgv\" (UniqueName: \"kubernetes.io/projected/fa392488-e95c-4b1b-8eaa-37eac7605d34-kube-api-access-gccgv\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:34.959859 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:34.959856    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa392488-e95c-4b1b-8eaa-37eac7605d34-plugins-config-volume\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:35.154750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:35.154718    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:23:35.156905 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:35.156884    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5cb9b7-6c8d9c5f5b-gd9w9"]
Jul 27 18:23:36.669812 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:36.669780    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734578ac-58d8-4724-9263-2886ad6b66a7" path="/var/lib/kubelet/pods/734578ac-58d8-4724-9263-2886ad6b66a7/volumes"
Jul 27 18:23:36.670208 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:36.670155    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa392488-e95c-4b1b-8eaa-37eac7605d34" path="/var/lib/kubelet/pods/fa392488-e95c-4b1b-8eaa-37eac7605d34/volumes"
Jul 27 18:23:39.034315 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:39.034279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:39.040965 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:39.040923    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"]
Jul 27 18:23:39.046732 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:39.046710    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5cb9b7-8pw9l"]
Jul 27 18:23:39.424361 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:39.424281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:40.668168 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:40.668134    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d89095-505a-4e0b-9b1b-8e76514c50c4" path="/var/lib/kubelet/pods/06d89095-505a-4e0b-9b1b-8e76514c50c4/volumes"
Jul 27 18:23:45.067625 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.067589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:45.132745 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.132708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:45.333882 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.333798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:45.574431 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.574398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:45.712744 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.712707    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"]
Jul 27 18:23:45.713111 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713099    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa392488-e95c-4b1b-8eaa-37eac7605d34" containerName="payload-pre-processing"
Jul 27 18:23:45.713163 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713113    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa392488-e95c-4b1b-8eaa-37eac7605d34" containerName="payload-pre-processing"
Jul 27 18:23:45.713163 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713143    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d89095-505a-4e0b-9b1b-8e76514c50c4" containerName="revoke-keys"
Jul 27 18:23:45.713163 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713151    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d89095-505a-4e0b-9b1b-8e76514c50c4" containerName="revoke-keys"
Jul 27 18:23:45.713302 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713167    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734578ac-58d8-4724-9263-2886ad6b66a7" containerName="maas-api"
Jul 27 18:23:45.713302 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713176    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="734578ac-58d8-4724-9263-2886ad6b66a7" containerName="maas-api"
Jul 27 18:23:45.713302 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713280    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa392488-e95c-4b1b-8eaa-37eac7605d34" containerName="payload-pre-processing"
Jul 27 18:23:45.713302 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d89095-505a-4e0b-9b1b-8e76514c50c4" containerName="revoke-keys"
Jul 27 18:23:45.713302 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.713297    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="734578ac-58d8-4724-9263-2886ad6b66a7" containerName="maas-api"
Jul 27 18:23:45.718076 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.718058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:45.721580 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.721335    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:23:45.724425 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.724398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"]
Jul 27 18:23:45.757280 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.757251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf\" (UID: \"ce516d0c-2832-47e8-8e5f-6eee04bee889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:45.858375 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.858344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf\" (UID: \"ce516d0c-2832-47e8-8e5f-6eee04bee889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:45.858951 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:45.858930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf\" (UID: \"ce516d0c-2832-47e8-8e5f-6eee04bee889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:46.030764 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:46.030678    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:46.162971 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:46.162947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"]
Jul 27 18:23:46.165393 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:23:46.165368    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce516d0c_2832_47e8_8e5f_6eee04bee889.slice/crio-632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78 WatchSource:0}: Error finding container 632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78: Status 404 returned error can't find the container with id 632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78
Jul 27 18:23:46.903912 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:46.903874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf" event={"ID":"ce516d0c-2832-47e8-8e5f-6eee04bee889","Type":"ContainerStarted","Data":"e56977c21546aecfe84abac406acf6da858c28cbd1f203c6a769e50adc1a026d"}
Jul 27 18:23:46.904106 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:46.903941    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf" event={"ID":"ce516d0c-2832-47e8-8e5f-6eee04bee889","Type":"ContainerStarted","Data":"632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78"}
Jul 27 18:23:46.921364 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:46.921313    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf" podStartSLOduration=1.92129653 podStartE2EDuration="1.92129653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:23:46.919379882 +0000 UTC m=+3522.796581086" watchObservedRunningTime="2026-07-27 18:23:46.92129653 +0000 UTC m=+3522.798497732"
Jul 27 18:23:47.911007 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:47.910973    2564 generic.go:356] "Generic (PLEG): container finished" podID="ce516d0c-2832-47e8-8e5f-6eee04bee889" containerID="e56977c21546aecfe84abac406acf6da858c28cbd1f203c6a769e50adc1a026d" exitCode=0
Jul 27 18:23:47.911447 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:47.911056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf" event={"ID":"ce516d0c-2832-47e8-8e5f-6eee04bee889","Type":"ContainerDied","Data":"e56977c21546aecfe84abac406acf6da858c28cbd1f203c6a769e50adc1a026d"}
Jul 27 18:23:49.072072 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.072045    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:49.190449 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.190428    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca\") pod \"ce516d0c-2832-47e8-8e5f-6eee04bee889\" (UID: \"ce516d0c-2832-47e8-8e5f-6eee04bee889\") "
Jul 27 18:23:49.190744 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.190724    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce516d0c-2832-47e8-8e5f-6eee04bee889" (UID: "ce516d0c-2832-47e8-8e5f-6eee04bee889"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:49.292041 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.292008    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce516d0c-2832-47e8-8e5f-6eee04bee889-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:49.923948 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.923915    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"
Jul 27 18:23:49.924122 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.923973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf" event={"ID":"ce516d0c-2832-47e8-8e5f-6eee04bee889","Type":"ContainerDied","Data":"632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78"}
Jul 27 18:23:49.924122 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:49.924019    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="632646c1e1d7f00a72be06fbc317e0d7b9524ffbf73e6933f744824f60a76e78"
Jul 27 18:23:56.070353 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.070316    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:23:56.071029 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.070553    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" podUID="affff087-af83-4e04-ac63-64bbf9cc08b7" containerName="maas-api" containerID="cri-o://a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40" gracePeriod=30
Jul 27 18:23:56.102889 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.102858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:56.202991 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.202965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:23:56.320553 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.320499    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:23:56.455628 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.455596    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls\") pod \"affff087-af83-4e04-ac63-64bbf9cc08b7\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") "
Jul 27 18:23:56.455816 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.455669    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca\") pod \"affff087-af83-4e04-ac63-64bbf9cc08b7\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") "
Jul 27 18:23:56.455816 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.455718    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klssq\" (UniqueName: \"kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq\") pod \"affff087-af83-4e04-ac63-64bbf9cc08b7\" (UID: \"affff087-af83-4e04-ac63-64bbf9cc08b7\") "
Jul 27 18:23:56.456119 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.456093    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "affff087-af83-4e04-ac63-64bbf9cc08b7" (UID: "affff087-af83-4e04-ac63-64bbf9cc08b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:56.457648 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.457616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "affff087-af83-4e04-ac63-64bbf9cc08b7" (UID: "affff087-af83-4e04-ac63-64bbf9cc08b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:23:56.457780 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.457759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq" (OuterVolumeSpecName: "kube-api-access-klssq") pod "affff087-af83-4e04-ac63-64bbf9cc08b7" (UID: "affff087-af83-4e04-ac63-64bbf9cc08b7"). InnerVolumeSpecName "kube-api-access-klssq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:56.556593 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.556565    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klssq\" (UniqueName: \"kubernetes.io/projected/affff087-af83-4e04-ac63-64bbf9cc08b7-kube-api-access-klssq\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.556593 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.556591    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affff087-af83-4e04-ac63-64bbf9cc08b7-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.556776 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.556601    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affff087-af83-4e04-ac63-64bbf9cc08b7-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.964376 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.964345    2564 generic.go:356] "Generic (PLEG): container finished" podID="affff087-af83-4e04-ac63-64bbf9cc08b7" containerID="a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40" exitCode=0
Jul 27 18:23:56.964538 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.964397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" event={"ID":"affff087-af83-4e04-ac63-64bbf9cc08b7","Type":"ContainerDied","Data":"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"}
Jul 27 18:23:56.964538 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.964404    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"
Jul 27 18:23:56.964538 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.964438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr" event={"ID":"affff087-af83-4e04-ac63-64bbf9cc08b7","Type":"ContainerDied","Data":"5f3280de933d3e9d09bbb002b763e7ab08ef888b111e91a5c6c5492dac65c41a"}
Jul 27 18:23:56.964538 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.964459    2564 scope.go:117] "RemoveContainer" containerID="a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"
Jul 27 18:23:56.973770 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.973749    2564 scope.go:117] "RemoveContainer" containerID="a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"
Jul 27 18:23:56.974031 ip-10-0-143-96 kubenswrapper[2564]: E0727 18:23:56.974009    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40\": container with ID starting with a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40 not found: ID does not exist" containerID="a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"
Jul 27 18:23:56.974078 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.974040    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40"} err="failed to get container status \"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40\": rpc error: code = NotFound desc = could not find container \"a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40\": container with ID starting with a8fe33e5b3038017c8f8d17cbad1dd3ebabf7a1bc678679975d4407676c34a40 not found: ID does not exist"
Jul 27 18:23:56.983107 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.983085    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:23:56.990572 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:56.990537    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-addd0c-5b6b4545-gvbsr"]
Jul 27 18:23:58.669670 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:23:58.669635    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="affff087-af83-4e04-ac63-64bbf9cc08b7" path="/var/lib/kubelet/pods/affff087-af83-4e04-ac63-64bbf9cc08b7/volumes"
Jul 27 18:24:00.780379 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:00.780341    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"]
Jul 27 18:24:00.782545 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:00.782522    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-addd0c-p62cf"]
Jul 27 18:24:00.784823 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:00.784764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:01.163404 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:01.163321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:02.670576 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:02.670545    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce516d0c-2832-47e8-8e5f-6eee04bee889" path="/var/lib/kubelet/pods/ce516d0c-2832-47e8-8e5f-6eee04bee889/volumes"
Jul 27 18:24:06.989360 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:06.989296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:07.091170 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.091137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:07.265139 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.265050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:07.507354 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.507312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:07.622994 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.622922    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"]
Jul 27 18:24:07.623321 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623308    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affff087-af83-4e04-ac63-64bbf9cc08b7" containerName="maas-api"
Jul 27 18:24:07.623370 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623323    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="affff087-af83-4e04-ac63-64bbf9cc08b7" containerName="maas-api"
Jul 27 18:24:07.623370 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623332    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce516d0c-2832-47e8-8e5f-6eee04bee889" containerName="revoke-keys"
Jul 27 18:24:07.623370 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623339    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce516d0c-2832-47e8-8e5f-6eee04bee889" containerName="revoke-keys"
Jul 27 18:24:07.623468 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623403    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="affff087-af83-4e04-ac63-64bbf9cc08b7" containerName="maas-api"
Jul 27 18:24:07.623468 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.623414    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce516d0c-2832-47e8-8e5f-6eee04bee889" containerName="revoke-keys"
Jul 27 18:24:07.627977 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.627959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:07.630827 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.630792    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmtk4\""
Jul 27 18:24:07.633146 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.633123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"]
Jul 27 18:24:07.755875 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.755843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj\" (UID: \"18494867-e6a5-471d-b952-90deadea40cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:07.856780 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.856748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj\" (UID: \"18494867-e6a5-471d-b952-90deadea40cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:07.857419 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.857400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj\" (UID: \"18494867-e6a5-471d-b952-90deadea40cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:07.939671 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:07.939649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:08.073569 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:08.073535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"]
Jul 27 18:24:08.074462 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:24:08.074420    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18494867_e6a5_471d_b952_90deadea40cb.slice/crio-ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025 WatchSource:0}: Error finding container ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025: Status 404 returned error can't find the container with id ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025
Jul 27 18:24:09.037844 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:09.037763    2564 generic.go:356] "Generic (PLEG): container finished" podID="18494867-e6a5-471d-b952-90deadea40cb" containerID="622c7e650d8a6ba80ce83f48995924b66b1382014edc615ceebc99eeb6354739" exitCode=0
Jul 27 18:24:09.037844 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:09.037823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj" event={"ID":"18494867-e6a5-471d-b952-90deadea40cb","Type":"ContainerDied","Data":"622c7e650d8a6ba80ce83f48995924b66b1382014edc615ceebc99eeb6354739"}
Jul 27 18:24:09.038024 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:09.037869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj" event={"ID":"18494867-e6a5-471d-b952-90deadea40cb","Type":"ContainerStarted","Data":"ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025"}
Jul 27 18:24:10.177641 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:10.177609    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:10.277390 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:10.277364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca\") pod \"18494867-e6a5-471d-b952-90deadea40cb\" (UID: \"18494867-e6a5-471d-b952-90deadea40cb\") "
Jul 27 18:24:10.277717 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:10.277694    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18494867-e6a5-471d-b952-90deadea40cb" (UID: "18494867-e6a5-471d-b952-90deadea40cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:10.378636 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:10.378569    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18494867-e6a5-471d-b952-90deadea40cb-maas-api-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:24:11.049944 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:11.049913    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"
Jul 27 18:24:11.049944 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:11.049931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj" event={"ID":"18494867-e6a5-471d-b952-90deadea40cb","Type":"ContainerDied","Data":"ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025"}
Jul 27 18:24:11.050160 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:11.049982    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba30920e7b66d2f3305d9d28d09cfd83834cfccd30fddd131650b072dbfa9025"
Jul 27 18:24:17.971119 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:17.971084    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:24:17.971616 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:17.971363    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" podUID="05073575-8fe1-43ff-86bd-f0e9922ffd69" containerName="maas-api" containerID="cri-o://86e43383f0a1c543123e771fab28cf0c908370001afd467e13ef9c6bccb408f2" gracePeriod=30
Jul 27 18:24:17.996355 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:17.996328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:18.069839 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.069806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:18.089898 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.089873    2564 generic.go:356] "Generic (PLEG): container finished" podID="05073575-8fe1-43ff-86bd-f0e9922ffd69" containerID="86e43383f0a1c543123e771fab28cf0c908370001afd467e13ef9c6bccb408f2" exitCode=0
Jul 27 18:24:18.090022 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.089907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" event={"ID":"05073575-8fe1-43ff-86bd-f0e9922ffd69","Type":"ContainerDied","Data":"86e43383f0a1c543123e771fab28cf0c908370001afd467e13ef9c6bccb408f2"}
Jul 27 18:24:18.128802 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.128771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:18.225836 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.225771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:24:18.249785 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.249753    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") pod \"05073575-8fe1-43ff-86bd-f0e9922ffd69\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") "
Jul 27 18:24:18.249944 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.249832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x89v\" (UniqueName: \"kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v\") pod \"05073575-8fe1-43ff-86bd-f0e9922ffd69\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") "
Jul 27 18:24:18.249944 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.249879    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca\") pod \"05073575-8fe1-43ff-86bd-f0e9922ffd69\" (UID: \"05073575-8fe1-43ff-86bd-f0e9922ffd69\") "
Jul 27 18:24:18.250318 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.250287    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05073575-8fe1-43ff-86bd-f0e9922ffd69" (UID: "05073575-8fe1-43ff-86bd-f0e9922ffd69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:18.252004 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.251971    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v" (OuterVolumeSpecName: "kube-api-access-6x89v") pod "05073575-8fe1-43ff-86bd-f0e9922ffd69" (UID: "05073575-8fe1-43ff-86bd-f0e9922ffd69"). InnerVolumeSpecName "kube-api-access-6x89v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:18.252004 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.251975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05073575-8fe1-43ff-86bd-f0e9922ffd69" (UID: "05073575-8fe1-43ff-86bd-f0e9922ffd69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:24:18.350730 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.350699    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x89v\" (UniqueName: \"kubernetes.io/projected/05073575-8fe1-43ff-86bd-f0e9922ffd69-kube-api-access-6x89v\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.350730 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.350731    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05073575-8fe1-43ff-86bd-f0e9922ffd69-openshift-service-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.350901 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:18.350745    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05073575-8fe1-43ff-86bd-f0e9922ffd69-maas-api-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\""
Jul 27 18:24:19.097156 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:19.097125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r" event={"ID":"05073575-8fe1-43ff-86bd-f0e9922ffd69","Type":"ContainerDied","Data":"f54665e7ede81d9ebd80ae2c732fb6adb87e61e1356a1f6d9671bcaad9e4645f"}
Jul 27 18:24:19.097156 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:19.097155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"
Jul 27 18:24:19.097775 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:19.097203    2564 scope.go:117] "RemoveContainer" containerID="86e43383f0a1c543123e771fab28cf0c908370001afd467e13ef9c6bccb408f2"
Jul 27 18:24:19.114987 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:19.114955    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:24:19.119297 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:19.119273    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1706dd-b87c5689d-4677r"]
Jul 27 18:24:20.669890 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:20.669857    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05073575-8fe1-43ff-86bd-f0e9922ffd69" path="/var/lib/kubelet/pods/05073575-8fe1-43ff-86bd-f0e9922ffd69/volumes"
Jul 27 18:24:22.684288 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:22.684260    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"]
Jul 27 18:24:22.686528 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:22.686504    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1706dd-hppmj"]
Jul 27 18:24:22.686795 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:22.686776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:23.062344 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:23.062310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:24.669968 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:24.669934    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18494867-e6a5-471d-b952-90deadea40cb" path="/var/lib/kubelet/pods/18494867-e6a5-471d-b952-90deadea40cb/volumes"
Jul 27 18:24:29.103240 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:29.103207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:29.204060 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:29.204026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:29.380758 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:29.380670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:29.594287 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:29.594242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:36.073615 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:36.073586    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-8jf2k_9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe/copy-manifests/0.log"
Jul 27 18:24:36.085868 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:36.085842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-8jf2k_9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe/manager/0.log"
Jul 27 18:24:37.431036 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.431004    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/extract/0.log"
Jul 27 18:24:37.437275 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.437253    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/util/0.log"
Jul 27 18:24:37.443124 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.443111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/pull/0.log"
Jul 27 18:24:37.554217 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.554194    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/pull/0.log"
Jul 27 18:24:37.560514 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.560495    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/extract/0.log"
Jul 27 18:24:37.566287 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.566272    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/util/0.log"
Jul 27 18:24:37.675684 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.675661    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/util/0.log"
Jul 27 18:24:37.682113 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.682050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/pull/0.log"
Jul 27 18:24:37.688310 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.688289    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/extract/0.log"
Jul 27 18:24:37.797797 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.797774    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/util/0.log"
Jul 27 18:24:37.804082 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.804064    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/pull/0.log"
Jul 27 18:24:37.809888 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:37.809867    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/extract/0.log"
Jul 27 18:24:38.516462 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:38.516431    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zjjlc_20a57360-5dfa-4258-b7aa-5c7dfd339b79/manager/0.log"
Jul 27 18:24:39.212825 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:39.212779    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-whvn6_d78d7b21-4aa3-4b2b-877e-18838eb4db29/discovery/0.log"
Jul 27 18:24:39.922474 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:39.922404    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f7bb7d55-jnrhm_0ce634e7-417d-4faa-a18a-a438c885cdee/router/0.log"
Jul 27 18:24:40.838649 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:40.838623    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-75l82_08d3615c-9a7f-4b9b-9b7a-445cec261602/main/0.log"
Jul 27 18:24:41.188271 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:41.188232    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xs88s_bcdf73cc-3d09-4ca2-9b69-f11fd7b674c6/main/0.log"
Jul 27 18:24:46.463602 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:46.463569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:46.530465 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:46.530418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log" limit=1024
Jul 27 18:24:49.300300 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:49.300270    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5rbbv_6d346835-866e-4fc5-969b-fb7c5d537ca2/global-pull-secret-syncer/0.log"
Jul 27 18:24:49.430574 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:49.430544    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-29b9z_87c92ea7-6d7a-455f-8672-6bd7eb96fb09/konnectivity-agent/0.log"
Jul 27 18:24:49.597121 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:49.597050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-96.ec2.internal_7f14f156ce10e05bbdf20bfb209f82c0/haproxy/0.log"
Jul 27 18:24:53.960434 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:53.960400    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/extract/0.log"
Jul 27 18:24:53.981607 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:53.981575    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/util/0.log"
Jul 27 18:24:54.005979 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.005957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922tmp_90849639-0d7e-4dea-a99f-c421d1c12726/pull/0.log"
Jul 27 18:24:54.043383 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.043355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/extract/0.log"
Jul 27 18:24:54.074803 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.074778    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/util/0.log"
Jul 27 18:24:54.097363 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.097341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l664x_3be1c994-c76d-49b2-9d18-5a3c845de86a/pull/0.log"
Jul 27 18:24:54.129097 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.129035    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/extract/0.log"
Jul 27 18:24:54.166073 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.166050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/util/0.log"
Jul 27 18:24:54.191410 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.191388    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735dfnd_e5017a89-ba1b-4769-b1d8-fa87480eac60/pull/0.log"
Jul 27 18:24:54.218818 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.218796    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/extract/0.log"
Jul 27 18:24:54.247655 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.247635    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/util/0.log"
Jul 27 18:24:54.274357 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:54.274333    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxvfs_1d0fb4c7-c38c-4a47-9bf1-8fd70fbdbab4/pull/0.log"
Jul 27 18:24:55.266817 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:55.266779    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zjjlc_20a57360-5dfa-4258-b7aa-5c7dfd339b79/manager/0.log"
Jul 27 18:24:57.287478 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.287439    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75d44bd6f4-wcb58_fdd0eaed-1f17-4c98-a182-40a597e84c6f/metrics-server/0.log"
Jul 27 18:24:57.318948 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.318918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-g67jp_7e0e5989-882e-44c2-8b4b-d87b9f8fd2ed/monitoring-plugin/0.log"
Jul 27 18:24:57.423931 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.423906    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95ccz_97cc0934-7822-4d26-b7ca-e31c2b46d7b1/node-exporter/0.log"
Jul 27 18:24:57.447646 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.447629    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95ccz_97cc0934-7822-4d26-b7ca-e31c2b46d7b1/kube-rbac-proxy/0.log"
Jul 27 18:24:57.469822 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.469804    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95ccz_97cc0934-7822-4d26-b7ca-e31c2b46d7b1/init-textfile/0.log"
Jul 27 18:24:57.589516 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.589428    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4md5p_68d7ce48-694c-4081-b524-73d260ce3754/kube-rbac-proxy-main/0.log"
Jul 27 18:24:57.611964 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.611940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4md5p_68d7ce48-694c-4081-b524-73d260ce3754/kube-rbac-proxy-self/0.log"
Jul 27 18:24:57.631966 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.631947    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4md5p_68d7ce48-694c-4081-b524-73d260ce3754/openshift-state-metrics/0.log"
Jul 27 18:24:57.880022 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.879948    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-r4rq7_cd29043e-6628-4eeb-930c-1daf0ece3674/prometheus-operator-admission-webhook/0.log"
Jul 27 18:24:57.909383 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.909364    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c57cd594-fskpz_3f5b6620-243f-443d-87bb-65e7b43dc9e2/telemeter-client/0.log"
Jul 27 18:24:57.929851 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.929829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c57cd594-fskpz_3f5b6620-243f-443d-87bb-65e7b43dc9e2/reload/0.log"
Jul 27 18:24:57.949540 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.949518    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c57cd594-fskpz_3f5b6620-243f-443d-87bb-65e7b43dc9e2/kube-rbac-proxy/0.log"
Jul 27 18:24:57.976900 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.976883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/thanos-query/0.log"
Jul 27 18:24:57.995837 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:57.995818    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/kube-rbac-proxy-web/0.log"
Jul 27 18:24:58.015655 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:58.015638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/kube-rbac-proxy/0.log"
Jul 27 18:24:58.035745 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:58.035722    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/prom-label-proxy/0.log"
Jul 27 18:24:58.057158 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:58.057139    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/kube-rbac-proxy-rules/0.log"
Jul 27 18:24:58.080236 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:58.080217    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b84688bb-v5x9t_2566563d-8a96-4c4c-a8b6-5a8467c0773a/kube-rbac-proxy-metrics/0.log"
Jul 27 18:24:59.896534 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.896496    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"]
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.896940    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18494867-e6a5-471d-b952-90deadea40cb" containerName="revoke-keys"
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.896955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18494867-e6a5-471d-b952-90deadea40cb" containerName="revoke-keys"
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.896966    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05073575-8fe1-43ff-86bd-f0e9922ffd69" containerName="maas-api"
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.896971    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="05073575-8fe1-43ff-86bd-f0e9922ffd69" containerName="maas-api"
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.897023    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="05073575-8fe1-43ff-86bd-f0e9922ffd69" containerName="maas-api"
Jul 27 18:24:59.897054 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.897034    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="18494867-e6a5-471d-b952-90deadea40cb" containerName="revoke-keys"
Jul 27 18:24:59.900158 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.900142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:24:59.903111 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.903090    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hshdv\"/\"default-dockercfg-llb9b\""
Jul 27 18:24:59.903283 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.903237    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"openshift-service-ca.crt\""
Jul 27 18:24:59.904487 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.904470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"kube-root-ca.crt\""
Jul 27 18:24:59.909029 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:24:59.909005    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"]
Jul 27 18:25:00.017421 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.017386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-lib-modules\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.017421 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.017424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-proc\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.017642 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.017488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkvv\" (UniqueName: \"kubernetes.io/projected/2b18c2f5-704c-4a9f-84af-c908835e054a-kube-api-access-phkvv\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.017642 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.017549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-podres\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.017642 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.017576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-sys\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118366 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-podres\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-sys\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-lib-modules\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-proc\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkvv\" (UniqueName: \"kubernetes.io/projected/2b18c2f5-704c-4a9f-84af-c908835e054a-kube-api-access-phkvv\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118527 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-podres\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-sys\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-proc\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.118750 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.118602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b18c2f5-704c-4a9f-84af-c908835e054a-lib-modules\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.127516 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.127496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkvv\" (UniqueName: \"kubernetes.io/projected/2b18c2f5-704c-4a9f-84af-c908835e054a-kube-api-access-phkvv\") pod \"perf-node-gather-daemonset-w55l5\" (UID: \"2b18c2f5-704c-4a9f-84af-c908835e054a\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.211713 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.211694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:00.345752 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.345727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"]
Jul 27 18:25:00.346586 ip-10-0-143-96 kubenswrapper[2564]: W0727 18:25:00.346564    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b18c2f5_704c_4a9f_84af_c908835e054a.slice/crio-2cebf8927bf0440ed18f7f207f3477c457165ead11cc71bdb9b87672bc569228 WatchSource:0}: Error finding container 2cebf8927bf0440ed18f7f207f3477c457165ead11cc71bdb9b87672bc569228: Status 404 returned error can't find the container with id 2cebf8927bf0440ed18f7f207f3477c457165ead11cc71bdb9b87672bc569228
Jul 27 18:25:00.379826 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.379790    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ffd6f8845-r4wkh_94f98189-1400-4ab3-9ef4-a41df09ba68c/console/0.log"
Jul 27 18:25:00.415710 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.415682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2pcpb_a8615566-8810-49d9-b404-b1ff4f4783db/download-server/0.log"
Jul 27 18:25:00.965700 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:00.965675    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-dht4j_7404b837-7f91-4133-a540-6a7c2db506b6/volume-data-source-validator/0.log"
Jul 27 18:25:01.329667 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.329577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5" event={"ID":"2b18c2f5-704c-4a9f-84af-c908835e054a","Type":"ContainerStarted","Data":"765fd69b1bdc73f0ade52c675f659019e8a0918401ad9b16da8428f3adfbed3d"}
Jul 27 18:25:01.329667 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.329632    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5" event={"ID":"2b18c2f5-704c-4a9f-84af-c908835e054a","Type":"ContainerStarted","Data":"2cebf8927bf0440ed18f7f207f3477c457165ead11cc71bdb9b87672bc569228"}
Jul 27 18:25:01.329913 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.329707    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:01.354785 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.354737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5" podStartSLOduration=2.354719624 podStartE2EDuration="2.354719624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:25:01.352326887 +0000 UTC m=+3597.229528081" watchObservedRunningTime="2026-07-27 18:25:01.354719624 +0000 UTC m=+3597.231920871"
Jul 27 18:25:01.922459 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.922429    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5lwv_c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a/dns/0.log"
Jul 27 18:25:01.943369 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:01.943347    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5lwv_c8104ce3-9e47-46d5-ac9d-9fc5cfa6470a/kube-rbac-proxy/0.log"
Jul 27 18:25:02.074355 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:02.074327    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6vkg_1c95930a-e283-48c8-a484-bb99194ab7ee/dns-node-resolver/0.log"
Jul 27 18:25:02.627616 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:02.627543    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67c5d887dd-8v7lc_b2fa5ad5-3440-4524-b71d-a8a7e24d021c/registry/0.log"
Jul 27 18:25:02.679880 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:02.679855    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gvhk5_9ad12cf3-c6ee-470d-8bbb-d43be8259ee6/node-ca/0.log"
Jul 27 18:25:03.778569 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:03.778536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-whvn6_d78d7b21-4aa3-4b2b-877e-18838eb4db29/discovery/0.log"
Jul 27 18:25:04.020004 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:04.019974    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f7bb7d55-jnrhm_0ce634e7-417d-4faa-a18a-a438c885cdee/router/0.log"
Jul 27 18:25:04.858399 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:04.858371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmw22_335afd52-e9d8-4d26-8c0c-512dceb352d1/serve-healthcheck-canary/0.log"
Jul 27 18:25:05.286647 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:05.286607    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-tqhvw_fbea3ce3-e76a-4303-b5f8-45eefc4cde17/insights-operator/0.log"
Jul 27 18:25:05.288583 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:05.288558    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-tqhvw_fbea3ce3-e76a-4303-b5f8-45eefc4cde17/insights-operator/1.log"
Jul 27 18:25:05.308878 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:05.308854    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9wtms_79cd464c-763c-433f-9cd8-41d51bee8c4f/kube-rbac-proxy/0.log"
Jul 27 18:25:05.328169 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:05.328150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9wtms_79cd464c-763c-433f-9cd8-41d51bee8c4f/exporter/0.log"
Jul 27 18:25:05.347741 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:05.347719    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9wtms_79cd464c-763c-433f-9cd8-41d51bee8c4f/extractor/0.log"
Jul 27 18:25:07.346244 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:07.346217    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-w55l5"
Jul 27 18:25:08.527718 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:08.527686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-8jf2k_9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe/manager/0.log"
Jul 27 18:25:08.543153 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:08.543130    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-8jf2k_9701a6ca-3ed0-4ab4-8ddf-11e4b1d9e5fe/copy-manifests/0.log"
Jul 27 18:25:10.011352 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:10.011323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbdc85ff6-ckvkv_794f6572-3a54-4d49-b7c6-c4195ae8e242/manager/0.log"
Jul 27 18:25:10.011352 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:10.011327    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbdc85ff6-ckvkv_794f6572-3a54-4d49-b7c6-c4195ae8e242/manager/1.log"
Jul 27 18:25:10.112216 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:10.112130    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-whvn6_d78d7b21-4aa3-4b2b-877e-18838eb4db29/discovery/0.log"
Jul 27 18:25:10.318936 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:10.318909    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f7bb7d55-jnrhm_0ce634e7-417d-4faa-a18a-a438c885cdee/router/0.log"
Jul 27 18:25:11.787390 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:11.787361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-whvn6_d78d7b21-4aa3-4b2b-877e-18838eb4db29/discovery/0.log"
Jul 27 18:25:12.001003 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:12.000974    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f7bb7d55-jnrhm_0ce634e7-417d-4faa-a18a-a438c885cdee/router/0.log"
Jul 27 18:25:15.165783 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:15.165747    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n_1bba1d9b-a978-40d0-91dd-e62519a7cba3/kube-storage-version-migrator-operator/1.log"
Jul 27 18:25:15.166415 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:15.166396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-79k2n_1bba1d9b-a978-40d0-91dd-e62519a7cba3/kube-storage-version-migrator-operator/0.log"
Jul 27 18:25:16.187822 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.187743    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/kube-multus-additional-cni-plugins/0.log"
Jul 27 18:25:16.209446 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.209420    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/egress-router-binary-copy/0.log"
Jul 27 18:25:16.229587 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.229560    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/cni-plugins/0.log"
Jul 27 18:25:16.249844 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.249822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/bond-cni-plugin/0.log"
Jul 27 18:25:16.270595 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.270569    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/routeoverride-cni/0.log"
Jul 27 18:25:16.293678 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.293654    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/whereabouts-cni-bincopy/0.log"
Jul 27 18:25:16.314944 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.314917    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvwfc_c19de51b-a214-4368-80f8-73fa2212b9c2/whereabouts-cni/0.log"
Jul 27 18:25:16.696786 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.696755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fhz5q_8fd50371-320e-451a-ad62-66bfac5dded0/kube-multus/0.log"
Jul 27 18:25:16.864336 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.864309    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpxwg_8c8d5e98-89f9-48c7-82ba-5890a826d740/network-metrics-daemon/0.log"
Jul 27 18:25:16.882815 ip-10-0-143-96 kubenswrapper[2564]: I0727 18:25:16.882794    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpxwg_8c8d5e98-89f9-48c7-82ba-5890a826d740/kube-rbac-proxy/0.log"