Jul 09 03:56:08.891598 ip-10-0-143-172 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 03:56:09.343007 ip-10-0-143-172 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:09.343007 ip-10-0-143-172 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 03:56:09.343007 ip-10-0-143-172 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:09.343007 ip-10-0-143-172 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 03:56:09.343007 ip-10-0-143-172 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:09.344043 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.343944    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351366    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351394    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351398    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351401    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351405    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351408    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351411    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.351403 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351417    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351422    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351425    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351429    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351432    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351435    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351438    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351440    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351444    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351448    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351451    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351454    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351457    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351460    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351463    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351465    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351468    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351471    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351474    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.351726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351476    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351479    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351482    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351484    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351487    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351492    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351494    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351497    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351499    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351502    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351504    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351507    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351509    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351512    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351514    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351518    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351521    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351523    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351527    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351530    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.352183 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351533    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351536    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351538    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351541    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351544    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351547    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351549    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351552    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351554    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351557    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351559    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351562    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351565    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351567    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351570    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351572    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351575    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351577    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351580    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351582    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.352738 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351584    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351587    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351589    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351591    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351594    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351596    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351600    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351604    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351607    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351610    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351613    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351616    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351618    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351660    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351663    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351666    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351669    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351672    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351675    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.353246 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351677    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351680    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351683    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351686    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351688    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351691    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351694    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351697    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351700    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351702    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351705    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351707    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351710    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.351713    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352488    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352497    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352503    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352507    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352511    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.353726 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352514    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352518    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352521    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352524    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352526    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352529    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352532    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352534    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352537    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352539    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352542    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352544    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352548    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352550    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352553    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352555    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352558    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352562    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352566    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352569    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.354248 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352571    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352574    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352577    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352579    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352581    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352584    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352586    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352589    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352591    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352594    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352596    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352599    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352601    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352604    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352606    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352610    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352612    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352615    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352617    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352620    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.354817 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352623    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352625    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352628    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352630    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352633    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352636    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352638    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352641    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352643    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352646    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352649    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352651    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352654    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352657    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352661    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352664    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352666    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352669    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352672    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.355332 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352675    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352678    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352682    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352685    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352688    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352691    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352693    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352695    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352698    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352701    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352704    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352706    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352709    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352712    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352715    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352717    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352720    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352723    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352725    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352729    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.355808 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352732    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352734    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352737    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352740    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352743    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352746    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352749    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352751    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352754    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352756    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352759    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352762    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352764    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352767    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.352770    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353291    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353299    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353302    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353305    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353308    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.356319 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353312    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353315    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353318    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353321    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353323    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353326    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353328    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353331    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353335    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353338    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353341    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353344    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353347    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353349    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353353    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353356    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353359    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353361    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353364    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353367    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.356821 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353369    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353372    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353374    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353377    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353379    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353381    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353385    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353387    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353390    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353392    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353395    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353398    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353401    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353403    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353406    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353408    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353411    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353414    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353418    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.357360 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353421    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353423    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353426    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353429    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353431    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353436    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353438    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353441    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353448    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353450    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353452    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353455    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353457    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353460    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353463    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353465    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353467    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353470    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353472    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.357828 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353475    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353477    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353480    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353482    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353485    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353487    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353490    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353493    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353495    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353497    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353500    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353502    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353504    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353507    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353509    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353512    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353514    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353517    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353519    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353523    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.358315 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353525    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353530    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353533    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353535    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353541    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353543    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353546    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353548    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353551    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353553    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353556    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353560    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353563    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353565    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353568    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.353571    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353652    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353661    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353668    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353673    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 03:56:09.358805 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353678    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353681    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353685    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353690    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353693    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353696    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353700    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353703    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353706    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353709    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353712    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353715    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353719    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353723    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353727    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353730    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353735    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353738    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353742    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353746    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353749    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353752    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353755    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353758    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 03:56:09.359322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353761    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353764    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353767    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353771    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353776    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353779    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353782    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353784    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353788    2569 flags.go:64] FLAG: --enable-server="true"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353791    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353796    2569 flags.go:64] FLAG: --event-burst="100"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353799    2569 flags.go:64] FLAG: --event-qps="50"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353802    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353805    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353808    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353817    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353820    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353823    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353826    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353829    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353832    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353837    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353840    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353843    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353847    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 03:56:09.359904 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353850    2569 flags.go:64] FLAG: --feature-gates=""
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353854    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353857    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353860    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353863    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353866    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353869    2569 flags.go:64] FLAG: --help="false"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353871    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353874    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353877    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353881    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353885    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353888    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353891    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353894    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353896    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353899    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353902    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353905    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353908    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353910    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353913    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353916    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353919    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 03:56:09.360552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353921    2569 flags.go:64] FLAG: --lock-file=""
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353924    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353927    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353930    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353937    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353940    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353944    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353948    2569 flags.go:64] FLAG: --logging-format="text"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353951    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353954    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353957    2569 flags.go:64] FLAG: --manifest-url=""
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353960    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353964    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353967    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353971    2569 flags.go:64] FLAG: --max-pods="110"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353974    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353991    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353994    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353996    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.353999    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354002    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354005    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354013    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354016    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354019    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 03:56:09.361164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354022    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354025    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354032    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354035    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354037    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354040    2569 flags.go:64] FLAG: --port="10250"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354043    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354046    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e5b888c1ee5c3e8a"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354049    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354052    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354055    2569 flags.go:64] FLAG: --register-node="true"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354060    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354064    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354068    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354071    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354075    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354079    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354082    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354085    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354088    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354091    2569 flags.go:64] FLAG: --runonce="false"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354094    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354097    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354101    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354103    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 03:56:09.361851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354106    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354109    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354112    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354115    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354118    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354121    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354124    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354126    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354129    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354132    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354135    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354140    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354143    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354146    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354150    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354152    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354155    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354158    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354163    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354166    2569 flags.go:64] FLAG: --v="2"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354170    2569 flags.go:64] FLAG: --version="false"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354175    2569 flags.go:64] FLAG: --vmodule=""
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354180    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.354184    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354352    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.362711 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354357    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354360    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354363    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354366    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354369    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354372    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354375    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354379    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354382    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354385    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354388    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354391    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354394    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354397    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354400    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354403    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354406    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354409    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354411    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.363377 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354414    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354416    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354419    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354421    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354424    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354426    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354431    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354434    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354437    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354440    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354447    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354450    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354453    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354455    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354458    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354460    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354463    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354466    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354469    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.363912 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354471    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354474    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354476    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354479    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354481    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354484    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354486    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354489    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354491    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354494    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354496    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354499    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354501    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354504    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354507    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354509    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354511    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354514    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354516    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354519    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.364454 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354521    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354524    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354526    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354530    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354537    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354540    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354543    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354545    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354548    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354550    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354553    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354556    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354559    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354562    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354564    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354567    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354569    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354571    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354574    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354578    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.364955 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354581    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354584    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354587    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354589    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354592    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354595    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354597    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354599    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354602    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354604    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354607    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354609    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354612    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354614    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354617    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354621    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354624    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354632    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354635    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.365462 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.354638    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.355586    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.363880    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.363903    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.363928    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.363939    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364006    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364012    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364015    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364018    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364022    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364025    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364028    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364031    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364033    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.365933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364036    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364040    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364043    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364045    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364048    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364051    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364053    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364056    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364058    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364061    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364064    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364066    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364068    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364071    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364073    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364076    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364078    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364081    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364083    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364088    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.366352 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364100    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364103    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364106    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364108    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364113    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364117    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364120    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364122    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364125    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364127    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364130    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364133    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364137    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364140    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364144    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364146    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364149    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364152    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364155    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.366858 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364157    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364160    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364162    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364164    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364167    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364169    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364172    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364175    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364178    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364181    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364183    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364187    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364192    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364195    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364199    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364202    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364204    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364207    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364209    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364212    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.367414 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364214    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364217    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364219    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364240    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364243    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364246    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364248    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364251    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364254    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364256    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364259    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364262    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364264    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364267    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364270    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364272    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364275    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364278    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364280    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364283    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.367972 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364285    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364288    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364293    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364295    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364299    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364302    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364304    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364308    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364310    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364312    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364315    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.364320    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364485    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364493    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364496    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:09.368536 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364499    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364501    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364504    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364507    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364509    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364512    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364514    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364517    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364519    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364522    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364524    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364526    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364529    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364532    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364537    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364539    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364542    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364545    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364547    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364550    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:09.368934 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364553    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364556    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364559    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364561    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364564    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364567    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364570    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364573    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364576    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364578    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364581    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364583    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364586    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364588    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364591    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364594    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364598    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364601    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364603    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:09.369472 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364606    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364609    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364611    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364614    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364616    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364619    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364621    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364624    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364626    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364629    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364631    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364634    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364637    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364639    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364643    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364646    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364648    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364650    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364653    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364656    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:09.369933 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364658    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364662    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364665    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364667    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364670    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364672    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364675    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364677    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364680    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364682    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364684    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364687    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364689    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364692    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364694    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364696    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364699    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364701    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364704    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:09.370466 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364706    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364709    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364711    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364713    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364716    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364719    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364721    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364724    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364726    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364729    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364731    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364734    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364736    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364739    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364742    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364744    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364747    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:09.370951 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:09.364749    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.364754    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.364901    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.367481    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.369284    2569 server.go:1019] "Starting client certificate rotation"
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.369443    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 03:56:09.371415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.369485    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 03:56:09.372322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.372300    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 03:56:09.374043 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.374012    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 03:56:09.388244 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.388196    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 09 03:56:09.391140 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.391115    2569 log.go:25] "Validated CRI v1 image API"
Jul 09 03:56:09.392172 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.392148    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 03:56:09.395046 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.395018    2569 fs.go:135] Filesystem UUIDs: map[2a677c18-18b2-4ce2-b70b-056c0447b5ef:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 972258dc-d90f-4047-ba2e-ff2c759d4fde:/dev/nvme0n1p4]
Jul 09 03:56:09.395046 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.395042    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 03:56:09.402001 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.401972    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 03:56:09.403105 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.402959    2569 manager.go:216] Machine: {Timestamp:2026-07-09 03:56:09.40132502 +0000 UTC m=+0.375472177 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100216 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2cf28fe31b5c7e821ef3c886b11a SystemUUID:ec2f2cf2-8fe3-1b5c-7e82-1ef3c886b11a BootID:cf7f10b3-727f-4f0f-bacd-cb1395e3fbb7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:60:98:5c:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:60:98:5c:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:04:9e:ef:9c:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 03:56:09.403105 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.403100    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 03:56:09.403245 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.403218    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 03:56:09.406899 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.406855    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 03:56:09.407088 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.406898    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 03:56:09.407817 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.407800    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 03:56:09.407817 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.407817    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 03:56:09.407877 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.407826    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 03:56:09.407877 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.407865    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 03:56:09.409815 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.409798    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 03:56:09.414685 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414666    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 03:56:09.414851 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414840    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 03:56:09.414886 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414875    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 03:56:09.414913 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414889    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 03:56:09.414913 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414905    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 03:56:09.414968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414916    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 09 03:56:09.414968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.414926    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 03:56:09.415416 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.415383    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 03:56:09.415476 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.415424    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 03:56:09.418533 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.418510    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r62bn"
Jul 09 03:56:09.418811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.418786    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 03:56:09.421543 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.421525    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 03:56:09.421596 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.421560    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 03:56:09.423138 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423123    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 03:56:09.423174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423143    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 03:56:09.423174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423152    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 03:56:09.423174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423158    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 03:56:09.423174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423167    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 03:56:09.423174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423173    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423181    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423186    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423199    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423205    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423214    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 03:56:09.423316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.423219    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 03:56:09.424218 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.424206    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 03:56:09.424218 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.424217    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 03:56:09.429101 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.429054    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 03:56:09.429101 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.429053    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 03:56:09.429984 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.429938    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r62bn"
Jul 09 03:56:09.430681 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.430661    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 03:56:09.432158 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.432144    2569 server.go:1268] "Started kubelet"
Jul 09 03:56:09.432323 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.432266    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 03:56:09.432386 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.432324    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 03:56:09.432445 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.432401    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 03:56:09.433142 ip-10-0-143-172 systemd[1]: Started Kubernetes Kubelet.
Jul 09 03:56:09.433986 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.433970    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 03:56:09.435025 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.435009    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 03:56:09.438396 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.438361    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 03:56:09.443272 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.443245    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 03:56:09.443272 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.443265    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 03:56:09.443480 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.443365    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.444142 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444113    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 03:56:09.444142 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444115    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 03:56:09.444335 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444151    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 03:56:09.444335 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444217    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 03:56:09.444335 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444244    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 03:56:09.444662 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444648    2569 factory.go:55] Registering systemd factory
Jul 09 03:56:09.444706 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444687    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 09 03:56:09.444906 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444895    2569 factory.go:153] Registering CRI-O factory
Jul 09 03:56:09.444948 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444908    2569 factory.go:223] Registration of the crio container factory successfully
Jul 09 03:56:09.445005 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.444967    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 03:56:09.445036 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.445003    2569 factory.go:103] Registering Raw factory
Jul 09 03:56:09.445036 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.445019    2569 manager.go:1196] Started watching for new ooms in manager
Jul 09 03:56:09.445643 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.445629    2569 manager.go:349] Starting recovery of all containers
Jul 09 03:56:09.446302 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.446280    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:09.450341 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.450134    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-172.ec2.internal\" not found" node="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.456899 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.456875    2569 manager.go:354] Recovery completed
Jul 09 03:56:09.462535 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.462504    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.465070 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465048    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.465158 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465091    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.465158 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465105    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.465725 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465700    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 03:56:09.465725 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465720    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 03:56:09.465879 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465739    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.465879 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.465742    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 03:56:09.466568 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.466546    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.466648 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.466582    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.466648 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.466592    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.468090 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.468070    2569 policy_none.go:49] "None policy: Start"
Jul 09 03:56:09.468090 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.468091    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 03:56:09.468211 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.468102    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 03:56:09.470236 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.470208    2569 policy_none.go:47] "Start"
Jul 09 03:56:09.516033 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516008    2569 manager.go:337] "Starting Device Plugin manager"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.516050    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516062    2569 server.go:87] "Starting device plugin registration server"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516392    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516404    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516525    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516645    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.516655    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.517205    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 03:56:09.524326 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.517291    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.554396 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.554355    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 03:56:09.556079 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.556051    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 03:56:09.556245 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.556102    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 03:56:09.556245 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.556133    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 03:56:09.556245 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.556177    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 03:56:09.558939 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.558911    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:09.617379 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.617301    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.618581 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.618555    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.618683 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.618601    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.618683 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.618616    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.618683 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.618645    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.629715 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.629679    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.629792 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.629717    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-172.ec2.internal\": node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.645210 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.645180    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.656863 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.656829    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"]
Jul 09 03:56:09.656933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.656911    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.657997 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.657979    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.658083 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.658018    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.658083 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.658030    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.660637 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.660614    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.660762 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.660741    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.660836 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.660779    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.661526 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661507    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.661607 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661541    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.661607 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661565    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.661607 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661575    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.661607 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661543    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.661726 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.661627    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.663942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.663921    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.664031 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.663959    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:09.664813 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.664793    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:09.664921 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.664829    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:09.664921 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.664843    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:09.689006 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.688978    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-172.ec2.internal\" not found" node="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.693297 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.693272    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-172.ec2.internal\" not found" node="ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.745932 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.745892    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.746113 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.745941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.746113 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.745975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.746113 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.745994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b593d636fd188f994c401884793c416d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-172.ec2.internal\" (UID: \"b593d636fd188f994c401884793c416d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846482 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.846425    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.846482 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846698 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846698 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b593d636fd188f994c401884793c416d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-172.ec2.internal\" (UID: \"b593d636fd188f994c401884793c416d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846698 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846567    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b593d636fd188f994c401884793c416d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-172.ec2.internal\" (UID: \"b593d636fd188f994c401884793c416d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846698 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846575    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.846698 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.846575    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebfd50437daad2ff2d77591647dc12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal\" (UID: \"8ebfd50437daad2ff2d77591647dc12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.947237 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:09.947196    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:09.992429 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.992397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:09.996704 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:09.996678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:10.048268 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:10.048215    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:10.148707 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:10.148668    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:10.249292 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:10.249177    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:10.349777 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:10.349723    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:10.368928 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:10.368891    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 03:56:10.369116 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:10.369093    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:10.369169 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:10.369103    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:11.944626 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:11.944574    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 03:51:10 +0000 UTC" deadline="2028-02-07 14:44:05.409845232 +0000 UTC"
Jul 09 03:56:11.944626 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:11.944611    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13882h47m53.465237636s"
Jul 09 03:56:11.958101 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:11.958061    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:12.059119 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:12.059029    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:12.141503 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:12.141464    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb593d636fd188f994c401884793c416d.slice/crio-6cbc92c5e503b3caafcc5a72886be49d97865190d56202d6bdd08a390e62042b WatchSource:0}: Error finding container 6cbc92c5e503b3caafcc5a72886be49d97865190d56202d6bdd08a390e62042b: Status 404 returned error can't find the container with id 6cbc92c5e503b3caafcc5a72886be49d97865190d56202d6bdd08a390e62042b
Jul 09 03:56:12.142469 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:12.142443    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebfd50437daad2ff2d77591647dc12a.slice/crio-322bec871392d40cb1e7a490dcc74566661acc880245b0f7cd4dbb94d12da984 WatchSource:0}: Error finding container 322bec871392d40cb1e7a490dcc74566661acc880245b0f7cd4dbb94d12da984: Status 404 returned error can't find the container with id 322bec871392d40cb1e7a490dcc74566661acc880245b0f7cd4dbb94d12da984
Jul 09 03:56:12.147532 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.147507    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 03:56:12.159963 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:12.159932    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-172.ec2.internal\" not found"
Jul 09 03:56:12.186668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.186623    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:12.188407 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.188386    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:12.252322 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.252286    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:12.263731 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.263697    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 03:56:12.264770 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.264745    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal"
Jul 09 03:56:12.274243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.274212    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 03:56:12.923973 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.923931    2569 apiserver.go:52] "Watching apiserver"
Jul 09 03:56:12.934717 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.934678    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 03:56:12.935858 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.935816    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:12.936755 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.936718    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r2nqr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj","openshift-cluster-node-tuning-operator/tuned-v79rw","openshift-dns/node-resolver-qqmz6","openshift-image-registry/node-ca-q6xvc","openshift-multus/multus-2xx6q","openshift-multus/network-metrics-daemon-86g8s","openshift-network-diagnostics/network-check-target-2kzm8","kube-system/konnectivity-agent-pv5gz","kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal","openshift-multus/multus-additional-cni-plugins-b2s9b","openshift-network-operator/iptables-alerter-stnzz","openshift-ovn-kubernetes/ovnkube-node-n6wj6"]
Jul 09 03:56:12.939680 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.939647    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:12.939853 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:12.939760    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:12.942418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.942382    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:12.944788 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.944754    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.945015 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.944982    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 03:56:12.945250 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.945231    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76lgp\""
Jul 09 03:56:12.945472 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.945449    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.946821 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.946799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.949109 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.949086    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dhw4m\""
Jul 09 03:56:12.949331 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.949308    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:12.949447 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.949095    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.949664 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.949148    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.951502 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.951472    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ch7vv\""
Jul 09 03:56:12.951639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.951472    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.951766 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.951748    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.952748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.952115    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 03:56:12.952748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.951809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:12.954330 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.954302    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.954653 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.954626    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.955149 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.955128    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 03:56:12.955686 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.955666    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gpfrx\""
Jul 09 03:56:12.955914 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.955897    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.956411 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.956392    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:12.957075 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.956927    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 03:56:12.957174 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.957107    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.957313 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.957296    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hkj5r\""
Jul 09 03:56:12.957491 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.957471    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 03:56:12.957683 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.957656    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.958293 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.958272    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 03:56:12.958773 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.958757    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lqrf9\""
Jul 09 03:56:12.959486 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.959465    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:12.959594 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.958997    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 03:56:12.959594 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:12.959543    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:12.962514 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.961936    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:12.964486 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.964458    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.964857 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.964830    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.964857 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.964849    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cljjc\""
Jul 09 03:56:12.965078 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965059    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-modprobe-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-hostroot\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 03:56:12.965145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-tmp-dir\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:12.965145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965136    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-os-release\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-iptables-alerter-script\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysconfig\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965222    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-run\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965294    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:12.965312 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-lib-modules\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965328    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbnc\" (UniqueName: \"kubernetes.io/projected/47f889a8-4391-47a8-896d-13371c7d2b22-kube-api-access-tdbnc\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-hosts-file\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56739082-4b8c-4add-96e4-77de7ec950c4-host\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-systemd\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-sys\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965595 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cnibin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-socket-dir-parent\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-kubelet\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-conf-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-conf\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965812    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-tmp\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxs4c\" (UniqueName: \"kubernetes.io/projected/56739082-4b8c-4add-96e4-77de7ec950c4-kube-api-access-jxs4c\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965872    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-system-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-daemon-config\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jsk5\" (UniqueName: \"kubernetes.io/projected/2ef85f6b-3690-4562-b909-9a3611217316-kube-api-access-6jsk5\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:12.965982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghpg\" (UniqueName: \"kubernetes.io/projected/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-kube-api-access-8ghpg\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.965988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-var-lib-kubelet\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966042    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-host\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-etc-tuned\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-multus-certs\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-etc-kubernetes\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966152    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56739082-4b8c-4add-96e4-77de7ec950c4-serviceca\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-bin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xnwq\" (UniqueName: \"kubernetes.io/projected/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-kube-api-access-6xnwq\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-host-slash\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-kubernetes\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfl9s\" (UniqueName: \"kubernetes.io/projected/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-kube-api-access-jfl9s\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cni-binary-copy\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-k8s-cni-cncf-io\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-netns\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.966544 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.966440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-multus\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:12.967706 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.967687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:12.967837 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:12.967811    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:12.968353 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968333    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 03:56:12.968353 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968341    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 03:56:12.968511 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968385    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 03:56:12.968571 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968341    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 03:56:12.968624 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968586    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cszfc\""
Jul 09 03:56:12.968624 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968592    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 03:56:12.968807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968790    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 03:56:12.968886 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.968836    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 03:56:12.970834 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.970349    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:12.974481 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.972384    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 03:56:12.974481 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.973357    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9k5g\""
Jul 09 03:56:12.974481 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.973615    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 03:56:12.985464 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.985432    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxbtf"
Jul 09 03:56:12.993757 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:12.993725    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxbtf"
Jul 09 03:56:13.053706 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.053675    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56739082-4b8c-4add-96e4-77de7ec950c4-serviceca\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xnwq\" (UniqueName: \"kubernetes.io/projected/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-kube-api-access-6xnwq\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-systemd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066845    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-host-slash\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfl9s\" (UniqueName: \"kubernetes.io/projected/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-kube-api-access-jfl9s\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-k8s-cni-cncf-io\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-multus\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066926    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.066983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-hostroot\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-kubelet-config\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-systemd-units\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-tmp-dir\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067091    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-os-release\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.068959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-dbus\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067147    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-system-cni-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6931612f-076e-43df-9711-a683369a3dd4-ovn-node-metrics-cert\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmlcs\" (UniqueName: \"kubernetes.io/projected/6931612f-076e-43df-9711-a683369a3dd4-kube-api-access-tmlcs\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-iptables-alerter-script\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-lib-modules\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-hosts-file\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067294    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-hostroot\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56739082-4b8c-4add-96e4-77de7ec950c4-host\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cnibin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067354    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56739082-4b8c-4add-96e4-77de7ec950c4-serviceca\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067443    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-hosts-file\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067449    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cnibin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-config\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-systemd\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-sys\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.069694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-socket-dir-parent\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-lib-modules\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-os-release\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf7d9c18-6b3d-479c-9312-20fd1657f11b-agent-certs\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-conf\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-daemon-config\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067756    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-etc-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-env-overrides\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jsk5\" (UniqueName: \"kubernetes.io/projected/2ef85f6b-3690-4562-b909-9a3611217316-kube-api-access-6jsk5\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghpg\" (UniqueName: \"kubernetes.io/projected/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-kube-api-access-8ghpg\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-var-lib-kubelet\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067875    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-tmp-dir\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-host\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.070542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067630    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56739082-4b8c-4add-96e4-77de7ec950c4-host\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-iptables-alerter-script\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067988    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-host-slash\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.067990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-multus-certs\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068047    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-host\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-etc-kubernetes\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068049    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-socket-dir-parent\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068075    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-k8s-cni-cncf-io\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068095    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-multus\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068097    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-systemd\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-etc-kubernetes\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068145    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-sys\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068151    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-os-release\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068191    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-conf\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-kubelet\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-bin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-kubernetes\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.071372 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cni-binary-copy\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-netns\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cnibin\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-modprobe-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068481    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-multus-certs\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068491    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-run-netns\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.068529    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf7d9c18-6b3d-479c-9312-20fd1657f11b-konnectivity-ca\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-script-lib\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068590    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-daemon-config\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.068613    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:13.56858324 +0000 UTC m=+3.034952893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-node-log\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-bin\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-device-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068692    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-modprobe-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068711    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-var-lib-kubelet\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068801    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-cni-bin\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.072303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnk55\" (UniqueName: \"kubernetes.io/projected/3a68283e-638f-44b2-b957-f7df1d2e07aa-kube-api-access-mnk55\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysconfig\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068901    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-kubernetes\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-cni-binary-copy\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-run\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbnc\" (UniqueName: \"kubernetes.io/projected/47f889a8-4391-47a8-896d-13371c7d2b22-kube-api-access-tdbnc\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.068993    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-conf-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069036    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysctl-d\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069082    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-conf-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069101    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-run\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069135    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47f889a8-4391-47a8-896d-13371c7d2b22-etc-sysconfig\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069128    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal" event={"ID":"8ebfd50437daad2ff2d77591647dc12a","Type":"ContainerStarted","Data":"322bec871392d40cb1e7a490dcc74566661acc880245b0f7cd4dbb94d12da984"}
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-kubelet\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069216    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-multus-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.073162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069280    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-host-var-lib-kubelet\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-slash\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-ovn\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-netd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-tmp\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs4c\" (UniqueName: \"kubernetes.io/projected/56739082-4b8c-4add-96e4-77de7ec950c4-kube-api-access-jxs4c\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-system-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-var-lib-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-log-socket\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-etc-tuned\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069703    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069715    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-system-cni-dir\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9tlr\" (UniqueName: \"kubernetes.io/projected/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-kube-api-access-d9tlr\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.069803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-netns\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.073942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.071388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal" event={"ID":"b593d636fd188f994c401884793c416d","Type":"ContainerStarted","Data":"6cbc92c5e503b3caafcc5a72886be49d97865190d56202d6bdd08a390e62042b"}
Jul 09 03:56:13.074793 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.073524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-tmp\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.075637 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.075604    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47f889a8-4391-47a8-896d-13371c7d2b22-etc-tuned\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.077039 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.076978    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xnwq\" (UniqueName: \"kubernetes.io/projected/256f37c4-4a7b-4727-99dd-26fd2a92fd7f-kube-api-access-6xnwq\") pod \"multus-2xx6q\" (UID: \"256f37c4-4a7b-4727-99dd-26fd2a92fd7f\") " pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.077876 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.077820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghpg\" (UniqueName: \"kubernetes.io/projected/99f6470f-8d1e-4ecc-a303-ea20fb23afa6-kube-api-access-8ghpg\") pod \"iptables-alerter-stnzz\" (UID: \"99f6470f-8d1e-4ecc-a303-ea20fb23afa6\") " pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.078184 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.078155    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxs4c\" (UniqueName: \"kubernetes.io/projected/56739082-4b8c-4add-96e4-77de7ec950c4-kube-api-access-jxs4c\") pod \"node-ca-q6xvc\" (UID: \"56739082-4b8c-4add-96e4-77de7ec950c4\") " pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.078288 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.078220    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfl9s\" (UniqueName: \"kubernetes.io/projected/2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870-kube-api-access-jfl9s\") pod \"node-resolver-qqmz6\" (UID: \"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870\") " pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.079059 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.079033    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jsk5\" (UniqueName: \"kubernetes.io/projected/2ef85f6b-3690-4562-b909-9a3611217316-kube-api-access-6jsk5\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:13.079160 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.079131    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbnc\" (UniqueName: \"kubernetes.io/projected/47f889a8-4391-47a8-896d-13371c7d2b22-kube-api-access-tdbnc\") pod \"tuned-v79rw\" (UID: \"47f889a8-4391-47a8-896d-13371c7d2b22\") " pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.160743 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.160708    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:13.170832 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-system-cni-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.170832 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6931612f-076e-43df-9711-a683369a3dd4-ovn-node-metrics-cert\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmlcs\" (UniqueName: \"kubernetes.io/projected/6931612f-076e-43df-9711-a683369a3dd4-kube-api-access-tmlcs\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-config\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-system-cni-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-os-release\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf7d9c18-6b3d-479c-9312-20fd1657f11b-agent-certs\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.170987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171025    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171065 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-etc-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171115    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-env-overrides\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-kubelet\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171231    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171256    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171386    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171442    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171490    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-etc-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171530    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-kubelet\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cnibin\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf7d9c18-6b3d-479c-9312-20fd1657f11b-konnectivity-ca\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-script-lib\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-node-log\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-bin\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.171730 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-device-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnk55\" (UniqueName: \"kubernetes.io/projected/3a68283e-638f-44b2-b957-f7df1d2e07aa-kube-api-access-mnk55\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171876    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-bin\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-slash\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171949    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-ovn\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171958    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-config\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-netd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171997    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cnibin\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-var-lib-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172044    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-cni-netd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172077    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-node-log\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172078    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-device-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172103    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-var-lib-openvswitch\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172226 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172128    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-slash\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.171948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-env-overrides\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-log-socket\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9tlr\" (UniqueName: \"kubernetes.io/projected/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-kube-api-access-d9tlr\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-netns\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172304    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172316    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-os-release\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172361    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-log-socket\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172371    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-systemd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-systemd\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172397    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-kubelet-config\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.172968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-systemd-units\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172549    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a68283e-638f-44b2-b957-f7df1d2e07aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-dbus\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf7d9c18-6b3d-479c-9312-20fd1657f11b-konnectivity-ca\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172669    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172727    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-systemd-units\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172728    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172676    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-dbus\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172773    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbe200bd-0abe-4b23-92a8-f4676f1550c7-kubelet-config\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-run-ovn\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172843    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.172849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6931612f-076e-43df-9711-a683369a3dd4-host-run-netns\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.172924    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.172997    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:13.672976958 +0000 UTC m=+3.139346616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.173051    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6931612f-076e-43df-9711-a683369a3dd4-ovnkube-script-lib\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.173599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.173245    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.174239 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.174128    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6931612f-076e-43df-9711-a683369a3dd4-ovn-node-metrics-cert\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.175970 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.175940    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf7d9c18-6b3d-479c-9312-20fd1657f11b-agent-certs\") pod \"konnectivity-agent-pv5gz\" (UID: \"cf7d9c18-6b3d-479c-9312-20fd1657f11b\") " pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.178772 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.178739    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:13.178772 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.178769    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:13.178995 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.178785    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:13.178995 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.178884    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:13.678861138 +0000 UTC m=+3.145230805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:13.181949 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.181889    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnk55\" (UniqueName: \"kubernetes.io/projected/3a68283e-638f-44b2-b957-f7df1d2e07aa-kube-api-access-mnk55\") pod \"aws-ebs-csi-driver-node-5mfgj\" (UID: \"3a68283e-638f-44b2-b957-f7df1d2e07aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.182428 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.182401    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9tlr\" (UniqueName: \"kubernetes.io/projected/abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8-kube-api-access-d9tlr\") pod \"multus-additional-cni-plugins-b2s9b\" (UID: \"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8\") " pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.184045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.184020    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmlcs\" (UniqueName: \"kubernetes.io/projected/6931612f-076e-43df-9711-a683369a3dd4-kube-api-access-tmlcs\") pod \"ovnkube-node-n6wj6\" (UID: \"6931612f-076e-43df-9711-a683369a3dd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.260120 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.260074    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-stnzz"
Jul 09 03:56:13.272780 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.272739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v79rw"
Jul 09 03:56:13.280808 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.280771    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqmz6"
Jul 09 03:56:13.288823 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.288786    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6xvc"
Jul 09 03:56:13.297049 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.296990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2xx6q"
Jul 09 03:56:13.307169 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.307135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:13.316297 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.316260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj"
Jul 09 03:56:13.323414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.323375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:13.329460 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.329423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2s9b"
Jul 09 03:56:13.575566 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.575470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:13.575725 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.575600    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:13.575725 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.575674    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:14.57565755 +0000 UTC m=+4.042027205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:13.676434 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.676394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:13.676629 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.676581    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:13.676698 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.676666    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:14.676644022 +0000 UTC m=+4.143013693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:13.777142 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.777103    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:13.777367 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.777283    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:13.777367 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.777309    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:13.777367 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.777319    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:13.777534 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:13.777384    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:14.777365302 +0000 UTC m=+4.243734959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:13.997321 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.997272    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:51:12 +0000 UTC" deadline="2028-04-07 11:47:59.34604575 +0000 UTC"
Jul 09 03:56:13.997321 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:13.997309    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15319h51m45.348739688s"
Jul 09 03:56:14.278273 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.278239    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256f37c4_4a7b_4727_99dd_26fd2a92fd7f.slice/crio-c6d4ac8ef028cb7266535ee892636dc3859adaf021c7d191794cbd313498d604 WatchSource:0}: Error finding container c6d4ac8ef028cb7266535ee892636dc3859adaf021c7d191794cbd313498d604: Status 404 returned error can't find the container with id c6d4ac8ef028cb7266535ee892636dc3859adaf021c7d191794cbd313498d604
Jul 09 03:56:14.280102 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.280028    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be0a3be_a1b3_4f4f_9abf_3a1cf6c66870.slice/crio-0267cb8344afcf52217381fa1f5160170c3a6b518c8c35727054a80175fdd05d WatchSource:0}: Error finding container 0267cb8344afcf52217381fa1f5160170c3a6b518c8c35727054a80175fdd05d: Status 404 returned error can't find the container with id 0267cb8344afcf52217381fa1f5160170c3a6b518c8c35727054a80175fdd05d
Jul 09 03:56:14.281390 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.281360    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a68283e_638f_44b2_b957_f7df1d2e07aa.slice/crio-ff557dcbdbb944b0f15ed475b588b1da5be98e7e43b73812d8172d81061eb289 WatchSource:0}: Error finding container ff557dcbdbb944b0f15ed475b588b1da5be98e7e43b73812d8172d81061eb289: Status 404 returned error can't find the container with id ff557dcbdbb944b0f15ed475b588b1da5be98e7e43b73812d8172d81061eb289
Jul 09 03:56:14.283720 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.283693    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabeb58a7_9ad2_4ccd_b8ca_437f398cb7d8.slice/crio-867d0b7372d1d79b0fea7c499f9b6d994f7056fb1b37ec246552837678d910af WatchSource:0}: Error finding container 867d0b7372d1d79b0fea7c499f9b6d994f7056fb1b37ec246552837678d910af: Status 404 returned error can't find the container with id 867d0b7372d1d79b0fea7c499f9b6d994f7056fb1b37ec246552837678d910af
Jul 09 03:56:14.284724 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.284660    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f6470f_8d1e_4ecc_a303_ea20fb23afa6.slice/crio-d96eb362a8226efcd09deedfff5a6ed8a54467265b32988e4b4c71ebfd5fdde2 WatchSource:0}: Error finding container d96eb362a8226efcd09deedfff5a6ed8a54467265b32988e4b4c71ebfd5fdde2: Status 404 returned error can't find the container with id d96eb362a8226efcd09deedfff5a6ed8a54467265b32988e4b4c71ebfd5fdde2
Jul 09 03:56:14.286119 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.286094    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f889a8_4391_47a8_896d_13371c7d2b22.slice/crio-82ba34b9b641eba58a51adc6a36bb8a429a0a0e3c9de9818f169d3595da99418 WatchSource:0}: Error finding container 82ba34b9b641eba58a51adc6a36bb8a429a0a0e3c9de9818f169d3595da99418: Status 404 returned error can't find the container with id 82ba34b9b641eba58a51adc6a36bb8a429a0a0e3c9de9818f169d3595da99418
Jul 09 03:56:14.287336 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.287204    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56739082_4b8c_4add_96e4_77de7ec950c4.slice/crio-b0c3a1b0db564c794cf0f355e68c5e46a77e94bcb1216a3290ba49e87d86f6db WatchSource:0}: Error finding container b0c3a1b0db564c794cf0f355e68c5e46a77e94bcb1216a3290ba49e87d86f6db: Status 404 returned error can't find the container with id b0c3a1b0db564c794cf0f355e68c5e46a77e94bcb1216a3290ba49e87d86f6db
Jul 09 03:56:14.288719 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:14.288430    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6931612f_076e_43df_9711_a683369a3dd4.slice/crio-30f0ab61f739553b2065f649f91e725bf0bfaa24f42589f4b9bfc147147f34c0 WatchSource:0}: Error finding container 30f0ab61f739553b2065f649f91e725bf0bfaa24f42589f4b9bfc147147f34c0: Status 404 returned error can't find the container with id 30f0ab61f739553b2065f649f91e725bf0bfaa24f42589f4b9bfc147147f34c0
Jul 09 03:56:14.582364 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:14.582326    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:14.582586 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.582457    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:14.582586 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.582519    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.582504662 +0000 UTC m=+6.048874315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:14.683855 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:14.683712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:14.684050 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.683908    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:14.684050 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.683992    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.683971709 +0000 UTC m=+6.150341376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:14.784945 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:14.784903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:14.785171 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.785148    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:14.785262 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.785176    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:14.785262 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.785190    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:14.785262 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:14.785248    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.785230007 +0000 UTC m=+6.251599663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:14.998145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:14.998100    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:51:12 +0000 UTC" deadline="2028-01-02 09:58:54.662379082 +0000 UTC"
Jul 09 03:56:14.998145 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:14.998143    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13014h2m39.664240966s"
Jul 09 03:56:15.065237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.065199    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:15.065434 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:15.065364    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:15.065798 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.065777    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:15.065911 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:15.065889    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:15.066089 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.066072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:15.066197 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:15.066170    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:15.078894 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.078767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-stnzz" event={"ID":"99f6470f-8d1e-4ecc-a303-ea20fb23afa6","Type":"ContainerStarted","Data":"d96eb362a8226efcd09deedfff5a6ed8a54467265b32988e4b4c71ebfd5fdde2"}
Jul 09 03:56:15.085448 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.085290    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj" event={"ID":"3a68283e-638f-44b2-b957-f7df1d2e07aa","Type":"ContainerStarted","Data":"ff557dcbdbb944b0f15ed475b588b1da5be98e7e43b73812d8172d81061eb289"}
Jul 09 03:56:15.092506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.092463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqmz6" event={"ID":"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870","Type":"ContainerStarted","Data":"0267cb8344afcf52217381fa1f5160170c3a6b518c8c35727054a80175fdd05d"}
Jul 09 03:56:15.098050 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.097986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pv5gz" event={"ID":"cf7d9c18-6b3d-479c-9312-20fd1657f11b","Type":"ContainerStarted","Data":"b5130943a999c9f5a27150d25c3d55150a8b860c010273ee6fb755368e549a87"}
Jul 09 03:56:15.100973 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.100928    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"30f0ab61f739553b2065f649f91e725bf0bfaa24f42589f4b9bfc147147f34c0"}
Jul 09 03:56:15.107734 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.107687    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6xvc" event={"ID":"56739082-4b8c-4add-96e4-77de7ec950c4","Type":"ContainerStarted","Data":"b0c3a1b0db564c794cf0f355e68c5e46a77e94bcb1216a3290ba49e87d86f6db"}
Jul 09 03:56:15.123301 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.123255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v79rw" event={"ID":"47f889a8-4391-47a8-896d-13371c7d2b22","Type":"ContainerStarted","Data":"82ba34b9b641eba58a51adc6a36bb8a429a0a0e3c9de9818f169d3595da99418"}
Jul 09 03:56:15.134688 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.134565    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerStarted","Data":"867d0b7372d1d79b0fea7c499f9b6d994f7056fb1b37ec246552837678d910af"}
Jul 09 03:56:15.143187 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.143148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2xx6q" event={"ID":"256f37c4-4a7b-4727-99dd-26fd2a92fd7f","Type":"ContainerStarted","Data":"c6d4ac8ef028cb7266535ee892636dc3859adaf021c7d191794cbd313498d604"}
Jul 09 03:56:15.153890 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.153847    2569 generic.go:356] "Generic (PLEG): container finished" podID="8ebfd50437daad2ff2d77591647dc12a" containerID="5ad98154fedc51e4c23f06bea846b31ce4e3bf0ba0655c9f6de09cb90ea7e28b" exitCode=0
Jul 09 03:56:15.154096 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.153971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal" event={"ID":"8ebfd50437daad2ff2d77591647dc12a","Type":"ContainerDied","Data":"5ad98154fedc51e4c23f06bea846b31ce4e3bf0ba0655c9f6de09cb90ea7e28b"}
Jul 09 03:56:15.167060 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.167021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal" event={"ID":"b593d636fd188f994c401884793c416d","Type":"ContainerStarted","Data":"6bd74f5162fa9578062b0a1b096e47b1b618f9f08d28470514032d7d26ac63d8"}
Jul 09 03:56:15.192898 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:15.192827    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-172.ec2.internal" podStartSLOduration=3.192802249 podStartE2EDuration="3.192802249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:15.191992276 +0000 UTC m=+4.658361953" watchObservedRunningTime="2026-07-09 03:56:15.192802249 +0000 UTC m=+4.659171925"
Jul 09 03:56:16.189826 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:16.189763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal" event={"ID":"8ebfd50437daad2ff2d77591647dc12a","Type":"ContainerStarted","Data":"cb42efc3744e7899c93d26bcee4da346d24db16665a1aeb9c00463b52e17c54a"}
Jul 09 03:56:16.603462 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:16.603357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:16.603664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.603521    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:16.603664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.603592    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:20.603572219 +0000 UTC m=+10.069941896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:16.704474 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:16.704429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:16.704672 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.704591    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:16.704672 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.704662    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:20.70464267 +0000 UTC m=+10.171012325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:16.804853 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:16.804804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:16.805093 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.805028    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:16.805093 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.805050    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:16.805093 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.805063    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:16.805244 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:16.805126    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:20.805106554 +0000 UTC m=+10.271476209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:17.065177 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:17.065137    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:17.065375 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:17.065274    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:17.066151 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:17.065700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:17.066151 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:17.065822    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:17.066151 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:17.065978    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:17.066151 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:17.066085    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:19.066217 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:19.066177    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:19.066631 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:19.066177    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:19.066631 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:19.066485    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:19.066631 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:19.066336    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:19.066631 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:19.066571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:19.066783 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:19.066713    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:20.643522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:20.643481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:20.644030 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.643669    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:20.644030 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.643741    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:28.64372217 +0000 UTC m=+18.110091830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:20.743852 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:20.743822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:20.744032 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.743948    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:20.744032 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.744017    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:28.743988408 +0000 UTC m=+18.210358065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:20.844623 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:20.844577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:20.844775 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.844762    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:20.844843 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.844783    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:20.844843 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.844798    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:20.844907 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:20.844860    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:28.844840619 +0000 UTC m=+18.311210273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:21.065741 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:21.065664    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:21.065937 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:21.065781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:21.066164 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:21.066143    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:21.066355 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:21.066332    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:21.066442 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:21.066398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:21.066499 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:21.066470    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:23.065142 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:23.065061    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:23.065581 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:23.065184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:23.065581 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:23.065191    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:23.065581 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:23.065278    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:23.065581 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:23.065061    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:23.065581 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:23.065350    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:25.064748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:25.064698    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:25.065191 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:25.064706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:25.065191 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:25.064849    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:25.065191 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:25.064731    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:25.065191 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:25.064978    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:25.065191 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:25.065067    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:27.064676 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:27.064636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:27.065170 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:27.064636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:27.065170 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:27.064653    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:27.065170 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:27.064787    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:27.065170 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:27.064864    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:27.065170 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:27.064966    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:28.705510 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:28.705466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:28.705936 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.705646    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:28.705936 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.705724    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:44.705701448 +0000 UTC m=+34.172071101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:28.806836 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:28.806793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:28.807048 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.806963    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:28.807116 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.807063    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:44.807042288 +0000 UTC m=+34.273411957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:28.907885 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:28.907840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:28.908099 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.907969    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:28.908099 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.907987    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:28.908099 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.907998    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:28.908099 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:28.908072    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:44.908054072 +0000 UTC m=+34.374423728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:29.064488 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:29.064403    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:29.064646 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:29.064398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:29.064646 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:29.064513    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:29.064646 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:29.064629    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:29.064764 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:29.064418    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:29.064764 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:29.064730    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:31.065687 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:31.065646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:31.066182 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:31.065764    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:31.066182 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:31.065797    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:31.066182 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:31.065880    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:31.066182 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:31.065769    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:31.066182 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:31.065979    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:33.064769 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:33.064730    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:33.065325 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:33.064859    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:33.065325 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:33.065245    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:33.065420 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:33.065327    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:33.065456 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:33.065443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:33.065536 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:33.065519    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:34.234996 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.234517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6xvc" event={"ID":"56739082-4b8c-4add-96e4-77de7ec950c4","Type":"ContainerStarted","Data":"6d1d5f12841ab4f6246700f0a4d90439b3a3211f2ce79759328e9119e8f9a920"}
Jul 09 03:56:34.236273 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.236234    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v79rw" event={"ID":"47f889a8-4391-47a8-896d-13371c7d2b22","Type":"ContainerStarted","Data":"e34c069420d65988b8bbbdb9c469613584f820219d642e50b091e489b0882044"}
Jul 09 03:56:34.237693 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.237665    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="b16643a30f8b75b2e476ca34b224af324369259e12afdaf1368f0ff3eba3d6b2" exitCode=0
Jul 09 03:56:34.237824 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.237750    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"b16643a30f8b75b2e476ca34b224af324369259e12afdaf1368f0ff3eba3d6b2"}
Jul 09 03:56:34.239624 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.239419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2xx6q" event={"ID":"256f37c4-4a7b-4727-99dd-26fd2a92fd7f","Type":"ContainerStarted","Data":"fba905046b02d1f2e6462aa7524edfcac1fdd8ae666e0c56f815632b50c4fd17"}
Jul 09 03:56:34.240951 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.240898    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj" event={"ID":"3a68283e-638f-44b2-b957-f7df1d2e07aa","Type":"ContainerStarted","Data":"690c2100e844e8bc7a7c87b7a1b763a3ea59e01ffbf7ccb09a010404eb6ef80f"}
Jul 09 03:56:34.242400 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.242371    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqmz6" event={"ID":"2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870","Type":"ContainerStarted","Data":"419997dd9e10282ab0d129b90a16857f2540c89f290dd342261b0e5366cdfdbe"}
Jul 09 03:56:34.244022 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.243953    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pv5gz" event={"ID":"cf7d9c18-6b3d-479c-9312-20fd1657f11b","Type":"ContainerStarted","Data":"0a0e9961588869a8a0f5ef887ddd65b3a4d26b0fdd609ee05a15680bdfd02380"}
Jul 09 03:56:34.246173 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 03:56:34.246504 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246484    2569 generic.go:356] "Generic (PLEG): container finished" podID="6931612f-076e-43df-9711-a683369a3dd4" containerID="81b5df7126a49b24fe2f1925547ef8f67c1652fba448261f629568c0863c0fea" exitCode=1
Jul 09 03:56:34.246551 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"9713d5ed9147c1d3168887aa55cf9832279229805bfb273f8f6d5aab21f56a94"}
Jul 09 03:56:34.246600 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"a72eb9950a6ee363950cb2882a7c5ab86cf61ecdfab55bc915384b1dbc6a7d68"}
Jul 09 03:56:34.246636 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerDied","Data":"81b5df7126a49b24fe2f1925547ef8f67c1652fba448261f629568c0863c0fea"}
Jul 09 03:56:34.246665 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.246641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"c00fc2456accb30c98210281c11cd79465b60caac8eae09a2f5e3fd9da217e65"}
Jul 09 03:56:34.247830 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.247788    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q6xvc" podStartSLOduration=4.045712243 podStartE2EDuration="23.247776434s" totalImagesPullingTime="19.202064191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:34.247388104 +0000 UTC m=+23.713757779" watchObservedRunningTime="2026-07-09 03:56:34.247776434 +0000 UTC m=+23.714146122"
Jul 09 03:56:34.248089 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.248067    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-172.ec2.internal" podStartSLOduration=22.248060882 podStartE2EDuration="22.248060882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:16.205383817 +0000 UTC m=+5.671753516" watchObservedRunningTime="2026-07-09 03:56:34.248060882 +0000 UTC m=+23.714430556"
Jul 09 03:56:34.281938 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.281888    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v79rw" podStartSLOduration=4.05499002 podStartE2EDuration="23.281872503s" totalImagesPullingTime="19.226882483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:34.281354276 +0000 UTC m=+23.747723966" watchObservedRunningTime="2026-07-09 03:56:34.281872503 +0000 UTC m=+23.748242178"
Jul 09 03:56:34.296899 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.296848    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2xx6q" podStartSLOduration=3.718539483 podStartE2EDuration="23.296829115s" totalImagesPullingTime="19.578289632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:34.296285454 +0000 UTC m=+23.762655157" watchObservedRunningTime="2026-07-09 03:56:34.296829115 +0000 UTC m=+23.763198790"
Jul 09 03:56:34.309523 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.309472    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qqmz6" podStartSLOduration=4.100786087 podStartE2EDuration="23.309453052s" totalImagesPullingTime="19.208666965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:34.309322079 +0000 UTC m=+23.775691765" watchObservedRunningTime="2026-07-09 03:56:34.309453052 +0000 UTC m=+23.775822727"
Jul 09 03:56:34.323765 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:34.323690    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pv5gz" podStartSLOduration=12.62013179 podStartE2EDuration="23.323666472s" totalImagesPullingTime="10.703534682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:34.323319241 +0000 UTC m=+23.789688918" watchObservedRunningTime="2026-07-09 03:56:34.323666472 +0000 UTC m=+23.790036148"
Jul 09 03:56:35.064923 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.064884    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:35.065147 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:35.065030    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:35.065147 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.064885    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:35.065147 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:35.065111    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:35.065147 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.064885    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:35.065356 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:35.065164    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:35.251345 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.251308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-stnzz" event={"ID":"99f6470f-8d1e-4ecc-a303-ea20fb23afa6","Type":"ContainerStarted","Data":"033fadc41929d438c4e12d87766a701d2def3411bf2363f93c4b8dbc9d958392"}
Jul 09 03:56:35.255711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.255681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 03:56:35.256835 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.256300    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"94560169e525c2f10d2fe618c9fae8c8b4f0d83fb9a2bbe1e67872eec42a1d78"}
Jul 09 03:56:35.256835 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.256393    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"a9b7aefc5e9c3d2e52deba72d34c520d05db765d67f8f7c77f656d056970ec76"}
Jul 09 03:56:35.265072 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.265023    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-stnzz" podStartSLOduration=5.060439738 podStartE2EDuration="24.264985715s" totalImagesPullingTime="19.204545977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:35.26471938 +0000 UTC m=+24.731089080" watchObservedRunningTime="2026-07-09 03:56:35.264985715 +0000 UTC m=+24.731355388"
Jul 09 03:56:35.320243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:35.320064    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 03:56:36.039952 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.039810    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T03:56:35.320236514Z","UUID":"a4a13893-d5c2-4347-9b33-b7cc47204841","Handler":null,"Name":"","Endpoint":""}
Jul 09 03:56:36.041853 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.041567    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 03:56:36.041853 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.041617    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 03:56:36.260371 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.260343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj" event={"ID":"3a68283e-638f-44b2-b957-f7df1d2e07aa","Type":"ContainerStarted","Data":"be7d01b96924892507062434cacd1bdc08ca7dce5692f8bbbcace9e48207828e"}
Jul 09 03:56:36.537496 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.537458    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:36.538375 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:36.538344    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:37.064811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.064782    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:37.064811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.064795    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:37.065177 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.064790    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:37.065177 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:37.064906    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:37.065177 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:37.065047    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:37.065177 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:37.065135    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:37.265144 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.265116    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 03:56:37.265800 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.265516    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"ce2cd1127e935e8f9ea0ddfa41be16c2418f042a43d453a2f57720dba37538b4"}
Jul 09 03:56:37.267559 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.267528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj" event={"ID":"3a68283e-638f-44b2-b957-f7df1d2e07aa","Type":"ContainerStarted","Data":"5c62a543af872b0d60d5d59c0683c760c84945926f0637889c957d3ddd1c3e57"}
Jul 09 03:56:37.284361 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:37.284304    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mfgj" podStartSLOduration=4.7218645729999995 podStartE2EDuration="26.284285879s" totalImagesPullingTime="21.562421306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:37.284203375 +0000 UTC m=+26.750573049" watchObservedRunningTime="2026-07-09 03:56:37.284285879 +0000 UTC m=+26.750655554"
Jul 09 03:56:39.064974 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:39.064934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:39.065714 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:39.065368    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:39.065714 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:39.065389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:39.065954 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:39.065855    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:39.066447 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:39.066423    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:39.066586 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:39.066546    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:39.664487 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:39.664303    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:39.665050 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:39.665036    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pv5gz"
Jul 09 03:56:40.279614 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.279581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 03:56:40.280076 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.280037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"7120d037a6251a2b4cf7f5b53782b6c900c435bd085ecc4d5758199e4608c6b9"}
Jul 09 03:56:40.280321 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.280294    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:40.280434 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.280370    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:40.280555 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.280539    2569 scope.go:117] "RemoveContainer" containerID="81b5df7126a49b24fe2f1925547ef8f67c1652fba448261f629568c0863c0fea"
Jul 09 03:56:40.282070 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.282047    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="408351f75f10da65594be7e856c8dcef0a8ec5ba607fdb4a61fa7f8ee0517ba4" exitCode=0
Jul 09 03:56:40.282185 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.282127    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"408351f75f10da65594be7e856c8dcef0a8ec5ba607fdb4a61fa7f8ee0517ba4"}
Jul 09 03:56:40.299256 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:40.299229    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:41.066632 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.066596    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:41.066786 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.066686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:41.066786 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.066738    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:41.066850 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.066783    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:41.066881 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.066850    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:41.067016 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.066971    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:41.289793 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.289555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 03:56:41.290407 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.290374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" event={"ID":"6931612f-076e-43df-9711-a683369a3dd4","Type":"ContainerStarted","Data":"2dc33928a7c118512dd137c8a4fbf419f6f5aa5bdcdcf8ba3b9e46c8caa598d8"}
Jul 09 03:56:41.290744 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.290723    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:41.310110 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.310080    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:56:41.319954 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.319852    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6" podStartSLOduration=11.094509548 podStartE2EDuration="30.319836451s" totalImagesPullingTime="19.225326903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:41.319366959 +0000 UTC m=+30.785736635" watchObservedRunningTime="2026-07-09 03:56:41.319836451 +0000 UTC m=+30.786206126"
Jul 09 03:56:41.631639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.631559    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2nqr"]
Jul 09 03:56:41.631780 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.631681    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:41.631821 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.631781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:41.634600 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.634565    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2kzm8"]
Jul 09 03:56:41.634764 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.634689    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:41.634850 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.634823    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:41.635189 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.635166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86g8s"]
Jul 09 03:56:41.635283 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:41.635268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:41.635391 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:41.635372    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:42.294624 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:42.294586    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="a8cb07c1395806e191904f341599ea735deb3e93f6379a3d8e282bd41c446546" exitCode=0
Jul 09 03:56:42.295186 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:42.294679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"a8cb07c1395806e191904f341599ea735deb3e93f6379a3d8e282bd41c446546"}
Jul 09 03:56:43.064470 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:43.064434    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:43.064605 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:43.064434    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:43.064640 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:43.064594    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:43.064640 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:43.064628    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:43.301349 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:43.301314    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="e8b7222b80e5d529b7f9c31e2ff151b1783499466adf65a70ccfc3740ed8f2fd" exitCode=0
Jul 09 03:56:43.302078 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:43.301390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"e8b7222b80e5d529b7f9c31e2ff151b1783499466adf65a70ccfc3740ed8f2fd"}
Jul 09 03:56:43.990177 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:43.990143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:44.065798 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:44.065711    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:44.065961 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.065868    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:44.077870 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:44.077836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:44.727857 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:44.727816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:44.728345 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.727934    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:44.728345 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.727991    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs podName:2ef85f6b-3690-4562-b909-9a3611217316 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:16.727975781 +0000 UTC m=+66.194345438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs") pod "network-metrics-daemon-86g8s" (UID: "2ef85f6b-3690-4562-b909-9a3611217316") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:44.828456 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:44.828414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:44.828635 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.828578    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:44.828678 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.828646    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret podName:dbe200bd-0abe-4b23-92a8-f4676f1550c7 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:16.828630977 +0000 UTC m=+66.295000633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret") pod "global-pull-secret-syncer-r2nqr" (UID: "dbe200bd-0abe-4b23-92a8-f4676f1550c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:44.929217 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:44.929180    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:44.929441 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.929313    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:44.929441 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.929332    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:44.929441 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.929343    2569 projected.go:196] Error preparing data for projected volume kube-api-access-g9vlq for pod openshift-network-diagnostics/network-check-target-2kzm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:44.929441 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:44.929398    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq podName:9adea244-06b3-4451-a603-f891fb769961 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:16.929381163 +0000 UTC m=+66.395750815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9vlq" (UniqueName: "kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq") pod "network-check-target-2kzm8" (UID: "9adea244-06b3-4451-a603-f891fb769961") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:45.064711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:45.064623    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:45.064876 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:45.064630    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:45.064876 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:45.064759    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2nqr" podUID="dbe200bd-0abe-4b23-92a8-f4676f1550c7"
Jul 09 03:56:45.064876 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:45.064815    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86g8s" podUID="2ef85f6b-3690-4562-b909-9a3611217316"
Jul 09 03:56:46.064483 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.064433    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:46.064881 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:46.064560    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kzm8" podUID="9adea244-06b3-4451-a603-f891fb769961"
Jul 09 03:56:46.795534 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.795346    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-172.ec2.internal" event="NodeReady"
Jul 09 03:56:46.795710 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.795645    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 03:56:46.826261 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.826223    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dc577894b-fn6jn"]
Jul 09 03:56:46.829320 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.829270    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.831613 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.831591    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8plw\""
Jul 09 03:56:46.831762 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.831586    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 03:56:46.831762 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.831586    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 03:56:46.831762 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.831679    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 03:56:46.836725 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.836697    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 03:56:46.838807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.838585    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4ps84"]
Jul 09 03:56:46.844331 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.844282    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:46.844507 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.844115    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rb6c2"]
Jul 09 03:56:46.847087 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.847054    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 03:56:46.847379 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.847358    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q7njr\""
Jul 09 03:56:46.847573 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.847558    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 03:56:46.848389 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.848366    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dc577894b-fn6jn"]
Jul 09 03:56:46.848540 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.848496    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:46.850432 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.850405    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ps84"]
Jul 09 03:56:46.850614 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.850599    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 03:56:46.850614 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.850603    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pxg4s\""
Jul 09 03:56:46.850916 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.850891    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 03:56:46.851066 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.850981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 03:56:46.855430 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.855400    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rb6c2"]
Jul 09 03:56:46.945123 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ft7d\" (UniqueName: \"kubernetes.io/projected/bbcba894-86a9-407b-b8cf-1c8d024d1938-kube-api-access-7ft7d\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-cert\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbcba894-86a9-407b-b8cf-1c8d024d1938-config-volume\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc82z\" (UniqueName: \"kubernetes.io/projected/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-kube-api-access-lc82z\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmw5h\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:46.945639 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:46.945490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcba894-86a9-407b-b8cf-1c8d024d1938-tmp-dir\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.046535 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046535 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046535 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046535 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc82z\" (UniqueName: \"kubernetes.io/projected/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-kube-api-access-lc82z\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmw5h\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcba894-86a9-407b-b8cf-1c8d024d1938-tmp-dir\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.046872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ft7d\" (UniqueName: \"kubernetes.io/projected/bbcba894-86a9-407b-b8cf-1c8d024d1938-kube-api-access-7ft7d\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.047237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.047237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-cert\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:47.047237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbcba894-86a9-407b-b8cf-1c8d024d1938-config-volume\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.047237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.046986    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.047440 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.047315    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.047588 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.047556    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:56:47.047588 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.047585    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:56:47.047811 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.047638    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:47.047811 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.047657    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:47.547637432 +0000 UTC m=+37.014007090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:56:47.047811 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.047688    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:47.54767223 +0000 UTC m=+37.014041883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:47.047811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.047561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbcba894-86a9-407b-b8cf-1c8d024d1938-config-volume\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.048015 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.047965    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcba894-86a9-407b-b8cf-1c8d024d1938-tmp-dir\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.048383 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.048358    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.051958 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.051930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.051958 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.051941    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-cert\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:47.052200 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.051941    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.056807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.056771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ft7d\" (UniqueName: \"kubernetes.io/projected/bbcba894-86a9-407b-b8cf-1c8d024d1938-kube-api-access-7ft7d\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.057023 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.056985    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmw5h\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.057671 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.057646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc82z\" (UniqueName: \"kubernetes.io/projected/a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7-kube-api-access-lc82z\") pod \"ingress-canary-rb6c2\" (UID: \"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7\") " pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:47.058393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.058365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.064249 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.064201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:56:47.064441 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.064201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:56:47.066882 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.066852    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 03:56:47.067585 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.066890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6dbl\""
Jul 09 03:56:47.067585 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.066852    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 03:56:47.167563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.167528    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rb6c2"
Jul 09 03:56:47.550442 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.550399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:47.550661 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:47.550474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:47.550661 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.550591    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:56:47.550661 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.550603    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:47.550661 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.550615    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:56:47.550878 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.550687    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:48.550663324 +0000 UTC m=+38.017032995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:56:47.550878 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:47.550706    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:48.55069682 +0000 UTC m=+38.017066473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:48.064287 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.064242    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:56:48.066902 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.066873    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 03:56:48.067689 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.067661    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 03:56:48.067689 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.067673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmr74\""
Jul 09 03:56:48.559897 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.559860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:48.560074 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.559919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:48.560074 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:48.560036    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:56:48.560074 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:48.560052    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:56:48.560074 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:48.560065    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:48.560207 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:48.560118    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:50.560100496 +0000 UTC m=+40.026470150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:56:48.560207 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:48.560140    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:50.560134662 +0000 UTC m=+40.026504314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:48.732748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:48.732711    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rb6c2"]
Jul 09 03:56:48.776784 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:56:48.776743    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1691833_5c1a_4418_b9b5_ca3cb4d3d8a7.slice/crio-90668e9197ad5f576495480acc143150f624a9bccdbed9cf16b7c926ab4b7e55 WatchSource:0}: Error finding container 90668e9197ad5f576495480acc143150f624a9bccdbed9cf16b7c926ab4b7e55: Status 404 returned error can't find the container with id 90668e9197ad5f576495480acc143150f624a9bccdbed9cf16b7c926ab4b7e55
Jul 09 03:56:49.321685 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:49.321418    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="5ce6671e1d4fd2db0db71bd1a1869c6d2983080d57dac85ee13b8e035711acbd" exitCode=0
Jul 09 03:56:49.322104 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:49.321477    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"5ce6671e1d4fd2db0db71bd1a1869c6d2983080d57dac85ee13b8e035711acbd"}
Jul 09 03:56:49.323497 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:49.323471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rb6c2" event={"ID":"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7","Type":"ContainerStarted","Data":"90668e9197ad5f576495480acc143150f624a9bccdbed9cf16b7c926ab4b7e55"}
Jul 09 03:56:50.330554 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:50.330506    2569 generic.go:356] "Generic (PLEG): container finished" podID="abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8" containerID="adf3ea5fb5932e8aa5f9e8e4152130ec4b00c9f86e9d4ab2edfe9f5352fbde35" exitCode=0
Jul 09 03:56:50.331144 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:50.330586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerDied","Data":"adf3ea5fb5932e8aa5f9e8e4152130ec4b00c9f86e9d4ab2edfe9f5352fbde35"}
Jul 09 03:56:50.577670 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:50.577626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:50.577876 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:50.577692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:50.577876 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:50.577800    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:56:50.577876 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:50.577811    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:50.577876 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:50.577827    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:56:50.578123 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:50.577900    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.577876439 +0000 UTC m=+44.044246095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:50.578123 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:50.577920    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.577910209 +0000 UTC m=+44.044279868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:56:51.100083 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.100050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:51.200914 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.200883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:51.336657 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.336560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" event={"ID":"abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8","Type":"ContainerStarted","Data":"f61e685931772f7641285d62ef8832ae7bb495edb8452a191376d7dc9de1ff10"}
Jul 09 03:56:51.363222 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.363160    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b2s9b" podStartSLOduration=8.664953876 podStartE2EDuration="40.363143694s" totalImagesPullingTime="31.698189818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:51.359091049 +0000 UTC m=+40.825460749" watchObservedRunningTime="2026-07-09 03:56:51.363143694 +0000 UTC m=+40.829513369"
Jul 09 03:56:51.478254 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.478220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:51.535021 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:51.534959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.011752 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.011648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.064393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.064356    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.340606 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.340494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rb6c2" event={"ID":"a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7","Type":"ContainerStarted","Data":"f7abd6de5346104608bddb8eb42935761a050855efde9719f6f4c380630604bc"}
Jul 09 03:56:52.354649 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.354619    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.361141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.361085    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rb6c2" podStartSLOduration=3.67320546 podStartE2EDuration="6.361069363s" totalImagesPullingTime="2.687863903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:52.360779327 +0000 UTC m=+41.827149005" watchObservedRunningTime="2026-07-09 03:56:52.361069363 +0000 UTC m=+41.827439037"
Jul 09 03:56:52.454144 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.454094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.622640 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.622520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.675675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.675643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.842032 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.841964    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:52.895833 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:52.895709    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.052656 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.052623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.114136 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.114106    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.192319 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.192287    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-57r96"]
Jul 09 03:56:53.215026 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.214978    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57r96"]
Jul 09 03:56:53.215171 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.215105    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.217442 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.217418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 03:56:53.217585 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.217419    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 03:56:53.218265 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.218243    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 03:56:53.218376 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.218267    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 03:56:53.218376 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.218342    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwlqq\""
Jul 09 03:56:53.226028 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.225979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.280209 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.280171    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.298353 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.298316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36c06bc7-7dfc-40ae-912a-36585b17d45c-crio-socket\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.298353 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.298353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36c06bc7-7dfc-40ae-912a-36585b17d45c-data-volume\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.298586 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.298372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4rnx\" (UniqueName: \"kubernetes.io/projected/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-api-access-z4rnx\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.298586 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.298410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.298586 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.298434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.354316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.354286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.399848 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.399806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.399848 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.399852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.399925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36c06bc7-7dfc-40ae-912a-36585b17d45c-crio-socket\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.399943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36c06bc7-7dfc-40ae-912a-36585b17d45c-data-volume\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.399945    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.399963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4rnx\" (UniqueName: \"kubernetes.io/projected/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-api-access-z4rnx\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.400060    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:53.9000382 +0000 UTC m=+43.366407855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.400141 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.400084    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.400344 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.400151    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:53.900131857 +0000 UTC m=+43.366501520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.400344 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.400154    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36c06bc7-7dfc-40ae-912a-36585b17d45c-crio-socket\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.400344 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.400327    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36c06bc7-7dfc-40ae-912a-36585b17d45c-data-volume\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.412248 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.412210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4rnx\" (UniqueName: \"kubernetes.io/projected/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-api-access-z4rnx\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.471809 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.471722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.524409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.524370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:53.904729 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.904616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.904729 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:53.904665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:53.904985 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.904753    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.904985 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.904757    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.904985 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.904828    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.904808302 +0000 UTC m=+44.371177956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.904985 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:53.904951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.904936498 +0000 UTC m=+44.371306150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.609919 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.609872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.610068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.610083    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.610112    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.610180    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:02.610158308 +0000 UTC m=+52.076527966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.610255    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:54.610407 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.610334    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:02.61030889 +0000 UTC m=+52.076678562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:54.620092 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.620058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:54.719817 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.719780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:54.912141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.912049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:54.912141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.912096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:54.912327 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.912174    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:54.912327 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.912215    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.912327 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.912241    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:56.912224466 +0000 UTC m=+46.378594120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:54.912327 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:54.912272    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:56:56.912259159 +0000 UTC m=+46.378628811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.972438 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:54.972408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:55.044822 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:55.044793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:55.168390 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:55.168368    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qqmz6_2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870/dns-node-resolver/0.log"
Jul 09 03:56:55.821608 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:55.821577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:56:56.371213 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:56.371182    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6xvc_56739082-4b8c-4add-96e4-77de7ec950c4/node-ca/0.log"
Jul 09 03:56:56.926809 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:56.926764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:56.927303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:56.926894    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:56:56.927303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:56.926929    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:56.927303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:56.926991    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:56.927303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:56.926997    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:57:00.926980991 +0000 UTC m=+50.393350647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:56.927303 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:56:56.927081    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:57:00.927063403 +0000 UTC m=+50.393433070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:57.169923 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:57.169887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rb6c2_a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7/serve-healthcheck-canary/0.log"
Jul 09 03:56:58.708064 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:56:58.707998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.209325 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.209288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.310262 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.310230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.411748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.411696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.514548 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.514432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.569542 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.569507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:00.958699 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.958662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:00.958869 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:00.958709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:00.958869 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:00.958786    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:57:00.958869 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:00.958804    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:00.958869 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:00.958847    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:57:08.958833597 +0000 UTC m=+58.425203254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:00.958869 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:00.958860    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:57:08.958854005 +0000 UTC m=+58.425223661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : configmap "kube-rbac-proxy" not found
Jul 09 03:57:01.305555 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:01.305458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:01.702458 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:01.702423    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:01.903638 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:01.903595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:02.073744 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:02.073662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:02.503722 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:02.503691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:02.674433 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:02.674382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") pod \"image-registry-dc577894b-fn6jn\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") " pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:57:02.674664 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:02.674453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:02.674664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:02.674536    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 03:57:02.674664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:02.674554    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc577894b-fn6jn: secret "image-registry-tls" not found
Jul 09 03:57:02.674664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:02.674603    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:57:02.674664 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:02.674606    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls podName:75fcb83c-8832-4525-b508-273618fd1f24 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:18.674592126 +0000 UTC m=+68.140961778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls") pod "image-registry-dc577894b-fn6jn" (UID: "75fcb83c-8832-4525-b508-273618fd1f24") : secret "image-registry-tls" not found
Jul 09 03:57:02.674868 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:02.674682    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls podName:bbcba894-86a9-407b-b8cf-1c8d024d1938 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:18.674652374 +0000 UTC m=+68.141022034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls") pod "dns-default-4ps84" (UID: "bbcba894-86a9-407b-b8cf-1c8d024d1938") : secret "dns-default-metrics-tls" not found
Jul 09 03:57:02.908964 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:02.908873    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:03.103058 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:03.102997    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:03.300669 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:03.300632    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:03.901737 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:03.901704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:04.309199 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:04.309161    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:04.364124 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:04.364090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:04.708287 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:04.708258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:04.902019 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:04.901972    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:05.103832 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:05.103737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:05.154876 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:05.154846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:05.504440 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:05.504399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:05.604699 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:05.604666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:05.656155 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:05.656110    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:06.099817 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:06.099779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:06.154775 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:06.154742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:06.303041 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:06.302981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:06.501415 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:06.501382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:06.903061 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:06.902979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:07.103674 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:07.103641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:07.515599 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:07.515564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:07.574567 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:07.574505    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:07.906154 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:07.906051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:08.507779 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:08.507746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:08.702388 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:08.702348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:09.021072 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:09.020997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:09.021263 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:09.021147    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:09.021263 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:09.021157    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:09.021263 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:09.021218    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls podName:36c06bc7-7dfc-40ae-912a-36585b17d45c nodeName:}" failed. No retries permitted until 2026-07-09 03:57:25.021202135 +0000 UTC m=+74.487571788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57r96" (UID: "36c06bc7-7dfc-40ae-912a-36585b17d45c") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:09.021682 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:09.021663    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36c06bc7-7dfc-40ae-912a-36585b17d45c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:09.099733 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:09.099698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:09.704411 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:09.704327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:10.301066 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:10.301033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:10.504867 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:10.504833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:10.714750 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:10.714703    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:10.912426 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:10.912382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:13.312669 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:13.312637    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6wj6"
Jul 09 03:57:15.611169 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.611137    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"]
Jul 09 03:57:15.613650 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.613633    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"]
Jul 09 03:57:15.613776 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.613756    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.615588 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.615565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.615964 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.615948    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 03:57:15.615964 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.615955    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6r8km\""
Jul 09 03:57:15.616124 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.615959    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 03:57:15.616124 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.615955    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 03:57:15.616727 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.616714    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 03:57:15.617341 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.617328    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 03:57:15.623340 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.623320    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"]
Jul 09 03:57:15.634844 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.634822    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"]
Jul 09 03:57:15.672380 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.672348    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a337ab54-d7c2-4420-8e56-a704756c9ded-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.672579 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.672393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swxtp\" (UniqueName: \"kubernetes.io/projected/a337ab54-d7c2-4420-8e56-a704756c9ded-kube-api-access-swxtp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.672579 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.672460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a337ab54-d7c2-4420-8e56-a704756c9ded-tmp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.672579 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.672496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9sq5\" (UniqueName: \"kubernetes.io/projected/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-kube-api-access-c9sq5\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.672579 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.672558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.680057 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.680024    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dc577894b-fn6jn"]
Jul 09 03:57:15.680238 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:15.680219    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-dc577894b-fn6jn" podUID="75fcb83c-8832-4525-b508-273618fd1f24"
Jul 09 03:57:15.706392 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.706354    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd4b99868-4hzvn"]
Jul 09 03:57:15.708350 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.708330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.723604 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.723569    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd4b99868-4hzvn"]
Jul 09 03:57:15.755767 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.755736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:15.773872 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.773843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a337ab54-d7c2-4420-8e56-a704756c9ded-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.773960 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.773881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-bound-sa-token\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.773960 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.773914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a337ab54-d7c2-4420-8e56-a704756c9ded-tmp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.773960 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.773935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-trusted-ca\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774094 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.773987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-registry-tls\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774094 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee4442d9-78c3-4920-9b23-98efd3982181-ca-trust-extracted\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774094 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-registry-certificates\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774215 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swxtp\" (UniqueName: \"kubernetes.io/projected/a337ab54-d7c2-4420-8e56-a704756c9ded-kube-api-access-swxtp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.774257 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9sq5\" (UniqueName: \"kubernetes.io/projected/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-kube-api-access-c9sq5\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.774301 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-image-registry-private-configuration\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774350 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.774350 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a337ab54-d7c2-4420-8e56-a704756c9ded-tmp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.774447 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-installation-pull-secrets\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.774447 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.774399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2tp\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-kube-api-access-kt2tp\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.776807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.776776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a337ab54-d7c2-4420-8e56-a704756c9ded-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.776917 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.776832    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.786185 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.786157    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9sq5\" (UniqueName: \"kubernetes.io/projected/b41dc13e-bce9-47a4-8bb4-7515fc0892f5-kube-api-access-c9sq5\") pod \"managed-serviceaccount-addon-agent-578586c8c4-wc4tb\" (UID: \"b41dc13e-bce9-47a4-8bb4-7515fc0892f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.786308 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.786291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swxtp\" (UniqueName: \"kubernetes.io/projected/a337ab54-d7c2-4420-8e56-a704756c9ded-kube-api-access-swxtp\") pod \"klusterlet-addon-workmgr-578f6bf57b-mq6lg\" (UID: \"a337ab54-d7c2-4420-8e56-a704756c9ded\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:15.822780 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.822746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:15.875617 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee4442d9-78c3-4920-9b23-98efd3982181-ca-trust-extracted\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.875617 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-registry-certificates\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.875811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-image-registry-private-configuration\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.875811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-installation-pull-secrets\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.875811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2tp\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-kube-api-access-kt2tp\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.875811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-bound-sa-token\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.876047 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-trusted-ca\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.876260 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.876215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-registry-tls\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.876359 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.875996    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee4442d9-78c3-4920-9b23-98efd3982181-ca-trust-extracted\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.876539 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.876518    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-registry-certificates\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.876941 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.876916    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee4442d9-78c3-4920-9b23-98efd3982181-trusted-ca\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.878218 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.878200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-installation-pull-secrets\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.878297 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.878218    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee4442d9-78c3-4920-9b23-98efd3982181-image-registry-private-configuration\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.878581 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.878564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-registry-tls\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.906863 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.906820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-bound-sa-token\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.909186 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.909161    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2tp\" (UniqueName: \"kubernetes.io/projected/ee4442d9-78c3-4920-9b23-98efd3982181-kube-api-access-kt2tp\") pod \"image-registry-5bd4b99868-4hzvn\" (UID: \"ee4442d9-78c3-4920-9b23-98efd3982181\") " pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:15.921519 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.921492    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:15.930635 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.930608    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"
Jul 09 03:57:15.936254 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:15.936235    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:16.017783 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.017748    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:16.018300 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.018281    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8plw\""
Jul 09 03:57:16.027424 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.027402    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:16.073024 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.072980    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb"]
Jul 09 03:57:16.076483 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:16.076459    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb41dc13e_bce9_47a4_8bb4_7515fc0892f5.slice/crio-3b7665ee3d4e4dc40bff768ebebffb4107a378195870dbbf25f2822445c36e9d WatchSource:0}: Error finding container 3b7665ee3d4e4dc40bff768ebebffb4107a378195870dbbf25f2822445c36e9d: Status 404 returned error can't find the container with id 3b7665ee3d4e4dc40bff768ebebffb4107a378195870dbbf25f2822445c36e9d
Jul 09 03:57:16.086546 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.086467    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"]
Jul 09 03:57:16.092339 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:16.092304    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda337ab54_d7c2_4420_8e56_a704756c9ded.slice/crio-69475a2f3a215073420853ce5b30188a7a5b23f24b9eab6309a0274c7f5d9bf5 WatchSource:0}: Error finding container 69475a2f3a215073420853ce5b30188a7a5b23f24b9eab6309a0274c7f5d9bf5: Status 404 returned error can't find the container with id 69475a2f3a215073420853ce5b30188a7a5b23f24b9eab6309a0274c7f5d9bf5
Jul 09 03:57:16.162170 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.162147    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd4b99868-4hzvn"]
Jul 09 03:57:16.164398 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:16.164373    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4442d9_78c3_4920_9b23_98efd3982181.slice/crio-6479c75e4cdb9f4f5bd688515303088e5975fd9bd08ee74eadd08494f44b69bb WatchSource:0}: Error finding container 6479c75e4cdb9f4f5bd688515303088e5975fd9bd08ee74eadd08494f44b69bb: Status 404 returned error can't find the container with id 6479c75e4cdb9f4f5bd688515303088e5975fd9bd08ee74eadd08494f44b69bb
Jul 09 03:57:16.402469 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.402427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn" event={"ID":"ee4442d9-78c3-4920-9b23-98efd3982181","Type":"ContainerStarted","Data":"c5dadd3ad5d4353819da1ad15d723c6efc1d7416357cb6c88d1a76dfd62474dd"}
Jul 09 03:57:16.402675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.402522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:16.402675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.402559    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn" event={"ID":"ee4442d9-78c3-4920-9b23-98efd3982181","Type":"ContainerStarted","Data":"6479c75e4cdb9f4f5bd688515303088e5975fd9bd08ee74eadd08494f44b69bb"}
Jul 09 03:57:16.403694 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.403660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb" event={"ID":"b41dc13e-bce9-47a4-8bb4-7515fc0892f5","Type":"ContainerStarted","Data":"3b7665ee3d4e4dc40bff768ebebffb4107a378195870dbbf25f2822445c36e9d"}
Jul 09 03:57:16.404800 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.404779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg" event={"ID":"a337ab54-d7c2-4420-8e56-a704756c9ded","Type":"ContainerStarted","Data":"69475a2f3a215073420853ce5b30188a7a5b23f24b9eab6309a0274c7f5d9bf5"}
Jul 09 03:57:16.404897 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.404816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:57:16.412431 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.412378    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:57:16.440051 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.439960    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn" podStartSLOduration=1.439938825 podStartE2EDuration="1.439938825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:16.422476713 +0000 UTC m=+65.888846412" watchObservedRunningTime="2026-07-09 03:57:16.439938825 +0000 UTC m=+65.906308489"
Jul 09 03:57:16.481675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481639    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.481870 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.481870 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481710    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.481870 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.481870 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481762    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmw5h\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.482119 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481868    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.482119 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.481959    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted\") pod \"75fcb83c-8832-4525-b508-273618fd1f24\" (UID: \"75fcb83c-8832-4525-b508-273618fd1f24\") "
Jul 09 03:57:16.482119 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.482059    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:57:16.482266 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.482211    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:57:16.482956 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.482931    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-registry-certificates\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.483109 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.482962    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75fcb83c-8832-4525-b508-273618fd1f24-trusted-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.483278 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.483252    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 03:57:16.484449 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.484422    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:57:16.484449 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.484433    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h" (OuterVolumeSpecName: "kube-api-access-nmw5h") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "kube-api-access-nmw5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:57:16.484571 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.484463    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:57:16.484571 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.484516    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "75fcb83c-8832-4525-b508-273618fd1f24" (UID: "75fcb83c-8832-4525-b508-273618fd1f24"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:57:16.583537 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.583495    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75fcb83c-8832-4525-b508-273618fd1f24-ca-trust-extracted\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.583537 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.583529    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-installation-pull-secrets\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.583537 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.583541    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-bound-sa-token\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.583767 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.583553    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmw5h\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-kube-api-access-nmw5h\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.583767 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.583565    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75fcb83c-8832-4525-b508-273618fd1f24-image-registry-private-configuration\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:16.784967 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.784925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:57:16.787126 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.787106    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 03:57:16.798162 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.798136    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef85f6b-3690-4562-b909-9a3611217316-metrics-certs\") pod \"network-metrics-daemon-86g8s\" (UID: \"2ef85f6b-3690-4562-b909-9a3611217316\") " pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:57:16.886020 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.885973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:57:16.888116 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.888098    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 03:57:16.899166 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.899147    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbe200bd-0abe-4b23-92a8-f4676f1550c7-original-pull-secret\") pod \"global-pull-secret-syncer-r2nqr\" (UID: \"dbe200bd-0abe-4b23-92a8-f4676f1550c7\") " pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:57:16.986922 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.986466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:57:16.988852 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.988826    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 03:57:17.000044 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:16.999813    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 03:57:17.011707 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.011646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9vlq\" (UniqueName: \"kubernetes.io/projected/9adea244-06b3-4451-a603-f891fb769961-kube-api-access-g9vlq\") pod \"network-check-target-2kzm8\" (UID: \"9adea244-06b3-4451-a603-f891fb769961\") " pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:57:17.081103 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.080816    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6dbl\""
Jul 09 03:57:17.084682 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.084654    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2nqr"
Jul 09 03:57:17.088997 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.088975    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86g8s"
Jul 09 03:57:17.179371 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.178979    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmr74\""
Jul 09 03:57:17.186128 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.186062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:57:17.284269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.283738    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2nqr"]
Jul 09 03:57:17.297152 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:17.297120    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe200bd_0abe_4b23_92a8_f4676f1550c7.slice/crio-d237d03c15a0e5c963b637acfefe1cb788fd4f06c249234d884b7b77ba4328a9 WatchSource:0}: Error finding container d237d03c15a0e5c963b637acfefe1cb788fd4f06c249234d884b7b77ba4328a9: Status 404 returned error can't find the container with id d237d03c15a0e5c963b637acfefe1cb788fd4f06c249234d884b7b77ba4328a9
Jul 09 03:57:17.311644 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.311567    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86g8s"]
Jul 09 03:57:17.315572 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:17.315541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef85f6b_3690_4562_b909_9a3611217316.slice/crio-5df7464ae03397015ff08ca881669b45fd9c096380faa0c1424e71179bfa02ef WatchSource:0}: Error finding container 5df7464ae03397015ff08ca881669b45fd9c096380faa0c1424e71179bfa02ef: Status 404 returned error can't find the container with id 5df7464ae03397015ff08ca881669b45fd9c096380faa0c1424e71179bfa02ef
Jul 09 03:57:17.380280 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.380197    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2kzm8"]
Jul 09 03:57:17.387973 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:17.387932    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adea244_06b3_4451_a603_f891fb769961.slice/crio-44a66489463165137ed40fdeabf8d912f9913801893b6f677f19faaaee07fdab WatchSource:0}: Error finding container 44a66489463165137ed40fdeabf8d912f9913801893b6f677f19faaaee07fdab: Status 404 returned error can't find the container with id 44a66489463165137ed40fdeabf8d912f9913801893b6f677f19faaaee07fdab
Jul 09 03:57:17.412227 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.412184    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2kzm8" event={"ID":"9adea244-06b3-4451-a603-f891fb769961","Type":"ContainerStarted","Data":"44a66489463165137ed40fdeabf8d912f9913801893b6f677f19faaaee07fdab"}
Jul 09 03:57:17.413886 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.413853    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2nqr" event={"ID":"dbe200bd-0abe-4b23-92a8-f4676f1550c7","Type":"ContainerStarted","Data":"d237d03c15a0e5c963b637acfefe1cb788fd4f06c249234d884b7b77ba4328a9"}
Jul 09 03:57:17.415803 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.415775    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86g8s" event={"ID":"2ef85f6b-3690-4562-b909-9a3611217316","Type":"ContainerStarted","Data":"5df7464ae03397015ff08ca881669b45fd9c096380faa0c1424e71179bfa02ef"}
Jul 09 03:57:17.416919 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.416389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc577894b-fn6jn"
Jul 09 03:57:17.451623 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.451576    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dc577894b-fn6jn"]
Jul 09 03:57:17.455890 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.455831    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dc577894b-fn6jn"]
Jul 09 03:57:17.492483 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.490854    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75fcb83c-8832-4525-b508-273618fd1f24-registry-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:57:17.673026 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.672975    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:17.772988 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:17.772954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:18.702899 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:18.702861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:18.713300 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:18.713231    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbcba894-86a9-407b-b8cf-1c8d024d1938-metrics-tls\") pod \"dns-default-4ps84\" (UID: \"bbcba894-86a9-407b-b8cf-1c8d024d1938\") " pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:18.962365 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:18.962287    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q7njr\""
Jul 09 03:57:18.970328 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:18.970292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:19.070157 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:19.070120    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75fcb83c-8832-4525-b508-273618fd1f24" path="/var/lib/kubelet/pods/75fcb83c-8832-4525-b508-273618fd1f24/volumes"
Jul 09 03:57:21.015452 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.015414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:21.118400 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.118370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:21.168424 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.168394    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"]
Jul 09 03:57:21.171487 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.171457    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:21.173788 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.173765    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 03:57:21.174419 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.174379    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h6vtf\""
Jul 09 03:57:21.178242 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.178219    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"]
Jul 09 03:57:21.185428 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.185403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:21.224960 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.224919    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0e35796-dc81-4651-a623-f9b7031d6af8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-724vk\" (UID: \"c0e35796-dc81-4651-a623-f9b7031d6af8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:21.242390 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.242350    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:21.325669 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.325569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0e35796-dc81-4651-a623-f9b7031d6af8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-724vk\" (UID: \"c0e35796-dc81-4651-a623-f9b7031d6af8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:21.328463 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.328433    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0e35796-dc81-4651-a623-f9b7031d6af8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-724vk\" (UID: \"c0e35796-dc81-4651-a623-f9b7031d6af8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:21.483603 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:21.483571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:22.668029 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:22.667976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:22.722930 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:22.722895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:24.108444 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:24.108367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:24.160538 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:24.160497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:24.622445 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:24.622411    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ps84"]
Jul 09 03:57:24.640744 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:24.640713    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"]
Jul 09 03:57:24.732863 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:24.732785    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcba894_86a9_407b_b8cf_1c8d024d1938.slice/crio-0cab18accd6f3d333c42cc03c4bc57290c0ac0698393d009f093714d07f70f56 WatchSource:0}: Error finding container 0cab18accd6f3d333c42cc03c4bc57290c0ac0698393d009f093714d07f70f56: Status 404 returned error can't find the container with id 0cab18accd6f3d333c42cc03c4bc57290c0ac0698393d009f093714d07f70f56
Jul 09 03:57:25.056845 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.056758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:25.059257 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.059232    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36c06bc7-7dfc-40ae-912a-36585b17d45c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57r96\" (UID: \"36c06bc7-7dfc-40ae-912a-36585b17d45c\") " pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:25.327549 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.327462    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwlqq\""
Jul 09 03:57:25.336198 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.336163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57r96"
Jul 09 03:57:25.443989 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.443228    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2kzm8" event={"ID":"9adea244-06b3-4451-a603-f891fb769961","Type":"ContainerStarted","Data":"639e2d287bb4a8cb6a97d1c3c6d4571e0aa70d5be0ed70d3ca1c13b47528a026"}
Jul 09 03:57:25.443989 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.443931    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:57:25.446166 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.446083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2nqr" event={"ID":"dbe200bd-0abe-4b23-92a8-f4676f1550c7","Type":"ContainerStarted","Data":"04c25d06772f591a0c1dedd47388874921d4b1b5614116b2c5886cc8e3b1d504"}
Jul 09 03:57:25.448948 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.448774    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86g8s" event={"ID":"2ef85f6b-3690-4562-b909-9a3611217316","Type":"ContainerStarted","Data":"79a80e525f32b143b20ed9f06b968b3ea00370e2cbee3f9f8c653d94ed95aeaf"}
Jul 09 03:57:25.448948 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.448826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86g8s" event={"ID":"2ef85f6b-3690-4562-b909-9a3611217316","Type":"ContainerStarted","Data":"8ed06b7952b1d5152594b42b3ae63c45a617d40b56effc83fed855f40306ef62"}
Jul 09 03:57:25.450827 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.450803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb" event={"ID":"b41dc13e-bce9-47a4-8bb4-7515fc0892f5","Type":"ContainerStarted","Data":"2a521e7757b82d8d622331ac776af9ce13877a08a5631ab9753b19b357018b58"}
Jul 09 03:57:25.456425 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.456391    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk" event={"ID":"c0e35796-dc81-4651-a623-f9b7031d6af8","Type":"ContainerStarted","Data":"9ceac20f04ccf7ade92a0acd1ccdb78b5c36ff652f25e5f9e59dc194b1c4408e"}
Jul 09 03:57:25.459404 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.459356    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2kzm8" podStartSLOduration=67.375438489 podStartE2EDuration="1m14.459340681s" totalImagesPullingTime="7.083902192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.458078114 +0000 UTC m=+74.924447808" watchObservedRunningTime="2026-07-09 03:57:25.459340681 +0000 UTC m=+74.925710337"
Jul 09 03:57:25.460245 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.460215    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg" event={"ID":"a337ab54-d7c2-4420-8e56-a704756c9ded","Type":"ContainerStarted","Data":"2b674572aa34906ee418ac2abb6d2bd51f0cac331b0a7fc74d036a75ee58e8e5"}
Jul 09 03:57:25.460855 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.460807    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:25.462475 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.462453    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg"
Jul 09 03:57:25.462927 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.462904    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ps84" event={"ID":"bbcba894-86a9-407b-b8cf-1c8d024d1938","Type":"ContainerStarted","Data":"0cab18accd6f3d333c42cc03c4bc57290c0ac0698393d009f093714d07f70f56"}
Jul 09 03:57:25.473854 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.473783    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-86g8s" podStartSLOduration=67.329506115 podStartE2EDuration="1m14.473765507s" totalImagesPullingTime="7.144259392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.472167705 +0000 UTC m=+74.938537405" watchObservedRunningTime="2026-07-09 03:57:25.473765507 +0000 UTC m=+74.940135184"
Jul 09 03:57:25.487590 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.487535    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r2nqr" podStartSLOduration=67.038194956 podStartE2EDuration="1m14.487516109s" totalImagesPullingTime="7.449321153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.486918749 +0000 UTC m=+74.953288437" watchObservedRunningTime="2026-07-09 03:57:25.487516109 +0000 UTC m=+74.953885785"
Jul 09 03:57:25.498960 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.498141    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57r96"]
Jul 09 03:57:25.500669 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.500440    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578586c8c4-wc4tb" podStartSLOduration=2.113825493 podStartE2EDuration="10.500420423s" totalImagesPullingTime="8.38659493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.499482092 +0000 UTC m=+74.965851766" watchObservedRunningTime="2026-07-09 03:57:25.500420423 +0000 UTC m=+74.966790101"
Jul 09 03:57:25.501490 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:25.501459    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c06bc7_7dfc_40ae_912a_36585b17d45c.slice/crio-e82c9bbe423a208afd7099e3f1682220810e8f7eb69a4c62b11a2e26c54a8318 WatchSource:0}: Error finding container e82c9bbe423a208afd7099e3f1682220810e8f7eb69a4c62b11a2e26c54a8318: Status 404 returned error can't find the container with id e82c9bbe423a208afd7099e3f1682220810e8f7eb69a4c62b11a2e26c54a8318
Jul 09 03:57:25.558598 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.558556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:25.617942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:25.617861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:26.468530 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:26.468442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57r96" event={"ID":"36c06bc7-7dfc-40ae-912a-36585b17d45c","Type":"ContainerStarted","Data":"e82c9bbe423a208afd7099e3f1682220810e8f7eb69a4c62b11a2e26c54a8318"}
Jul 09 03:57:26.640342 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:26.640311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:26.741718 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:26.741633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:27.474141 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.474101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk" event={"ID":"c0e35796-dc81-4651-a623-f9b7031d6af8","Type":"ContainerStarted","Data":"5adb258861dc4c1ec8370a9b8c246d427b138d84160f9878ec6a201e6d92d2d7"}
Jul 09 03:57:27.474612 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.474165    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:27.476349 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.476324    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ps84" event={"ID":"bbcba894-86a9-407b-b8cf-1c8d024d1938","Type":"ContainerStarted","Data":"ba5064dc5d1ba91c9143b848a7a24941b4a2b88c66dc896b4a5df686dcb1b5ad"}
Jul 09 03:57:27.476495 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.476364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ps84" event={"ID":"bbcba894-86a9-407b-b8cf-1c8d024d1938","Type":"ContainerStarted","Data":"21cba9630e2155f5d31ab8c2477a4f1126140e5490f59641cfc8074689e8fb6e"}
Jul 09 03:57:27.479347 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.479323    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk"
Jul 09 03:57:27.492090 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.492031    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f6bf57b-mq6lg" podStartSLOduration=4.119192415 podStartE2EDuration="12.491988776s" totalImagesPullingTime="8.372796361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.51590259 +0000 UTC m=+74.982272264" watchObservedRunningTime="2026-07-09 03:57:27.491988776 +0000 UTC m=+76.958358453"
Jul 09 03:57:27.493083 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.493038    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-724vk" podStartSLOduration=4.675408618 podStartE2EDuration="6.493021875s" totalImagesPullingTime="1.817613257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:27.491502204 +0000 UTC m=+76.957871902" watchObservedRunningTime="2026-07-09 03:57:27.493021875 +0000 UTC m=+76.959391548"
Jul 09 03:57:27.515392 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:27.515338    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4ps84" podStartSLOduration=39.692748025 podStartE2EDuration="41.515322616s" totalImagesPullingTime="1.822574591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:27.514425884 +0000 UTC m=+76.980795586" watchObservedRunningTime="2026-07-09 03:57:27.515322616 +0000 UTC m=+76.981692293"
Jul 09 03:57:28.186809 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.186719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:28.229064 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.229028    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"]
Jul 09 03:57:28.242097 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.242067    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"]
Jul 09 03:57:28.242233 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.242201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.244929 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.244885    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 03:57:28.244929 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.244923    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 03:57:28.245175 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.245060    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 03:57:28.245175 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.244894    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 03:57:28.245942 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.245919    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 03:57:28.246134 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.246028    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vx894\""
Jul 09 03:57:28.261779 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.261742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:28.279830 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.279789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr986\" (UniqueName: \"kubernetes.io/projected/6bfd27ab-0ba1-4605-a6fd-1140e989222c-kube-api-access-zr986\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.280018 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.279852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.280018 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.279885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bfd27ab-0ba1-4605-a6fd-1140e989222c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.280018 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.279931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.318413 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.318381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:28.380427 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.380387    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.381265 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.380824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bfd27ab-0ba1-4605-a6fd-1140e989222c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.381265 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.380900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.381265 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.380923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr986\" (UniqueName: \"kubernetes.io/projected/6bfd27ab-0ba1-4605-a6fd-1140e989222c-kube-api-access-zr986\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.381739 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.381709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bfd27ab-0ba1-4605-a6fd-1140e989222c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.383336 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.383311    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.383583 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.383561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bfd27ab-0ba1-4605-a6fd-1140e989222c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.390890 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.390837    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr986\" (UniqueName: \"kubernetes.io/projected/6bfd27ab-0ba1-4605-a6fd-1140e989222c-kube-api-access-zr986\") pod \"prometheus-operator-567f7b8b7c-dlvsj\" (UID: \"6bfd27ab-0ba1-4605-a6fd-1140e989222c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:28.480896 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.480820    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:28.554367 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:28.554257    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"
Jul 09 03:57:29.927059 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:29.927028    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj"]
Jul 09 03:57:29.931388 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:29.931358    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfd27ab_0ba1_4605_a6fd_1140e989222c.slice/crio-e0c8ad7e02204cf4c13e2feb3b5c05a22a3db42ce550b8ca174facaf407a62e1 WatchSource:0}: Error finding container e0c8ad7e02204cf4c13e2feb3b5c05a22a3db42ce550b8ca174facaf407a62e1: Status 404 returned error can't find the container with id e0c8ad7e02204cf4c13e2feb3b5c05a22a3db42ce550b8ca174facaf407a62e1
Jul 09 03:57:30.113202 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.113099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.205765 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.205734    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.304566 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.304508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.404427 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.404346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.488700 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.488666    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj" event={"ID":"6bfd27ab-0ba1-4605-a6fd-1140e989222c","Type":"ContainerStarted","Data":"e0c8ad7e02204cf4c13e2feb3b5c05a22a3db42ce550b8ca174facaf407a62e1"}
Jul 09 03:57:30.490067 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.490023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57r96" event={"ID":"36c06bc7-7dfc-40ae-912a-36585b17d45c","Type":"ContainerStarted","Data":"f2254bb7c99ccbf05f5efb335ff1c22674110d74c2b9ee43b8187b32239f1752"}
Jul 09 03:57:30.766908 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.766847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.867104 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.867070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:30.969794 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:30.969756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:31.029260 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:31.029173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:31.363462 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:31.363268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:31.464424 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:31.464381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:31.495674 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:31.495645    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57r96" event={"ID":"36c06bc7-7dfc-40ae-912a-36585b17d45c","Type":"ContainerStarted","Data":"62a14adbf11db9a8bb263660c1910b2df079bbf6839b3a7071701482c529a1e9"}
Jul 09 03:57:31.773552 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:31.773525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:32.009366 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.009329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:32.171364 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.171327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:32.371119 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.371086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:32.502651 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.502552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj" event={"ID":"6bfd27ab-0ba1-4605-a6fd-1140e989222c","Type":"ContainerStarted","Data":"2adcfd6aadd82c22488f3bec080521863e1e3aa3eaa3b70ddf634392197a7f8c"}
Jul 09 03:57:32.502651 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.502634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj" event={"ID":"6bfd27ab-0ba1-4605-a6fd-1140e989222c","Type":"ContainerStarted","Data":"d1d49565de851cee3ab07fb4d049a549c7ba0c16a91c9ae1732b85ef16441500"}
Jul 09 03:57:32.519675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.519612    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dlvsj" podStartSLOduration=2.969390351 podStartE2EDuration="4.519592797s" totalImagesPullingTime="1.550202446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:32.517985163 +0000 UTC m=+81.984354861" watchObservedRunningTime="2026-07-09 03:57:32.519592797 +0000 UTC m=+81.985962471"
Jul 09 03:57:32.991681 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:32.991639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:33.196299 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:33.196263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:33.302817 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:33.302714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:33.508190 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:33.508153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57r96" event={"ID":"36c06bc7-7dfc-40ae-912a-36585b17d45c","Type":"ContainerStarted","Data":"2612de156cf8dd923d246313a8e5faeb179478f9eeb4d92837cb2fd355250762"}
Jul 09 03:57:33.525202 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:33.524997    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-57r96" podStartSLOduration=32.967432999 podStartE2EDuration="40.524979831s" totalImagesPullingTime="7.557546832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:33.524801769 +0000 UTC m=+82.991171454" watchObservedRunningTime="2026-07-09 03:57:33.524979831 +0000 UTC m=+82.991349541"
Jul 09 03:57:34.335204 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.335150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.436508 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.436443    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.553612 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.553569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.610917 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.610825    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g7v8t"]
Jul 09 03:57:34.615318 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.615288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.617545 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.617516    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6gkkq\""
Jul 09 03:57:34.617712 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.617561    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 03:57:34.617712 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.617616    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 03:57:34.617834 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.617768    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 03:57:34.642368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.642331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.711938 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.711907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.731564 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731534    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-wtmp\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731670 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-root\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731670 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731603    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfn84\" (UniqueName: \"kubernetes.io/projected/5b64fba4-b63a-434e-9243-b7fb4019885d-kube-api-access-rfn84\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731670 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-metrics-client-ca\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731783 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-tls\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731783 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731753    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-textfile\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731783 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-sys\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731890 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.731890 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.731831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.810748 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.810715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.832481 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832447    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-root\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfn84\" (UniqueName: \"kubernetes.io/projected/5b64fba4-b63a-434e-9243-b7fb4019885d-kube-api-access-rfn84\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-metrics-client-ca\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-tls\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-root\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-textfile\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-sys\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832668 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832699    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-sys\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832736    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-wtmp\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832890    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-wtmp\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.832991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.832988    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-textfile\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.833306 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.833282    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-metrics-client-ca\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.833371 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.833356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.835354 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.835320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-tls\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.835507 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.835400    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b64fba4-b63a-434e-9243-b7fb4019885d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.841363 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.841333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfn84\" (UniqueName: \"kubernetes.io/projected/5b64fba4-b63a-434e-9243-b7fb4019885d-kube-api-access-rfn84\") pod \"node-exporter-g7v8t\" (UID: \"5b64fba4-b63a-434e-9243-b7fb4019885d\") " pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.924933 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.924905    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7v8t"
Jul 09 03:57:34.934584 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:34.934545    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:34.936874 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:34.936845    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b64fba4_b63a_434e_9243_b7fb4019885d.slice/crio-044d2b8084a89c44bed1588ba66a21c65a9d9debf1c74858877499f09144d1e3 WatchSource:0}: Error finding container 044d2b8084a89c44bed1588ba66a21c65a9d9debf1c74858877499f09144d1e3: Status 404 returned error can't find the container with id 044d2b8084a89c44bed1588ba66a21c65a9d9debf1c74858877499f09144d1e3
Jul 09 03:57:35.066405 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.066371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:35.166299 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.166264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:35.270289 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.270210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:35.516938 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.516897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7v8t" event={"ID":"5b64fba4-b63a-434e-9243-b7fb4019885d","Type":"ContainerStarted","Data":"044d2b8084a89c44bed1588ba66a21c65a9d9debf1c74858877499f09144d1e3"}
Jul 09 03:57:35.556446 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.556355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:35.650028 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.649973    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:35.651360 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.651333    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:57:35.655063 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.655038    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.657638 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.657581    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 03:57:35.657638 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.657582    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 03:57:35.657903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.657842    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 03:57:35.657973 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.657924    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 03:57:35.658135 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658108    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rkbzb\""
Jul 09 03:57:35.658243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658155    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 03:57:35.658243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658189    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 03:57:35.658243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658200    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 03:57:35.658490 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658473    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 03:57:35.658532 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.658481    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 03:57:35.669219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.668601    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:57:35.740102 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740102 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740127    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grvw\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740338 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740587 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740587 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740587 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.740587 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.740453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841210 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841210 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841422 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841422 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841422 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grvw\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841690 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:35.841645    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle podName:2794026f-f0c6-48ec-b12f-0730686611f9 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:36.341622773 +0000 UTC m=+85.807992442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9") : configmap references non-existent config key: ca-bundle.crt
Jul 09 03:57:35.841811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841859 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841911 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841869    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.841911 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.842028 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.841916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.842943 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.842909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.845189 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.845152    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.845319 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.845252    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.845319 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:35.845267    2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 03:57:35.845447 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:57:35.845340    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls podName:2794026f-f0c6-48ec-b12f-0730686611f9 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:36.345317553 +0000 UTC m=+85.811687207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9") : secret "alertmanager-main-tls" not found
Jul 09 03:57:35.845643 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.845595    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.846051 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.845992    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.846494 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.846472    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.846588 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.846500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.846720 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.846697    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.847296 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.847250    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.847922 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.847902    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:35.852841 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:35.852808    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grvw\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.082985 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.082958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:36.346916 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.346877    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.347142 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.346991    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.347728 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.347701    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.349500 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.349480    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.522137 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.522095    2569 generic.go:356] "Generic (PLEG): container finished" podID="5b64fba4-b63a-434e-9243-b7fb4019885d" containerID="e53df6f71dcc59267370643c729cc6aa649e0203e9b9895af6688a74042905dd" exitCode=0
Jul 09 03:57:36.522663 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.522147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7v8t" event={"ID":"5b64fba4-b63a-434e-9243-b7fb4019885d","Type":"ContainerDied","Data":"e53df6f71dcc59267370643c729cc6aa649e0203e9b9895af6688a74042905dd"}
Jul 09 03:57:36.592082 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.592046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:57:36.750549 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:36.750513    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:57:36.753881 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:36.753851    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2794026f_f0c6_48ec_b12f_0730686611f9.slice/crio-21cd363bb202914ad46d73dd1f4c2a8abce291e18b45d27d5ff8649494a32446 WatchSource:0}: Error finding container 21cd363bb202914ad46d73dd1f4c2a8abce291e18b45d27d5ff8649494a32446: Status 404 returned error can't find the container with id 21cd363bb202914ad46d73dd1f4c2a8abce291e18b45d27d5ff8649494a32446
Jul 09 03:57:37.422466 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.422432    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bd4b99868-4hzvn"
Jul 09 03:57:37.530968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.530922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7v8t" event={"ID":"5b64fba4-b63a-434e-9243-b7fb4019885d","Type":"ContainerStarted","Data":"164c6149f1481f2df3574175b4f1a31669c610f82e2925f7e840b606f5ea0dec"}
Jul 09 03:57:37.531427 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.530988    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7v8t" event={"ID":"5b64fba4-b63a-434e-9243-b7fb4019885d","Type":"ContainerStarted","Data":"5a0f10d94fc8b7ade514a2c20f5096397f50844d6655f2135529275469d970b2"}
Jul 09 03:57:37.532348 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.532317    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"21cd363bb202914ad46d73dd1f4c2a8abce291e18b45d27d5ff8649494a32446"}
Jul 09 03:57:37.538495 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.538429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:37.560260 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.560209    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g7v8t" podStartSLOduration=2.351428065 podStartE2EDuration="3.560192352s" totalImagesPullingTime="1.131589024s" totalInitContainerRuntime="77.175263ms" isStatefulPod=true podCreationTimestamp="2026-07-09 03:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:37.559057609 +0000 UTC m=+87.025427299" watchObservedRunningTime="2026-07-09 03:57:37.560192352 +0000 UTC m=+87.026562027"
Jul 09 03:57:37.607401 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.607365    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64494f98d9-6thdd"]
Jul 09 03:57:37.610856 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.610836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.613264 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613236    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 03:57:37.613416 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613304    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 03:57:37.613416 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613405    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 03:57:37.613528 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613493    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bv4bw\""
Jul 09 03:57:37.613563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613538    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 03:57:37.613563 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613554    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 03:57:37.613778 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.613764    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-atuai8tnr2f7c\""
Jul 09 03:57:37.622767 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.622739    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64494f98d9-6thdd"]
Jul 09 03:57:37.626484 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.626455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:37.759015 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.758900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759015 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.758941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-grpc-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759015 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.758983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.759106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.759162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhqv\" (UniqueName: \"kubernetes.io/projected/213ee34b-9521-490d-9a5b-34547c064245-kube-api-access-sfhqv\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.759218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213ee34b-9521-490d-9a5b-34547c064245-metrics-client-ca\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759349 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.759257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.759349 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.759280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.769060 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.769022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:37.860045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.859979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213ee34b-9521-490d-9a5b-34547c064245-metrics-client-ca\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860140    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-grpc-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860500 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860500 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860317    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhqv\" (UniqueName: \"kubernetes.io/projected/213ee34b-9521-490d-9a5b-34547c064245-kube-api-access-sfhqv\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.860920 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.860861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213ee34b-9521-490d-9a5b-34547c064245-metrics-client-ca\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.863856 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.863798    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.863989 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.863887    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.864073 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.863989    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-grpc-tls\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.864472 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.864448    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.864569 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.864531    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.864630 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.864613    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213ee34b-9521-490d-9a5b-34547c064245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.866258 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.866217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:37.869374 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.869348    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhqv\" (UniqueName: \"kubernetes.io/projected/213ee34b-9521-490d-9a5b-34547c064245-kube-api-access-sfhqv\") pod \"thanos-querier-64494f98d9-6thdd\" (UID: \"213ee34b-9521-490d-9a5b-34547c064245\") " pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:37.921972 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:37.921929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:38.126675 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.126645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64494f98d9-6thdd"]
Jul 09 03:57:38.178034 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:38.177984    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213ee34b_9521_490d_9a5b_34547c064245.slice/crio-471d386229eb4ef355ae6c04114043533bf48f572c46e556ed404696b10dfa88 WatchSource:0}: Error finding container 471d386229eb4ef355ae6c04114043533bf48f572c46e556ed404696b10dfa88: Status 404 returned error can't find the container with id 471d386229eb4ef355ae6c04114043533bf48f572c46e556ed404696b10dfa88
Jul 09 03:57:38.486533 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.486500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4ps84"
Jul 09 03:57:38.538152 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.538114    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025" exitCode=0
Jul 09 03:57:38.538623 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.538219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"}
Jul 09 03:57:38.539665 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.539643    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"471d386229eb4ef355ae6c04114043533bf48f572c46e556ed404696b10dfa88"}
Jul 09 03:57:38.987303 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.987268    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57997df9db-c84fd"]
Jul 09 03:57:38.990711 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.990677    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.993963    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.993992    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.994032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dtk8x\""
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.994039    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.993962    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 03:57:38.994246 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:38.993962    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6k7sev6cj89cd\""
Jul 09 03:57:39.002434 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.002400    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57997df9db-c84fd"]
Jul 09 03:57:39.070254 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-metrics-server-audit-profiles\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-tls\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f32131de-cb36-46e0-9815-245311cba16c-audit-log\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070531 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-client-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070531 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrr5\" (UniqueName: \"kubernetes.io/projected/f32131de-cb36-46e0-9815-245311cba16c-kube-api-access-hrrr5\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.070531 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.070504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-client-certs\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171791 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-client-certs\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171981 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171981 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-metrics-server-audit-profiles\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171981 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-tls\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171981 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171936    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f32131de-cb36-46e0-9815-245311cba16c-audit-log\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.171981 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-client-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.172278 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.171994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrr5\" (UniqueName: \"kubernetes.io/projected/f32131de-cb36-46e0-9815-245311cba16c-kube-api-access-hrrr5\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.172689 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.172650    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.172972 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.172945    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f32131de-cb36-46e0-9815-245311cba16c-audit-log\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.173384 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.173356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f32131de-cb36-46e0-9815-245311cba16c-metrics-server-audit-profiles\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.175053 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.175029    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-client-certs\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.175281 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.175260    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-secret-metrics-server-tls\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.175632 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.175611    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32131de-cb36-46e0-9815-245311cba16c-client-ca-bundle\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.179983 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.179954    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrr5\" (UniqueName: \"kubernetes.io/projected/f32131de-cb36-46e0-9815-245311cba16c-kube-api-access-hrrr5\") pod \"metrics-server-57997df9db-c84fd\" (UID: \"f32131de-cb36-46e0-9815-245311cba16c\") " pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.306920 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.306811    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:39.356828 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.356613    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:39.364019 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.363963    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"]
Jul 09 03:57:39.369551 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.369524    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.371910 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.371884    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-knnb2\""
Jul 09 03:57:39.372369 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.372166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 03:57:39.374556 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.374494    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"]
Jul 09 03:57:39.412896 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.412821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:39.476197 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.475339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cffd28a-108a-4a1f-a868-228d2e39004a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.476197 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.475458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjrdh\" (UniqueName: \"kubernetes.io/projected/0cffd28a-108a-4a1f-a868-228d2e39004a-kube-api-access-vjrdh\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.487152 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.487114    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57997df9db-c84fd"]
Jul 09 03:57:39.491457 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:39.491313    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32131de_cb36_46e0_9815_245311cba16c.slice/crio-c17c74dfa2151d503fec4a317306566fdbc709f716dc71b5957b1c6ee26e1c45 WatchSource:0}: Error finding container c17c74dfa2151d503fec4a317306566fdbc709f716dc71b5957b1c6ee26e1c45: Status 404 returned error can't find the container with id c17c74dfa2151d503fec4a317306566fdbc709f716dc71b5957b1c6ee26e1c45
Jul 09 03:57:39.546237 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.546199    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57997df9db-c84fd" event={"ID":"f32131de-cb36-46e0-9815-245311cba16c","Type":"ContainerStarted","Data":"c17c74dfa2151d503fec4a317306566fdbc709f716dc71b5957b1c6ee26e1c45"}
Jul 09 03:57:39.554369 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.554323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:39.576222 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.576124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjrdh\" (UniqueName: \"kubernetes.io/projected/0cffd28a-108a-4a1f-a868-228d2e39004a-kube-api-access-vjrdh\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.576222 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.576220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cffd28a-108a-4a1f-a868-228d2e39004a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.579506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.579466    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cffd28a-108a-4a1f-a868-228d2e39004a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.584232 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.584202    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjrdh\" (UniqueName: \"kubernetes.io/projected/0cffd28a-108a-4a1f-a868-228d2e39004a-kube-api-access-vjrdh\") pod \"monitoring-plugin-d5dcff7cf-fvk7s\" (UID: \"0cffd28a-108a-4a1f-a868-228d2e39004a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.683096 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.683059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:39.847046 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:39.846927    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"]
Jul 09 03:57:39.850152 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:39.850118    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cffd28a_108a_4a1f_a868_228d2e39004a.slice/crio-8f2b5b966c70167573566c008b16bff40e8c10777f4fba36b599d3e471639ade WatchSource:0}: Error finding container 8f2b5b966c70167573566c008b16bff40e8c10777f4fba36b599d3e471639ade: Status 404 returned error can't find the container with id 8f2b5b966c70167573566c008b16bff40e8c10777f4fba36b599d3e471639ade
Jul 09 03:57:40.128593 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:40.125024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:40.184193 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:40.184147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:40.555161 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:40.555047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s" event={"ID":"0cffd28a-108a-4a1f-a868-228d2e39004a","Type":"ContainerStarted","Data":"8f2b5b966c70167573566c008b16bff40e8c10777f4fba36b599d3e471639ade"}
Jul 09 03:57:40.848025 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:40.847912    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:41.186279 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:41.186241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:42.565770 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.565733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"26b1471d241a371a3d1d027d9c19eaa8e31b19e52efee2a23bbf3911e0a02bde"}
Jul 09 03:57:42.566199 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.565860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"32fb7f4a1ff40677b96a4751ef0f39258b38bac577ff93a2a7ab611eb3f9827b"}
Jul 09 03:57:42.566199 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.565909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"0049edc0712c50249e46397e6c2b24b9e28c488235429c7a8085da6b33f556ce"}
Jul 09 03:57:42.567477 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.567448    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57997df9db-c84fd" event={"ID":"f32131de-cb36-46e0-9815-245311cba16c","Type":"ContainerStarted","Data":"027a699bf71490a032f243d099dbe35bf0e6c9ecb70d611b9600868fb78727a2"}
Jul 09 03:57:42.570969 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.570944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"}
Jul 09 03:57:42.571091 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.571040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"}
Jul 09 03:57:42.571091 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.571085    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"}
Jul 09 03:57:42.571191 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.571123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"}
Jul 09 03:57:42.571191 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.571160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"}
Jul 09 03:57:42.584576 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:42.584512    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57997df9db-c84fd" podStartSLOduration=2.498912895 podStartE2EDuration="4.584490634s" totalImagesPullingTime="2.085577739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:42.583763691 +0000 UTC m=+92.050133385" watchObservedRunningTime="2026-07-09 03:57:42.584490634 +0000 UTC m=+92.050860309"
Jul 09 03:57:43.578101 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.578060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"f85ec01fdaed26de244908fdeb305dffdae5149bc9bcbfd83ff2ad6afd34cefc"}
Jul 09 03:57:43.578605 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.578159    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"f7e399d53b66c38f14b86ca2b4c484888317fb03087cba904c4ca5bb53348ac3"}
Jul 09 03:57:43.578605 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.578218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:43.578605 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.578283    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" event={"ID":"213ee34b-9521-490d-9a5b-34547c064245","Type":"ContainerStarted","Data":"d6406acceb79074f7f6e90cc1a35c553ea5adaa1231235d9574a887124eda058"}
Jul 09 03:57:43.579503 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.579481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s" event={"ID":"0cffd28a-108a-4a1f-a868-228d2e39004a","Type":"ContainerStarted","Data":"f46bb71cffdedfc65011e466097133421ac2acddd2312881a9761ebb91103045"}
Jul 09 03:57:43.579634 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.579619    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:43.583299 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.583271    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerStarted","Data":"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"}
Jul 09 03:57:43.585247 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.585231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s"
Jul 09 03:57:43.599524 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.599477    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd" podStartSLOduration=2.213199746 podStartE2EDuration="6.599461662s" totalImagesPullingTime="4.386261916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:43.597492558 +0000 UTC m=+93.063862233" watchObservedRunningTime="2026-07-09 03:57:43.599461662 +0000 UTC m=+93.065831336"
Jul 09 03:57:43.612208 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.612160    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fvk7s" podStartSLOduration=1.6176622090000001 podStartE2EDuration="4.612145889s" totalImagesPullingTime="2.99448368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:43.610931051 +0000 UTC m=+93.077300746" watchObservedRunningTime="2026-07-09 03:57:43.612145889 +0000 UTC m=+93.078515563"
Jul 09 03:57:43.636291 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:43.636234    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.466215525 podStartE2EDuration="8.636211723s" totalImagesPullingTime="5.154111694s" totalInitContainerRuntime="15.884504ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:43.634228001 +0000 UTC m=+93.100597697" watchObservedRunningTime="2026-07-09 03:57:43.636211723 +0000 UTC m=+93.102581399"
Jul 09 03:57:44.188062 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:44.188028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:46.163419 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:46.163377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:46.213592 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:46.213559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:47.590637 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:47.590593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:47.638101 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:47.638063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:49.123816 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:49.123782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:49.593663 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:49.593638    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64494f98d9-6thdd"
Jul 09 03:57:51.139363 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:51.139331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:51.199288 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:51.199248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:55.595787 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:55.595737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:55.649283 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:55.649221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:56.384392 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.384355    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 03:57:56.440865 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.440773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 03:57:56.440865 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.440859    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.443669 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.443642    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 03:57:56.443835 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.443659    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 03:57:56.443835 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.443790    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v5bpw\""
Jul 09 03:57:56.443835 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.443821    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 03:57:56.444025 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.443891    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 03:57:56.444421 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.444402    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 03:57:56.444543 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.444528    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 03:57:56.444811 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.444792    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 03:57:56.449202 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.449176    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 03:57:56.533567 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533567 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54t56\" (UniqueName: \"kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.533782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.634565 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.634565 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634513    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.634565 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635194 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635194 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54t56\" (UniqueName: \"kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635194 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635194 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.634700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635461 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.635435    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.635957 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.635934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.636121 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.635960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.636121 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.636077    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.637791 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.637766    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.637947 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.637931    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.642774 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.642745    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54t56\" (UniqueName: \"kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56\") pod \"console-668888d6b9-hzdlj\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") " pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.752159 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.752109    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:57:56.922895 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:56.922870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 03:57:56.925017 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:57:56.924978    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76352363_c08f_4266_adde_77748bc57d83.slice/crio-cbd927445dba610ebf729d13fdc9bb26b8ad6c2ea9998627e18e55f7e82c123a WatchSource:0}: Error finding container cbd927445dba610ebf729d13fdc9bb26b8ad6c2ea9998627e18e55f7e82c123a: Status 404 returned error can't find the container with id cbd927445dba610ebf729d13fdc9bb26b8ad6c2ea9998627e18e55f7e82c123a
Jul 09 03:57:57.479448 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:57.479415    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2kzm8"
Jul 09 03:57:57.643204 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:57.643169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668888d6b9-hzdlj" event={"ID":"76352363-c08f-4266-adde-77748bc57d83","Type":"ContainerStarted","Data":"cbd927445dba610ebf729d13fdc9bb26b8ad6c2ea9998627e18e55f7e82c123a"}
Jul 09 03:57:58.160197 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:58.160161    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:58.238459 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:58.238415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:58.291339 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:58.291278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:58.627779 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:58.627735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:57:59.307707 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:59.307658    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:57:59.308171 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:57:59.307738    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:58:00.656727 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:00.656641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668888d6b9-hzdlj" event={"ID":"76352363-c08f-4266-adde-77748bc57d83","Type":"ContainerStarted","Data":"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"}
Jul 09 03:58:00.672108 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:00.671983    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668888d6b9-hzdlj" podStartSLOduration=1.253304137 podStartE2EDuration="4.671963898s" totalImagesPullingTime="3.418659761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:58:00.671956699 +0000 UTC m=+110.138326438" watchObservedRunningTime="2026-07-09 03:58:00.671963898 +0000 UTC m=+110.138333572"
Jul 09 03:58:01.226810 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:01.226772    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:06.098288 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:06.098245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:06.198561 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:06.198527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:06.752899 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:06.752852    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:58:06.753124 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:06.752934    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:58:06.758461 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:06.758435    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:58:07.686588 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:07.686557    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 03:58:07.830586 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:07.830549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:07.887472 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:07.887445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:07.945330 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:07.945221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:19.313016 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:19.312980    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:58:19.317057 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:19.317033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57997df9db-c84fd"
Jul 09 03:58:21.098778 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:21.098734    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:21.148438 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:21.148380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:50.693841 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:50.693808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:50.744874 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:50.744840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:58:54.948464 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.948428    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:54.949399 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.949344    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-metric" containerID="cri-o://0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7" gracePeriod=120
Jul 09 03:58:54.949854 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.949830    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="prom-label-proxy" containerID="cri-o://1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd" gracePeriod=120
Jul 09 03:58:54.950288 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.950268    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-web" containerID="cri-o://2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381" gracePeriod=120
Jul 09 03:58:54.950483 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.950466    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy" containerID="cri-o://ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b" gracePeriod=120
Jul 09 03:58:54.950707 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.950691    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="config-reloader" containerID="cri-o://1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491" gracePeriod=120
Jul 09 03:58:54.952543 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:54.952511    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="alertmanager" containerID="cri-o://a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49" gracePeriod=120
Jul 09 03:58:55.869156 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869118    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd" exitCode=0
Jul 09 03:58:55.869156 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869145    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b" exitCode=0
Jul 09 03:58:55.869156 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869152    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491" exitCode=0
Jul 09 03:58:55.869156 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869157    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49" exitCode=0
Jul 09 03:58:55.869418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869184    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"}
Jul 09 03:58:55.869418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"}
Jul 09 03:58:55.869418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869269    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"}
Jul 09 03:58:55.869418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:55.869294    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"}
Jul 09 03:58:56.223907 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.223883    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:56.330776 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330746    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330776 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330779    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330797    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330837    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8grvw\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330861    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330900    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.330991 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.330952    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331033    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331071    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331097    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331123    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331159    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331269 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out\") pod \"2794026f-f0c6-48ec-b12f-0730686611f9\" (UID: \"2794026f-f0c6-48ec-b12f-0730686611f9\") "
Jul 09 03:58:56.331568 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331284    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:56.331568 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331384    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:56.331568 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331468    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.331568 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.331489    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2794026f-f0c6-48ec-b12f-0730686611f9-metrics-client-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.332541 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.332484    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 03:58:56.333883 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.333800    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.333883 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.333847    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.334418 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.334380    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume" (OuterVolumeSpecName: "config-volume") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.334765 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.334740    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw" (OuterVolumeSpecName: "kube-api-access-8grvw") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "kube-api-access-8grvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:58:56.335063 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.335041    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out" (OuterVolumeSpecName: "config-out") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 03:58:56.335620 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.335595    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.335736 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.335718    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.335974 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.335951    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:58:56.339855 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.339826    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.346335 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.346313    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config" (OuterVolumeSpecName: "web-config") pod "2794026f-f0c6-48ec-b12f-0730686611f9" (UID: "2794026f-f0c6-48ec-b12f-0730686611f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:56.432309 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432272    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432309 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432306    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-main-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432320    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-tls-assets\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432331    2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-config-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432343    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-alertmanager-main-db\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432378    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-web-config\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432389    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2794026f-f0c6-48ec-b12f-0730686611f9-config-out\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432399    2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-cluster-tls-config\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432411    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432424    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8grvw\" (UniqueName: \"kubernetes.io/projected/2794026f-f0c6-48ec-b12f-0730686611f9-kube-api-access-8grvw\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.432522 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.432436    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2794026f-f0c6-48ec-b12f-0730686611f9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 03:58:56.876163 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876075    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7" exitCode=0
Jul 09 03:58:56.876163 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876104    2569 generic.go:356] "Generic (PLEG): container finished" podID="2794026f-f0c6-48ec-b12f-0730686611f9" containerID="2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381" exitCode=0
Jul 09 03:58:56.876163 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876156    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:56.876414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"}
Jul 09 03:58:56.876414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"}
Jul 09 03:58:56.876414 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.876320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2794026f-f0c6-48ec-b12f-0730686611f9","Type":"ContainerDied","Data":"21cd363bb202914ad46d73dd1f4c2a8abce291e18b45d27d5ff8649494a32446"}
Jul 09 03:58:56.877044 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.877027    2569 scope.go:117] "RemoveContainer" containerID="1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"
Jul 09 03:58:56.885735 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.885719    2569 scope.go:117] "RemoveContainer" containerID="0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"
Jul 09 03:58:56.894238 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.894213    2569 scope.go:117] "RemoveContainer" containerID="ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"
Jul 09 03:58:56.900577 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.900552    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:56.902176 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.902139    2569 scope.go:117] "RemoveContainer" containerID="2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"
Jul 09 03:58:56.905155 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.905125    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:56.909873 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.909847    2569 scope.go:117] "RemoveContainer" containerID="1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"
Jul 09 03:58:56.917051 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.917035    2569 scope.go:117] "RemoveContainer" containerID="a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"
Jul 09 03:58:56.924783 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.924763    2569 scope.go:117] "RemoveContainer" containerID="5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"
Jul 09 03:58:56.930903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.930881    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:56.931346 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931329    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="init-config-reloader"
Jul 09 03:58:56.931393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931350    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="init-config-reloader"
Jul 09 03:58:56.931393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931367    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="prom-label-proxy"
Jul 09 03:58:56.931393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931375    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="prom-label-proxy"
Jul 09 03:58:56.931393 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931390    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-metric"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931398    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-metric"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931413    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="config-reloader"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931421    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="config-reloader"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931430    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-web"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931438    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-web"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931448    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931457    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931470    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="alertmanager"
Jul 09 03:58:56.931506 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931482    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="alertmanager"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931557    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-web"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931567    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931578    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="alertmanager"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931585    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="kube-rbac-proxy-metric"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931595    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="prom-label-proxy"
Jul 09 03:58:56.931747 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.931604    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" containerName="config-reloader"
Jul 09 03:58:56.933066 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933046    2569 scope.go:117] "RemoveContainer" containerID="1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"
Jul 09 03:58:56.933377 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.933357    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd\": container with ID starting with 1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd not found: ID does not exist" containerID="1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"
Jul 09 03:58:56.933438 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933387    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"} err="failed to get container status \"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd\": rpc error: code = NotFound desc = could not find container \"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd\": container with ID starting with 1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd not found: ID does not exist"
Jul 09 03:58:56.933438 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933420    2569 scope.go:117] "RemoveContainer" containerID="0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"
Jul 09 03:58:56.933673 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.933655    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7\": container with ID starting with 0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7 not found: ID does not exist" containerID="0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"
Jul 09 03:58:56.933723 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933679    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"} err="failed to get container status \"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7\": rpc error: code = NotFound desc = could not find container \"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7\": container with ID starting with 0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7 not found: ID does not exist"
Jul 09 03:58:56.933723 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933700    2569 scope.go:117] "RemoveContainer" containerID="ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"
Jul 09 03:58:56.933946 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.933930    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b\": container with ID starting with ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b not found: ID does not exist" containerID="ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"
Jul 09 03:58:56.934022 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933951    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"} err="failed to get container status \"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b\": rpc error: code = NotFound desc = could not find container \"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b\": container with ID starting with ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b not found: ID does not exist"
Jul 09 03:58:56.934022 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.933971    2569 scope.go:117] "RemoveContainer" containerID="2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"
Jul 09 03:58:56.934246 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.934223    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381\": container with ID starting with 2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381 not found: ID does not exist" containerID="2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"
Jul 09 03:58:56.934295 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934250    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"} err="failed to get container status \"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381\": rpc error: code = NotFound desc = could not find container \"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381\": container with ID starting with 2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381 not found: ID does not exist"
Jul 09 03:58:56.934295 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934263    2569 scope.go:117] "RemoveContainer" containerID="1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"
Jul 09 03:58:56.934513 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.934495    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491\": container with ID starting with 1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491 not found: ID does not exist" containerID="1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"
Jul 09 03:58:56.934583 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934516    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"} err="failed to get container status \"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491\": rpc error: code = NotFound desc = could not find container \"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491\": container with ID starting with 1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491 not found: ID does not exist"
Jul 09 03:58:56.934583 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934531    2569 scope.go:117] "RemoveContainer" containerID="a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"
Jul 09 03:58:56.934782 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.934767    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49\": container with ID starting with a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49 not found: ID does not exist" containerID="a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"
Jul 09 03:58:56.934826 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934785    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"} err="failed to get container status \"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49\": rpc error: code = NotFound desc = could not find container \"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49\": container with ID starting with a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49 not found: ID does not exist"
Jul 09 03:58:56.934826 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.934796    2569 scope.go:117] "RemoveContainer" containerID="5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"
Jul 09 03:58:56.935111 ip-10-0-143-172 kubenswrapper[2569]: E0709 03:58:56.935092    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025\": container with ID starting with 5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025 not found: ID does not exist" containerID="5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"
Jul 09 03:58:56.935170 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935116    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"} err="failed to get container status \"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025\": rpc error: code = NotFound desc = could not find container \"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025\": container with ID starting with 5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025 not found: ID does not exist"
Jul 09 03:58:56.935170 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935128    2569 scope.go:117] "RemoveContainer" containerID="1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"
Jul 09 03:58:56.935354 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935335    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd"} err="failed to get container status \"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd\": rpc error: code = NotFound desc = could not find container \"1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd\": container with ID starting with 1191d0e99cd84de971a6f471c03ab7cb6a965e5fe0cf37e48c9216849ed064bd not found: ID does not exist"
Jul 09 03:58:56.935404 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935357    2569 scope.go:117] "RemoveContainer" containerID="0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"
Jul 09 03:58:56.935583 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935565    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7"} err="failed to get container status \"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7\": rpc error: code = NotFound desc = could not find container \"0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7\": container with ID starting with 0efa2e85d0eac9cad23d4e23dd1ece206512e4646aa38f3832bb2efddf0f21d7 not found: ID does not exist"
Jul 09 03:58:56.935618 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935586    2569 scope.go:117] "RemoveContainer" containerID="ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"
Jul 09 03:58:56.935813 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935794    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b"} err="failed to get container status \"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b\": rpc error: code = NotFound desc = could not find container \"ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b\": container with ID starting with ea63a7d8f19e2eb79dea5d7decfa344593f0432747f3021e4f032fb92a20292b not found: ID does not exist"
Jul 09 03:58:56.935813 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.935812    2569 scope.go:117] "RemoveContainer" containerID="2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"
Jul 09 03:58:56.936034 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936014    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381"} err="failed to get container status \"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381\": rpc error: code = NotFound desc = could not find container \"2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381\": container with ID starting with 2be874515c8ab9cb2acd8b747809072b915f14eae0698235331377da42cde381 not found: ID does not exist"
Jul 09 03:58:56.936092 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936035    2569 scope.go:117] "RemoveContainer" containerID="1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"
Jul 09 03:58:56.936243 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936224    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491"} err="failed to get container status \"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491\": rpc error: code = NotFound desc = could not find container \"1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491\": container with ID starting with 1f42946103194bc8c5a61fe1d1274c99313a865347de784c65a63744707b9491 not found: ID does not exist"
Jul 09 03:58:56.936284 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936244    2569 scope.go:117] "RemoveContainer" containerID="a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"
Jul 09 03:58:56.936466 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936449    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49"} err="failed to get container status \"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49\": rpc error: code = NotFound desc = could not find container \"a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49\": container with ID starting with a3d7a0affe108e26e01decd0a6cc38779c2c63dc9be7110b60047782efbd7b49 not found: ID does not exist"
Jul 09 03:58:56.936533 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936467    2569 scope.go:117] "RemoveContainer" containerID="5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"
Jul 09 03:58:56.936672 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.936656    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025"} err="failed to get container status \"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025\": rpc error: code = NotFound desc = could not find container \"5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025\": container with ID starting with 5579abe3412301da45ee9a5fcca0f8d9737c2222742946eb3224a66450c82025 not found: ID does not exist"
Jul 09 03:58:56.937405 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.937390    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:56.939499 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.939483    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 03:58:56.939757 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.939743    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 03:58:56.939959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.939914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 03:58:56.939959 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.939914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 03:58:56.940111 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.939916    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rkbzb\""
Jul 09 03:58:56.940111 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.940035    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 03:58:56.940111 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.940066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 03:58:56.940334 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.940317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 03:58:56.940402 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.940317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 03:58:56.945313 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.945296    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 03:58:56.948297 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:56.948278    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:57.036978 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.036946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.036978 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.036985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56c9v\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-kube-api-access-56c9v\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037064    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037219 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.037368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.037334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.070391 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.070358    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2794026f-f0c6-48ec-b12f-0730686611f9" path="/var/lib/kubelet/pods/2794026f-f0c6-48ec-b12f-0730686611f9/volumes"
Jul 09 03:58:57.138534 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138534 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138534 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138764 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138764 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138764 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56c9v\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-kube-api-access-56c9v\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.138903 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.139134 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.138976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.139134 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.139039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.139134 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.139071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.139979 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.139627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.141585 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.141557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142049 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.141754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142049 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.141892    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142049 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.141962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142252 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142099    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142308 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142308 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142288    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142409 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142386    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70627548-0eb3-4d81-a394-60a18b8cb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142613 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142593    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.142751 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.142734    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.143982 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.143966    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70627548-0eb3-4d81-a394-60a18b8cb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.146442 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.146420    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56c9v\" (UniqueName: \"kubernetes.io/projected/70627548-0eb3-4d81-a394-60a18b8cb68c-kube-api-access-56c9v\") pod \"alertmanager-main-0\" (UID: \"70627548-0eb3-4d81-a394-60a18b8cb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.247165 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.247129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 03:58:57.389271 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.389245    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 03:58:57.391696 ip-10-0-143-172 kubenswrapper[2569]: W0709 03:58:57.391667    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70627548_0eb3_4d81_a394_60a18b8cb68c.slice/crio-97b14c1497da76163ced96cf10a70552224e8978db83e8195ab73a3810cf1bcb WatchSource:0}: Error finding container 97b14c1497da76163ced96cf10a70552224e8978db83e8195ab73a3810cf1bcb: Status 404 returned error can't find the container with id 97b14c1497da76163ced96cf10a70552224e8978db83e8195ab73a3810cf1bcb
Jul 09 03:58:57.882497 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.882460    2569 generic.go:356] "Generic (PLEG): container finished" podID="70627548-0eb3-4d81-a394-60a18b8cb68c" containerID="85bffefda53a6532812c71a3ac1ffb72e205ef89e4cef2892de2d4100ade1c68" exitCode=0
Jul 09 03:58:57.882497 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.882503    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerDied","Data":"85bffefda53a6532812c71a3ac1ffb72e205ef89e4cef2892de2d4100ade1c68"}
Jul 09 03:58:57.882760 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:57.882558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"97b14c1497da76163ced96cf10a70552224e8978db83e8195ab73a3810cf1bcb"}
Jul 09 03:58:58.889631 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889596    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"1d079d8ecdbe68c39d3591d80ced01fa2a8fd74ad006d9b36d57103c9aff9303"}
Jul 09 03:58:58.890045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"240a09c30c864024dcf5b9e2cb9716ab8310f22732be4a7721603d2cf71f8cd0"}
Jul 09 03:58:58.890045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"769691e3d1d2c1991e2510b6df33c7340e2a4e30b6a6e999d9c25b8e0f04dbf2"}
Jul 09 03:58:58.890045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"379f31f0d39acad6e039a05c094cfa41e57e93fb70239070ad3d34427468119c"}
Jul 09 03:58:58.890045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889736    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"cd0e4f2d3473fd58c817f3e2af7cb52b912a0f51c77a2ed86305d21e1867a38f"}
Jul 09 03:58:58.890045 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.889758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70627548-0eb3-4d81-a394-60a18b8cb68c","Type":"ContainerStarted","Data":"275b19b7e362ac7db9877aa6b183a2c04b97d4471e7d5e5b5a8f53d079ddb7f6"}
Jul 09 03:58:58.917367 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:58:58.917306    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.901713842 podStartE2EDuration="2.917288748s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.574906ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:58:58.915323129 +0000 UTC m=+168.381692807" watchObservedRunningTime="2026-07-09 03:58:58.917288748 +0000 UTC m=+168.383658423"
Jul 09 03:59:02.653249 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:02.653158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:02.706368 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:02.706333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:06.106083 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:06.106048    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:06.206749 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:06.206710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:07.799350 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:07.799307    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:24.326427 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:24.326386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:24.422968 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:24.422918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:30.345113 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:30.345075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:40.693617 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:40.693581    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 03:59:40.793028 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:40.791329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:40.850844 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:40.850810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:40.902292 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:40.902260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:50.992947 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:50.992910    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:51.779860 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:51.779822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:54.597815 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:54.597773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:54.698724 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:54.698688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:56.064413 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:56.064371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:56.157316 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:56.157281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:56.826182 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:56.826151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:56.922873 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:56.922839    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:59.028840 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:59.028811    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 03:59:59.238282 ip-10-0-143-172 kubenswrapper[2569]: I0709 03:59:59.238247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:01.462155 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:01.462121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:01.782851 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:01.782782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:04.640526 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:04.640489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:05.134533 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:05.134496    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:05.334864 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:05.334825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:05.714092 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:05.714049    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-668888d6b9-hzdlj" podUID="76352363-c08f-4266-adde-77748bc57d83" containerName="console" containerID="cri-o://134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1" gracePeriod=15
Jul 09 04:00:05.963056 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:05.963033    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 04:00:06.038223 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038152    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038223 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038190    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038223 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038215    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038464 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038237    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038464 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038464 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038372    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038464 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038414    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54t56\" (UniqueName: \"kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56\") pod \"76352363-c08f-4266-adde-77748bc57d83\" (UID: \"76352363-c08f-4266-adde-77748bc57d83\") "
Jul 09 04:00:06.038671 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038582    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca" (OuterVolumeSpecName: "service-ca") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:00:06.038757 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038728    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:00:06.038757 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038741    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:00:06.038959 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.038735    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config" (OuterVolumeSpecName: "console-config") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:00:06.040678 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.040656    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:00:06.040771 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.040718    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:00:06.040824 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.040799    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56" (OuterVolumeSpecName: "kube-api-access-54t56") pod "76352363-c08f-4266-adde-77748bc57d83" (UID: "76352363-c08f-4266-adde-77748bc57d83"). InnerVolumeSpecName "kube-api-access-54t56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:00:06.139273 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139240    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139273 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139266    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-oauth-serving-cert\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139273 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139276    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-trusted-ca-bundle\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139273 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139285    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-oauth-config\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139293    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76352363-c08f-4266-adde-77748bc57d83-console-serving-cert\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139301    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76352363-c08f-4266-adde-77748bc57d83-console-config\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.139529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.139312    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54t56\" (UniqueName: \"kubernetes.io/projected/76352363-c08f-4266-adde-77748bc57d83-kube-api-access-54t56\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:00:06.149654 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.149626    2569 generic.go:356] "Generic (PLEG): container finished" podID="76352363-c08f-4266-adde-77748bc57d83" containerID="134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1" exitCode=0
Jul 09 04:00:06.149786 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.149670    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668888d6b9-hzdlj"
Jul 09 04:00:06.149786 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.149678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668888d6b9-hzdlj" event={"ID":"76352363-c08f-4266-adde-77748bc57d83","Type":"ContainerDied","Data":"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"}
Jul 09 04:00:06.149786 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.149720    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668888d6b9-hzdlj" event={"ID":"76352363-c08f-4266-adde-77748bc57d83","Type":"ContainerDied","Data":"cbd927445dba610ebf729d13fdc9bb26b8ad6c2ea9998627e18e55f7e82c123a"}
Jul 09 04:00:06.149786 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.149738    2569 scope.go:117] "RemoveContainer" containerID="134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"
Jul 09 04:00:06.158743 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.158726    2569 scope.go:117] "RemoveContainer" containerID="134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"
Jul 09 04:00:06.159038 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:00:06.158995    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1\": container with ID starting with 134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1 not found: ID does not exist" containerID="134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"
Jul 09 04:00:06.159096 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.159046    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1"} err="failed to get container status \"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1\": rpc error: code = NotFound desc = could not find container \"134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1\": container with ID starting with 134be217689d96a202ef99708c4388b6c1b6352c4cc017d5b57319bae45d48e1 not found: ID does not exist"
Jul 09 04:00:06.168943 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.168918    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 04:00:06.172483 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:06.172457    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668888d6b9-hzdlj"]
Jul 09 04:00:07.068841 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.068799    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76352363-c08f-4266-adde-77748bc57d83" path="/var/lib/kubelet/pods/76352363-c08f-4266-adde-77748bc57d83/volumes"
Jul 09 04:00:07.351798 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.351707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:07.397080 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.397049    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jwzd9"]
Jul 09 04:00:07.397361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.397349    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76352363-c08f-4266-adde-77748bc57d83" containerName="console"
Jul 09 04:00:07.397407 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.397363    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="76352363-c08f-4266-adde-77748bc57d83" containerName="console"
Jul 09 04:00:07.397439 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.397419    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="76352363-c08f-4266-adde-77748bc57d83" containerName="console"
Jul 09 04:00:07.402708 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.401623    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.404427 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.404408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 04:00:07.404534 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.404446    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 04:00:07.405341 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.405323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mjdhh\""
Jul 09 04:00:07.407901 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.407880    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jwzd9"]
Jul 09 04:00:07.552432 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.552391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.552432 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.552441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6njj\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-kube-api-access-f6njj\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.653458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.653387    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.653458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.653438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6njj\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-kube-api-access-f6njj\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.661717 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.661680    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.661884 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.661864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6njj\" (UniqueName: \"kubernetes.io/projected/baf4f79f-b010-4915-a4e2-bd8959db04c1-kube-api-access-f6njj\") pod \"cert-manager-55b4d954d5-jwzd9\" (UID: \"baf4f79f-b010-4915-a4e2-bd8959db04c1\") " pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.713425 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.713384    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jwzd9"
Jul 09 04:00:07.850434 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:07.850379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jwzd9"]
Jul 09 04:00:07.853171 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:07.853135    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaf4f79f_b010_4915_a4e2_bd8959db04c1.slice/crio-9f560ab4ac53fb9ca7074a05f8bb6171175b9100e5905ff18979e701c4e5ca3f WatchSource:0}: Error finding container 9f560ab4ac53fb9ca7074a05f8bb6171175b9100e5905ff18979e701c4e5ca3f: Status 404 returned error can't find the container with id 9f560ab4ac53fb9ca7074a05f8bb6171175b9100e5905ff18979e701c4e5ca3f
Jul 09 04:00:08.160096 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:08.160056    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jwzd9" event={"ID":"baf4f79f-b010-4915-a4e2-bd8959db04c1","Type":"ContainerStarted","Data":"9f560ab4ac53fb9ca7074a05f8bb6171175b9100e5905ff18979e701c4e5ca3f"}
Jul 09 04:00:12.927901 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:12.927858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:13.029383 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:13.029349    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:14.987266 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.987214    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"]
Jul 09 04:00:14.991210 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.991179    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:14.993767 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.993737    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q6bcr\""
Jul 09 04:00:14.993912 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.993888    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:00:14.994631 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.994612    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 04:00:14.999679 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:14.999649    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"]
Jul 09 04:00:15.120973 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.120935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhvr\" (UniqueName: \"kubernetes.io/projected/46c03f67-ec3e-4e7e-980f-06933ee07d55-kube-api-access-gbhvr\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.121165 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.121056    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c03f67-ec3e-4e7e-980f-06933ee07d55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.222153 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.222114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhvr\" (UniqueName: \"kubernetes.io/projected/46c03f67-ec3e-4e7e-980f-06933ee07d55-kube-api-access-gbhvr\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.222338 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.222311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c03f67-ec3e-4e7e-980f-06933ee07d55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.223383 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.223356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c03f67-ec3e-4e7e-980f-06933ee07d55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.231442 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.231416    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhvr\" (UniqueName: \"kubernetes.io/projected/46c03f67-ec3e-4e7e-980f-06933ee07d55-kube-api-access-gbhvr\") pod \"openshift-lws-operator-fd8ccff4c-dd28n\" (UID: \"46c03f67-ec3e-4e7e-980f-06933ee07d55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.302289 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.302203    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"
Jul 09 04:00:15.838399 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:15.838366    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n"]
Jul 09 04:00:15.842679 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:15.842639    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46c03f67_ec3e_4e7e_980f_06933ee07d55.slice/crio-b4e207bfef1243038d7a5163c0ffc5ffb43c679815501d0ae67d8c934e05620d WatchSource:0}: Error finding container b4e207bfef1243038d7a5163c0ffc5ffb43c679815501d0ae67d8c934e05620d: Status 404 returned error can't find the container with id b4e207bfef1243038d7a5163c0ffc5ffb43c679815501d0ae67d8c934e05620d
Jul 09 04:00:16.193920 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:16.193879    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n" event={"ID":"46c03f67-ec3e-4e7e-980f-06933ee07d55","Type":"ContainerStarted","Data":"b4e207bfef1243038d7a5163c0ffc5ffb43c679815501d0ae67d8c934e05620d"}
Jul 09 04:00:16.195371 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:16.195347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jwzd9" event={"ID":"baf4f79f-b010-4915-a4e2-bd8959db04c1","Type":"ContainerStarted","Data":"813223652d583bd4542e95580dfd7438ea89053d05c192ae095f53673cbc5d3f"}
Jul 09 04:00:16.211849 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:16.211795    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jwzd9" podStartSLOduration=1.288620796 podStartE2EDuration="9.211776163s" totalImagesPullingTime="7.923155367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:16.211280185 +0000 UTC m=+245.677649861" watchObservedRunningTime="2026-07-09 04:00:16.211776163 +0000 UTC m=+245.678145841"
Jul 09 04:00:19.209286 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:19.209241    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n" event={"ID":"46c03f67-ec3e-4e7e-980f-06933ee07d55","Type":"ContainerStarted","Data":"a382ab6b6534e64f0d7475ac7673187b14e10131bd7154222dbba6049ce3c1cf"}
Jul 09 04:00:19.225042 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:19.224967    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dd28n" podStartSLOduration=1.978747619 podStartE2EDuration="5.2249517s" totalImagesPullingTime="3.246204081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:19.22359951 +0000 UTC m=+248.689969189" watchObservedRunningTime="2026-07-09 04:00:19.2249517 +0000 UTC m=+248.691321374"
Jul 09 04:00:19.842533 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:19.842500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:19.960365 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:19.960333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:22.580664 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:22.580631    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:33.606310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:33.606211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:33.705916 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:33.705874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.232287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.232253    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.432435 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.432397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.530826 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.530727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.564884 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.564854    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"]
Jul 09 04:00:34.571459 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.571433    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.574034 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.573993    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 04:00:34.574189 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.574035    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 04:00:34.574293 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.574277    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 04:00:34.574355 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.574341    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 04:00:34.574441 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.574425    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mnmqz\""
Jul 09 04:00:34.580968 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.580938    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"]
Jul 09 04:00:34.682521 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.682484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qnd\" (UniqueName: \"kubernetes.io/projected/59308d0b-deb0-4d5e-9518-50988a37ce59-kube-api-access-22qnd\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.682963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.682546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.682963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.682566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.682963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.682665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.682963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.682697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.759533 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.759497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.783287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.783287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.783416 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qnd\" (UniqueName: \"kubernetes.io/projected/59308d0b-deb0-4d5e-9518-50988a37ce59-kube-api-access-22qnd\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.783499 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.783537 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.783885 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.783861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.785598 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.785570    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59308d0b-deb0-4d5e-9518-50988a37ce59-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.785789 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.785771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.785879 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.785861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59308d0b-deb0-4d5e-9518-50988a37ce59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.791388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.791368    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qnd\" (UniqueName: \"kubernetes.io/projected/59308d0b-deb0-4d5e-9518-50988a37ce59-kube-api-access-22qnd\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-zwqnv\" (UID: \"59308d0b-deb0-4d5e-9518-50988a37ce59\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:34.861447 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.861411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:34.882579 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:34.882546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:35.036548 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:35.036446    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"]
Jul 09 04:00:35.040697 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:35.040663    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59308d0b_deb0_4d5e_9518_50988a37ce59.slice/crio-f8fb094706593198a6aa992c177389fe93c0dd7c3a830970e1c9c209f53e1ebf WatchSource:0}: Error finding container f8fb094706593198a6aa992c177389fe93c0dd7c3a830970e1c9c209f53e1ebf: Status 404 returned error can't find the container with id f8fb094706593198a6aa992c177389fe93c0dd7c3a830970e1c9c209f53e1ebf
Jul 09 04:00:35.275950 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:35.275907    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv" event={"ID":"59308d0b-deb0-4d5e-9518-50988a37ce59","Type":"ContainerStarted","Data":"f8fb094706593198a6aa992c177389fe93c0dd7c3a830970e1c9c209f53e1ebf"}
Jul 09 04:00:35.639487 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:35.639442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:35.740352 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:35.740322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:39.296963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:39.296926    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv" event={"ID":"59308d0b-deb0-4d5e-9518-50988a37ce59","Type":"ContainerStarted","Data":"82a59f42f1983467f3eae4f2b6055e346980ccf0b74fe223f434d48e725de34b"}
Jul 09 04:00:40.302546 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:40.302512    2569 generic.go:356] "Generic (PLEG): container finished" podID="59308d0b-deb0-4d5e-9518-50988a37ce59" containerID="82a59f42f1983467f3eae4f2b6055e346980ccf0b74fe223f434d48e725de34b" exitCode=0
Jul 09 04:00:40.302965 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:40.302558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv" event={"ID":"59308d0b-deb0-4d5e-9518-50988a37ce59","Type":"ContainerDied","Data":"82a59f42f1983467f3eae4f2b6055e346980ccf0b74fe223f434d48e725de34b"}
Jul 09 04:00:41.064663 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:41.064567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:41.164860 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:41.164832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:41.308603 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:41.308573    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv" event={"ID":"59308d0b-deb0-4d5e-9518-50988a37ce59","Type":"ContainerStarted","Data":"c8311ec78cb863978fc041a6f5231c37b60eaa231f413c38bee272228d7d5e89"}
Jul 09 04:00:41.308957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:41.308642    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:41.330727 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:41.330628    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv" podStartSLOduration=2.207036969 podStartE2EDuration="7.330611187s" totalImagesPullingTime="4.119029686s" totalInitContainerRuntime="1.004544532s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:41.327978771 +0000 UTC m=+270.794348445" watchObservedRunningTime="2026-07-09 04:00:41.330611187 +0000 UTC m=+270.796980861"
Jul 09 04:00:43.230730 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:43.230693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:43.285949 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:43.285912    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:52.315165 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:52.315130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-zwqnv"
Jul 09 04:00:53.869492 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:53.869457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:53.978372 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:53.978336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:54.232817 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.232783    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:54.509040 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.508941    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"]
Jul 09 04:00:54.516916 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.516891    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.519319 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.519285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 04:00:54.519522 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.519507    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 04:00:54.519588 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.519521    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4z6hc\""
Jul 09 04:00:54.520221 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.520204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 04:00:54.520315 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.520235    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 04:00:54.526458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.526435    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"]
Jul 09 04:00:54.623408 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.623376    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqkg8"]
Jul 09 04:00:54.626561 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.626540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.626773 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.626749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:54.629333 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.629315    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 04:00:54.629437 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.629324    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ndvs6\""
Jul 09 04:00:54.638666 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.638643    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqkg8"]
Jul 09 04:00:54.667585 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.667554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9pj\" (UniqueName: \"kubernetes.io/projected/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-kube-api-access-sw9pj\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.667747 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.667598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tmp\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.667747 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.667711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tls-certs\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.712843 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.712807    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:54.769221 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.769127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9pj\" (UniqueName: \"kubernetes.io/projected/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-kube-api-access-sw9pj\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.769221 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.769166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tmp\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.769447 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.769300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5tn\" (UniqueName: \"kubernetes.io/projected/90cdd39e-daa5-476e-b55f-9429299c40bc-kube-api-access-4g5tn\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.769447 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.769357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tls-certs\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.769447 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.769383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.771512 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.771475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tmp\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.772082 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.772061    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-tls-certs\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.777392 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.777370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9pj\" (UniqueName: \"kubernetes.io/projected/674ff913-7db7-4dd6-8f13-7c5942e7b1b2-kube-api-access-sw9pj\") pod \"kube-auth-proxy-644c76db6f-7pdcf\" (UID: \"674ff913-7db7-4dd6-8f13-7c5942e7b1b2\") " pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.820698 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.820656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:54.827451 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.827430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"
Jul 09 04:00:54.869945 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.869911    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5tn\" (UniqueName: \"kubernetes.io/projected/90cdd39e-daa5-476e-b55f-9429299c40bc-kube-api-access-4g5tn\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.870328 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.869970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.870328 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:00:54.870155    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 04:00:54.870328 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:00:54.870232    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert podName:90cdd39e-daa5-476e-b55f-9429299c40bc nodeName:}" failed. No retries permitted until 2026-07-09 04:00:55.370215608 +0000 UTC m=+284.836585266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert") pod "odh-model-controller-7998c67dc4-kqkg8" (UID: "90cdd39e-daa5-476e-b55f-9429299c40bc") : secret "odh-model-controller-webhook-cert" not found
Jul 09 04:00:54.880677 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.880647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5tn\" (UniqueName: \"kubernetes.io/projected/90cdd39e-daa5-476e-b55f-9429299c40bc-kube-api-access-4g5tn\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:54.965900 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:54.965872    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf"]
Jul 09 04:00:54.968189 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:54.968156    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674ff913_7db7_4dd6_8f13_7c5942e7b1b2.slice/crio-0927302101b614d4cda63b477ecd6703c5490a4c30a73702e92b1e43da0b37bf WatchSource:0}: Error finding container 0927302101b614d4cda63b477ecd6703c5490a4c30a73702e92b1e43da0b37bf: Status 404 returned error can't find the container with id 0927302101b614d4cda63b477ecd6703c5490a4c30a73702e92b1e43da0b37bf
Jul 09 04:00:55.001623 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.001589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:55.373440 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.373409    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:55.375428 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.375397    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf" event={"ID":"674ff913-7db7-4dd6-8f13-7c5942e7b1b2","Type":"ContainerStarted","Data":"0927302101b614d4cda63b477ecd6703c5490a4c30a73702e92b1e43da0b37bf"}
Jul 09 04:00:55.376231 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.376210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cdd39e-daa5-476e-b55f-9429299c40bc-cert\") pod \"odh-model-controller-7998c67dc4-kqkg8\" (UID: \"90cdd39e-daa5-476e-b55f-9429299c40bc\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:55.406921 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.406887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:55.413564 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.413540    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sz7rd"]
Jul 09 04:00:55.418105 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.418089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.420477 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.420455    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 04:00:55.420595 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.420455    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fdl2v\""
Jul 09 04:00:55.427159 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.427136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sz7rd"]
Jul 09 04:00:55.537317 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.537274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:00:55.565902 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.565866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:55.575035 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.574987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdccf\" (UniqueName: \"kubernetes.io/projected/dc19156f-39f5-4d77-8f9c-91f02e92b69a-kube-api-access-pdccf\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.575172 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.575119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc19156f-39f5-4d77-8f9c-91f02e92b69a-tls-certs\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.655693 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.655615    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:00:55.660705 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.660675    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.663982 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.663964    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 04:00:55.664310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.664292    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 04:00:55.664408 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.664295    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 04:00:55.664408 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.664295    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-txtnc\""
Jul 09 04:00:55.669976 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.669958    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 04:00:55.676291 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.676266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdccf\" (UniqueName: \"kubernetes.io/projected/dc19156f-39f5-4d77-8f9c-91f02e92b69a-kube-api-access-pdccf\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.676405 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.676324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc19156f-39f5-4d77-8f9c-91f02e92b69a-tls-certs\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.679397 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.679377    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc19156f-39f5-4d77-8f9c-91f02e92b69a-tls-certs\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.689183 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.689161    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:00:55.697189 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.697166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqkg8"]
Jul 09 04:00:55.697277 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.697224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdccf\" (UniqueName: \"kubernetes.io/projected/dc19156f-39f5-4d77-8f9c-91f02e92b69a-kube-api-access-pdccf\") pod \"model-serving-api-54d89bd5fc-sz7rd\" (UID: \"dc19156f-39f5-4d77-8f9c-91f02e92b69a\") " pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.700057 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:55.700031    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cdd39e_daa5_476e_b55f_9429299c40bc.slice/crio-930a88302a606211e2061b7e7b0dd9d8358e36fa618197af2bb0e5cda390a391 WatchSource:0}: Error finding container 930a88302a606211e2061b7e7b0dd9d8358e36fa618197af2bb0e5cda390a391: Status 404 returned error can't find the container with id 930a88302a606211e2061b7e7b0dd9d8358e36fa618197af2bb0e5cda390a391
Jul 09 04:00:55.700225 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.700206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:55.728350 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.728317    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:00:55.766354 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.766317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:00:55.777661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.777661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.777661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.777661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.778145 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.778145 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrp94\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.778145 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.777784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.878596 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrp94\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.878777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.879058    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.879602 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.879574    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.881236 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.881209    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.881331 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.881232    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.881370 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.881334    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.881370 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.881344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.886316 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.886150    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sz7rd"]
Jul 09 04:00:55.889136 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:55.889103    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc19156f_39f5_4d77_8f9c_91f02e92b69a.slice/crio-9f493afd24c9b88540ef34eae0a0705dd024a106bb37f7cf5cfb7a6a4da747ac WatchSource:0}: Error finding container 9f493afd24c9b88540ef34eae0a0705dd024a106bb37f7cf5cfb7a6a4da747ac: Status 404 returned error can't find the container with id 9f493afd24c9b88540ef34eae0a0705dd024a106bb37f7cf5cfb7a6a4da747ac
Jul 09 04:00:55.889357 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.889338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrp94\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.889458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.889442    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token\") pod \"istiod-openshift-gateway-7574459656-tlskq\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:55.970465 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:55.970431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:00:56.118632 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:56.118605    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:00:56.121673 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:00:56.121642    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817f3c5d_cec4_4abc_ba44_a24f671525dd.slice/crio-d01eef46bc00e7728c59e569f84db21a2b67097508563add085c398b140d1706 WatchSource:0}: Error finding container d01eef46bc00e7728c59e569f84db21a2b67097508563add085c398b140d1706: Status 404 returned error can't find the container with id d01eef46bc00e7728c59e569f84db21a2b67097508563add085c398b140d1706
Jul 09 04:00:56.381926 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:56.381842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" event={"ID":"817f3c5d-cec4-4abc-ba44-a24f671525dd","Type":"ContainerStarted","Data":"d01eef46bc00e7728c59e569f84db21a2b67097508563add085c398b140d1706"}
Jul 09 04:00:56.383283 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:56.383252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8" event={"ID":"90cdd39e-daa5-476e-b55f-9429299c40bc","Type":"ContainerStarted","Data":"930a88302a606211e2061b7e7b0dd9d8358e36fa618197af2bb0e5cda390a391"}
Jul 09 04:00:56.384710 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:56.384678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd" event={"ID":"dc19156f-39f5-4d77-8f9c-91f02e92b69a","Type":"ContainerStarted","Data":"9f493afd24c9b88540ef34eae0a0705dd024a106bb37f7cf5cfb7a6a4da747ac"}
Jul 09 04:00:56.659950 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:00:56.659861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:00.939672 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:00.939642    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 09 04:01:00.939978 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:00.939702    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 09 04:01:01.413358 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.413322    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd" event={"ID":"dc19156f-39f5-4d77-8f9c-91f02e92b69a","Type":"ContainerStarted","Data":"190685f8b757296ca9828475c1da2aaab99f8aab5b95b69ed4cca8848a43a8e0"}
Jul 09 04:01:01.413572 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.413535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:01:01.415131 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.415095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf" event={"ID":"674ff913-7db7-4dd6-8f13-7c5942e7b1b2","Type":"ContainerStarted","Data":"22a95f0a586d8a68426c6e4a19be72c085f2c44c3a089384be9329753b872c07"}
Jul 09 04:01:01.416798 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.416773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" event={"ID":"817f3c5d-cec4-4abc-ba44-a24f671525dd","Type":"ContainerStarted","Data":"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"}
Jul 09 04:01:01.416890 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.416821    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:01:01.418275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.418250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8" event={"ID":"90cdd39e-daa5-476e-b55f-9429299c40bc","Type":"ContainerStarted","Data":"91c18ee0efa354fe55c916cd6b6c5c85fee674d4557f6d97c7c2c31a062ea238"}
Jul 09 04:01:01.418411 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.418382    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:01:01.443560 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.443504    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd" podStartSLOduration=1.39828047 podStartE2EDuration="6.443483983s" totalImagesPullingTime="5.045203513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:01.441150028 +0000 UTC m=+290.907519731" watchObservedRunningTime="2026-07-09 04:01:01.443483983 +0000 UTC m=+290.909853662"
Jul 09 04:01:01.461447 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.461394    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" podStartSLOduration=1.6462445460000001 podStartE2EDuration="6.461378263s" totalImagesPullingTime="4.815133717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:01.460031513 +0000 UTC m=+290.926401201" watchObservedRunningTime="2026-07-09 04:01:01.461378263 +0000 UTC m=+290.927747938"
Jul 09 04:01:01.477388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.477343    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8" podStartSLOduration=2.230162558 podStartE2EDuration="7.477325232s" totalImagesPullingTime="5.247162674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:01.475408818 +0000 UTC m=+290.941778514" watchObservedRunningTime="2026-07-09 04:01:01.477325232 +0000 UTC m=+290.943694907"
Jul 09 04:01:01.665606 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.665502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:01.773292 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.773261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:01.961666 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:01.961636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:02.073450 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:02.073420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:02.391211 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:02.391123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:02.425195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:02.425171    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:01:02.465929 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:02.462219    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-644c76db6f-7pdcf" podStartSLOduration=2.499246763 podStartE2EDuration="8.462197145s" totalImagesPullingTime="5.962950382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:01.491098728 +0000 UTC m=+290.957468425" watchObservedRunningTime="2026-07-09 04:01:02.462197145 +0000 UTC m=+291.928566821"
Jul 09 04:01:04.857471 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.857420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:04.911685 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.911645    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"]
Jul 09 04:01:04.915213 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.915195    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:04.917708 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.917683    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-54mw8\""
Jul 09 04:01:04.918565 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.918543    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 04:01:04.929935 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.929906    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"]
Jul 09 04:01:04.941225 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.941198    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"]
Jul 09 04:01:04.944418 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.944394    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:04.947149 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.947125    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lm8d5\""
Jul 09 04:01:04.947357 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.947139    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 04:01:04.957515 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.957488    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"]
Jul 09 04:01:04.977810 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:04.977779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:05.072306 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.072271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.072480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.072342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3d8045-c803-4033-9805-da200fd01044-cert\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.072480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.072386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5zl\" (UniqueName: \"kubernetes.io/projected/1e3d8045-c803-4033-9805-da200fd01044-kube-api-access-pn5zl\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.072480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.072461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hpk\" (UniqueName: \"kubernetes.io/projected/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-kube-api-access-98hpk\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.134625 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.134541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:05.172945 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.172901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3d8045-c803-4033-9805-da200fd01044-cert\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.173171 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.172969    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5zl\" (UniqueName: \"kubernetes.io/projected/1e3d8045-c803-4033-9805-da200fd01044-kube-api-access-pn5zl\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.173171 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.173047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hpk\" (UniqueName: \"kubernetes.io/projected/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-kube-api-access-98hpk\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.173171 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.173120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.173348 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:01:05.173279    2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 09 04:01:05.173406 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:01:05.173389    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert podName:0b198e0a-de2b-4c4c-a7aa-1c18309154a6 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:05.673366494 +0000 UTC m=+295.139736152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert") pod "llmisvc-controller-manager-777c6bd7d5-rl62t" (UID: "0b198e0a-de2b-4c4c-a7aa-1c18309154a6") : secret "llmisvc-webhook-server-cert" not found
Jul 09 04:01:05.175818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.175788    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3d8045-c803-4033-9805-da200fd01044-cert\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.181941 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.181888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hpk\" (UniqueName: \"kubernetes.io/projected/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-kube-api-access-98hpk\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.182159 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.182138    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5zl\" (UniqueName: \"kubernetes.io/projected/1e3d8045-c803-4033-9805-da200fd01044-kube-api-access-pn5zl\") pod \"kserve-controller-manager-d6f4b65b8-bqr78\" (UID: \"1e3d8045-c803-4033-9805-da200fd01044\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.225070 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.225028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:05.368276 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.368250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"]
Jul 09 04:01:05.370194 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:01:05.370161    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3d8045_c803_4033_9805_da200fd01044.slice/crio-c7d945422cc52929803966484192b61baaea7182a8f96e454f40c9fb29afe63a WatchSource:0}: Error finding container c7d945422cc52929803966484192b61baaea7182a8f96e454f40c9fb29afe63a: Status 404 returned error can't find the container with id c7d945422cc52929803966484192b61baaea7182a8f96e454f40c9fb29afe63a
Jul 09 04:01:05.437060 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.436993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78" event={"ID":"1e3d8045-c803-4033-9805-da200fd01044","Type":"ContainerStarted","Data":"c7d945422cc52929803966484192b61baaea7182a8f96e454f40c9fb29afe63a"}
Jul 09 04:01:05.437868 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.437845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:05.678552 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.678519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.681046 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.681026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b198e0a-de2b-4c4c-a7aa-1c18309154a6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rl62t\" (UID: \"0b198e0a-de2b-4c4c-a7aa-1c18309154a6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.856166 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.856059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:05.997792 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:05.997765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"]
Jul 09 04:01:06.000335 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:01:06.000297    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b198e0a_de2b_4c4c_a7aa_1c18309154a6.slice/crio-d422bfaa80cd62e3bd7bf605169874444d4bbaba823aa62368bdb8bd75031cac WatchSource:0}: Error finding container d422bfaa80cd62e3bd7bf605169874444d4bbaba823aa62368bdb8bd75031cac: Status 404 returned error can't find the container with id d422bfaa80cd62e3bd7bf605169874444d4bbaba823aa62368bdb8bd75031cac
Jul 09 04:01:06.191734 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:06.191699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:06.292258 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:06.292223    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:06.442353 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:06.442265    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t" event={"ID":"0b198e0a-de2b-4c4c-a7aa-1c18309154a6","Type":"ContainerStarted","Data":"d422bfaa80cd62e3bd7bf605169874444d4bbaba823aa62368bdb8bd75031cac"}
Jul 09 04:01:08.451835 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:08.451796    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:08.470194 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:08.470157    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:01:08.470588 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:08.470428    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" podUID="817f3c5d-cec4-4abc-ba44-a24f671525dd" containerName="discovery" containerID="cri-o://f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758" gracePeriod=30
Jul 09 04:01:09.274953 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.274921    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:01:09.318268 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318227    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318298    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318334    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318401    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318445    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318658 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318470    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrp94\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318658 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318516    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert\") pod \"817f3c5d-cec4-4abc-ba44-a24f671525dd\" (UID: \"817f3c5d-cec4-4abc-ba44-a24f671525dd\") "
Jul 09 04:01:09.318870 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.318840    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:01:09.320966 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.320932    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:01:09.320966 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.320965    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts" (OuterVolumeSpecName: "cacerts") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:01:09.321238 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.321222    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs" (OuterVolumeSpecName: "local-certs") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:09.321238 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.321232    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94" (OuterVolumeSpecName: "kube-api-access-lrp94") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "kube-api-access-lrp94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:01:09.321418 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.321393    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:01:09.321467 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.321393    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "817f3c5d-cec4-4abc-ba44-a24f671525dd" (UID: "817f3c5d-cec4-4abc-ba44-a24f671525dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:01:09.420216 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420181    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-token\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420216 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420213    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-cacerts\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420413 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420223    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrp94\" (UniqueName: \"kubernetes.io/projected/817f3c5d-cec4-4abc-ba44-a24f671525dd-kube-api-access-lrp94\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420413 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420231    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-dns-cert\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420413 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420243    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-kubeconfig\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420413 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420251    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f3c5d-cec4-4abc-ba44-a24f671525dd-local-certs\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.420413 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.420259    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/817f3c5d-cec4-4abc-ba44-a24f671525dd-istio-csr-ca-configmap\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:09.461491 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.461454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t" event={"ID":"0b198e0a-de2b-4c4c-a7aa-1c18309154a6","Type":"ContainerStarted","Data":"922f4417feeb99ee10743aec5185bc49e0b3764ec70830125c93111c50d0fb60"}
Jul 09 04:01:09.461961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.461680    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:09.463078 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.463044    2569 generic.go:356] "Generic (PLEG): container finished" podID="817f3c5d-cec4-4abc-ba44-a24f671525dd" containerID="f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758" exitCode=0
Jul 09 04:01:09.463206 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.463096    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"
Jul 09 04:01:09.463206 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.463141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" event={"ID":"817f3c5d-cec4-4abc-ba44-a24f671525dd","Type":"ContainerDied","Data":"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"}
Jul 09 04:01:09.463206 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.463186    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tlskq" event={"ID":"817f3c5d-cec4-4abc-ba44-a24f671525dd","Type":"ContainerDied","Data":"d01eef46bc00e7728c59e569f84db21a2b67097508563add085c398b140d1706"}
Jul 09 04:01:09.463366 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.463216    2569 scope.go:117] "RemoveContainer" containerID="f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"
Jul 09 04:01:09.464943 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.464916    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78" event={"ID":"1e3d8045-c803-4033-9805-da200fd01044","Type":"ContainerStarted","Data":"8bfb4aad6bcc00fa3794b5ddd488dde8c44d651cf5ac54e58c923bab3f4dd0a7"}
Jul 09 04:01:09.465068 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.465035    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:09.472789 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.472608    2569 scope.go:117] "RemoveContainer" containerID="f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"
Jul 09 04:01:09.472923 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:01:09.472905    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758\": container with ID starting with f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758 not found: ID does not exist" containerID="f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"
Jul 09 04:01:09.472974 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.472932    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758"} err="failed to get container status \"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758\": rpc error: code = NotFound desc = could not find container \"f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758\": container with ID starting with f40e9f4921a6a7f5da7d99ce352dd05d7481ec22dc9f8bcfd2a3a4ba9efe1758 not found: ID does not exist"
Jul 09 04:01:09.477962 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.477917    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t" podStartSLOduration=2.317225733 podStartE2EDuration="5.477904159s" totalImagesPullingTime="3.160678426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:09.476572973 +0000 UTC m=+298.942942673" watchObservedRunningTime="2026-07-09 04:01:09.477904159 +0000 UTC m=+298.944273828"
Jul 09 04:01:09.491176 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.491140    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:01:09.495211 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.495185    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tlskq"]
Jul 09 04:01:09.510236 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:09.510189    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78" podStartSLOduration=1.724230018 podStartE2EDuration="5.510175418s" totalImagesPullingTime="3.7859454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:09.508482004 +0000 UTC m=+298.974851704" watchObservedRunningTime="2026-07-09 04:01:09.510175418 +0000 UTC m=+298.976545093"
Jul 09 04:01:10.819959 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:10.819926    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:10.977475 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:10.977448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:01:10.979183 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:10.979146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:01:10.986448 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:10.986429    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 04:01:11.071289 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:11.071112    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="817f3c5d-cec4-4abc-ba44-a24f671525dd" path="/var/lib/kubelet/pods/817f3c5d-cec4-4abc-ba44-a24f671525dd/volumes"
Jul 09 04:01:12.425588 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:12.425558    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kqkg8"
Jul 09 04:01:12.429022 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:12.428984    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sz7rd"
Jul 09 04:01:28.817988 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:28.817952    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:28.874061 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:28.874019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:40.472641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:40.472603    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rl62t"
Jul 09 04:01:40.475501 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:40.475480    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bqr78"
Jul 09 04:01:55.334721 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.334681    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:55.437443 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.437407    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:55.438178 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.438157    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:01:55.438507 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.438495    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817f3c5d-cec4-4abc-ba44-a24f671525dd" containerName="discovery"
Jul 09 04:01:55.438543 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.438509    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="817f3c5d-cec4-4abc-ba44-a24f671525dd" containerName="discovery"
Jul 09 04:01:55.438577 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.438569    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="817f3c5d-cec4-4abc-ba44-a24f671525dd" containerName="discovery"
Jul 09 04:01:55.451037 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.450993    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:55.452347 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.452307    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:01:55.455211 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.455192    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 04:01:55.456027 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.455985    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 04:01:55.456218 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.455990    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7qhhs\""
Jul 09 04:01:55.501528 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.501494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:55.526535 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.526496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5r2q\" (UniqueName: \"kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q\") pod \"kuadrant-operator-catalog-rrkmt\" (UID: \"563286ce-d249-427d-aa0e-02ae8a7d3c9b\") " pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:55.627701 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.627602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5r2q\" (UniqueName: \"kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q\") pod \"kuadrant-operator-catalog-rrkmt\" (UID: \"563286ce-d249-427d-aa0e-02ae8a7d3c9b\") " pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:55.636147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.636114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5r2q\" (UniqueName: \"kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q\") pod \"kuadrant-operator-catalog-rrkmt\" (UID: \"563286ce-d249-427d-aa0e-02ae8a7d3c9b\") " pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:55.762275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.762235    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:55.808149 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.808116    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:01:55.896423 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.896327    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:01:55.900053 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:01:55.900027    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563286ce_d249_427d_aa0e_02ae8a7d3c9b.slice/crio-2124055bcb61085e6134f4d9789103aef2d67f504cb17bb951772630e77528be WatchSource:0}: Error finding container 2124055bcb61085e6134f4d9789103aef2d67f504cb17bb951772630e77528be: Status 404 returned error can't find the container with id 2124055bcb61085e6134f4d9789103aef2d67f504cb17bb951772630e77528be
Jul 09 04:01:55.901570 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:55.901551    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:01:56.016860 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.016820    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw9kj"]
Jul 09 04:01:56.021505 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.021487    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:01:56.026910 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.026886    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw9kj"]
Jul 09 04:01:56.130597 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.130559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkstw\" (UniqueName: \"kubernetes.io/projected/c20c7e43-b8a9-4740-bb29-efcf2877d7b7-kube-api-access-jkstw\") pod \"kuadrant-operator-catalog-kw9kj\" (UID: \"c20c7e43-b8a9-4740-bb29-efcf2877d7b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:01:56.231586 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.231553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkstw\" (UniqueName: \"kubernetes.io/projected/c20c7e43-b8a9-4740-bb29-efcf2877d7b7-kube-api-access-jkstw\") pod \"kuadrant-operator-catalog-kw9kj\" (UID: \"c20c7e43-b8a9-4740-bb29-efcf2877d7b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:01:56.239294 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.239267    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkstw\" (UniqueName: \"kubernetes.io/projected/c20c7e43-b8a9-4740-bb29-efcf2877d7b7-kube-api-access-jkstw\") pod \"kuadrant-operator-catalog-kw9kj\" (UID: \"c20c7e43-b8a9-4740-bb29-efcf2877d7b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:01:56.258720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.258688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:56.332713 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.332678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:01:56.448121 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.448077    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:01:56.484406 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.484229    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw9kj"]
Jul 09 04:01:56.487162 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:01:56.487135    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20c7e43_b8a9_4740_bb29_efcf2877d7b7.slice/crio-94eb26638fd34c417baec982eb4e16345c77834a7afb1501b0a6d50f1da275a5 WatchSource:0}: Error finding container 94eb26638fd34c417baec982eb4e16345c77834a7afb1501b0a6d50f1da275a5: Status 404 returned error can't find the container with id 94eb26638fd34c417baec982eb4e16345c77834a7afb1501b0a6d50f1da275a5
Jul 09 04:01:56.678335 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.678303    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj" event={"ID":"c20c7e43-b8a9-4740-bb29-efcf2877d7b7","Type":"ContainerStarted","Data":"94eb26638fd34c417baec982eb4e16345c77834a7afb1501b0a6d50f1da275a5"}
Jul 09 04:01:56.679478 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:56.679458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" event={"ID":"563286ce-d249-427d-aa0e-02ae8a7d3c9b","Type":"ContainerStarted","Data":"2124055bcb61085e6134f4d9789103aef2d67f504cb17bb951772630e77528be"}
Jul 09 04:01:58.691611 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.691575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj" event={"ID":"c20c7e43-b8a9-4740-bb29-efcf2877d7b7","Type":"ContainerStarted","Data":"13e77c12cd60ac722ffbd05f6fb52e824a6ee57567854d9f1286232ad16478a8"}
Jul 09 04:01:58.693096 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.693068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" event={"ID":"563286ce-d249-427d-aa0e-02ae8a7d3c9b","Type":"ContainerStarted","Data":"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"}
Jul 09 04:01:58.693229 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.693111    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" podUID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" containerName="registry-server" containerID="cri-o://1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52" gracePeriod=2
Jul 09 04:01:58.707724 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.707683    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj" podStartSLOduration=0.845430006 podStartE2EDuration="2.707665406s" totalImagesPullingTime="1.8622354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:58.705997464 +0000 UTC m=+348.172367176" watchObservedRunningTime="2026-07-09 04:01:58.707665406 +0000 UTC m=+348.174035080"
Jul 09 04:01:58.721492 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.721447    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" podStartSLOduration=1.268062799 podStartE2EDuration="3.721431714s" totalImagesPullingTime="2.453368915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:58.719932356 +0000 UTC m=+348.186302056" watchObservedRunningTime="2026-07-09 04:01:58.721431714 +0000 UTC m=+348.187801389"
Jul 09 04:01:58.935108 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.935078    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:58.958081 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.957991    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5r2q\" (UniqueName: \"kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q\") pod \"563286ce-d249-427d-aa0e-02ae8a7d3c9b\" (UID: \"563286ce-d249-427d-aa0e-02ae8a7d3c9b\") "
Jul 09 04:01:58.960261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:58.960233    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q" (OuterVolumeSpecName: "kube-api-access-h5r2q") pod "563286ce-d249-427d-aa0e-02ae8a7d3c9b" (UID: "563286ce-d249-427d-aa0e-02ae8a7d3c9b"). InnerVolumeSpecName "kube-api-access-h5r2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:01:59.059421 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.059381    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5r2q\" (UniqueName: \"kubernetes.io/projected/563286ce-d249-427d-aa0e-02ae8a7d3c9b-kube-api-access-h5r2q\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:01:59.698233 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.698201    2569 generic.go:356] "Generic (PLEG): container finished" podID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" containerID="1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52" exitCode=0
Jul 09 04:01:59.698653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.698247    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt"
Jul 09 04:01:59.698653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.698285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" event={"ID":"563286ce-d249-427d-aa0e-02ae8a7d3c9b","Type":"ContainerDied","Data":"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"}
Jul 09 04:01:59.698653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.698329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrkmt" event={"ID":"563286ce-d249-427d-aa0e-02ae8a7d3c9b","Type":"ContainerDied","Data":"2124055bcb61085e6134f4d9789103aef2d67f504cb17bb951772630e77528be"}
Jul 09 04:01:59.698653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.698349    2569 scope.go:117] "RemoveContainer" containerID="1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"
Jul 09 04:01:59.707340 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.707323    2569 scope.go:117] "RemoveContainer" containerID="1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"
Jul 09 04:01:59.707607 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:01:59.707589    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52\": container with ID starting with 1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52 not found: ID does not exist" containerID="1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"
Jul 09 04:01:59.707656 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.707616    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52"} err="failed to get container status \"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52\": rpc error: code = NotFound desc = could not find container \"1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52\": container with ID starting with 1fb596e4d3dc53f4a313fdf3156354f0cc34989b31846f84db5aded03ed43e52 not found: ID does not exist"
Jul 09 04:01:59.712596 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.712576    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:01:59.714161 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:01:59.714134    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrkmt"]
Jul 09 04:02:01.069788 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:01.069755    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" path="/var/lib/kubelet/pods/563286ce-d249-427d-aa0e-02ae8a7d3c9b/volumes"
Jul 09 04:02:06.333591 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:06.333554    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:02:06.334058 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:06.333784    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:02:06.357137 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:06.357108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:02:06.752673 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:06.752647    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kw9kj"
Jul 09 04:02:24.191559 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:24.191521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:26.822767 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.822729    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"]
Jul 09 04:02:26.823168 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.823079    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" containerName="registry-server"
Jul 09 04:02:26.823168 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.823091    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" containerName="registry-server"
Jul 09 04:02:26.823168 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.823149    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="563286ce-d249-427d-aa0e-02ae8a7d3c9b" containerName="registry-server"
Jul 09 04:02:26.827364 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.827343    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:26.833986 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.833589    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-887vm\""
Jul 09 04:02:26.846417 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.846384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"]
Jul 09 04:02:26.908419 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:26.908379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrqf\" (UniqueName: \"kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf\") pod \"limitador-operator-controller-manager-859d7b78bd-45w7k\" (UID: \"967a4712-6de8-45a4-a21d-22daa3a91451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:27.009396 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.009359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrqf\" (UniqueName: \"kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf\") pod \"limitador-operator-controller-manager-859d7b78bd-45w7k\" (UID: \"967a4712-6de8-45a4-a21d-22daa3a91451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:27.017917 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.017888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrqf\" (UniqueName: \"kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf\") pod \"limitador-operator-controller-manager-859d7b78bd-45w7k\" (UID: \"967a4712-6de8-45a4-a21d-22daa3a91451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:27.137230 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.137157    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:27.275450 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.275416    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"]
Jul 09 04:02:27.279307 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:27.279272    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967a4712_6de8_45a4_a21d_22daa3a91451.slice/crio-3d5ee56c1bc992e7c5fb255761c86118df0cfac40e3fc8ac9a1a023bb89f2ba7 WatchSource:0}: Error finding container 3d5ee56c1bc992e7c5fb255761c86118df0cfac40e3fc8ac9a1a023bb89f2ba7: Status 404 returned error can't find the container with id 3d5ee56c1bc992e7c5fb255761c86118df0cfac40e3fc8ac9a1a023bb89f2ba7
Jul 09 04:02:27.585327 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.585284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:27.826915 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:27.826882    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k" event={"ID":"967a4712-6de8-45a4-a21d-22daa3a91451","Type":"ContainerStarted","Data":"3d5ee56c1bc992e7c5fb255761c86118df0cfac40e3fc8ac9a1a023bb89f2ba7"}
Jul 09 04:02:28.380074 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:28.379986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:29.837981 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:29.837889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k" event={"ID":"967a4712-6de8-45a4-a21d-22daa3a91451","Type":"ContainerStarted","Data":"a6a48b6486fde0fd61e7d4bc08af6f8e542714d4472cd2523f405ae13971436d"}
Jul 09 04:02:29.837981 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:29.837966    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:29.862533 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:29.862481    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k" podStartSLOduration=1.605062723 podStartE2EDuration="3.862466595s" totalImagesPullingTime="2.257403872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:02:29.860731496 +0000 UTC m=+379.327101189" watchObservedRunningTime="2026-07-09 04:02:29.862466595 +0000 UTC m=+379.328836270"
Jul 09 04:02:30.883659 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:30.883619    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"]
Jul 09 04:02:30.887129 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:30.887111    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:30.889532 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:30.889515    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s6v7p\""
Jul 09 04:02:30.897997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:30.897970    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"]
Jul 09 04:02:31.048421 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.048375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gp9\" (UniqueName: \"kubernetes.io/projected/cea4230f-7ca9-4641-9816-fc1b3f4bf95b-kube-api-access-q2gp9\") pod \"authorino-operator-75cc8d5cb7-gj9gg\" (UID: \"cea4230f-7ca9-4641-9816-fc1b3f4bf95b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:31.149240 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.149157    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gp9\" (UniqueName: \"kubernetes.io/projected/cea4230f-7ca9-4641-9816-fc1b3f4bf95b-kube-api-access-q2gp9\") pod \"authorino-operator-75cc8d5cb7-gj9gg\" (UID: \"cea4230f-7ca9-4641-9816-fc1b3f4bf95b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:31.165377 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.165347    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gp9\" (UniqueName: \"kubernetes.io/projected/cea4230f-7ca9-4641-9816-fc1b3f4bf95b-kube-api-access-q2gp9\") pod \"authorino-operator-75cc8d5cb7-gj9gg\" (UID: \"cea4230f-7ca9-4641-9816-fc1b3f4bf95b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:31.197894 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.197858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:31.333866 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.333840    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"]
Jul 09 04:02:31.336432 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:31.336391    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea4230f_7ca9_4641_9816_fc1b3f4bf95b.slice/crio-77df72f190fa4162cd1f7c84a95c8d8846917cf2d25d9d9da71516e38a716c61 WatchSource:0}: Error finding container 77df72f190fa4162cd1f7c84a95c8d8846917cf2d25d9d9da71516e38a716c61: Status 404 returned error can't find the container with id 77df72f190fa4162cd1f7c84a95c8d8846917cf2d25d9d9da71516e38a716c61
Jul 09 04:02:31.625611 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.625575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:31.847706 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:31.847674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg" event={"ID":"cea4230f-7ca9-4641-9816-fc1b3f4bf95b","Type":"ContainerStarted","Data":"77df72f190fa4162cd1f7c84a95c8d8846917cf2d25d9d9da71516e38a716c61"}
Jul 09 04:02:32.007938 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:32.007904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:33.416224 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:33.416187    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:33.859344 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:33.859312    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg" event={"ID":"cea4230f-7ca9-4641-9816-fc1b3f4bf95b","Type":"ContainerStarted","Data":"bf72bba2b05979702ad6e7b818e9a33f696fefa5f8334624c9ee4bddaf418820"}
Jul 09 04:02:33.859490 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:33.859387    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:33.878701 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:33.878638    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg" podStartSLOduration=1.58710258 podStartE2EDuration="3.878620732s" totalImagesPullingTime="2.291518152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:02:33.877354823 +0000 UTC m=+383.343724523" watchObservedRunningTime="2026-07-09 04:02:33.878620732 +0000 UTC m=+383.344990404"
Jul 09 04:02:34.033363 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.033283    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"]
Jul 09 04:02:34.036719 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.036701    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:34.039439 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.039401    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xhk26\""
Jul 09 04:02:34.039597 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.039530    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 04:02:34.059794 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.059760    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"]
Jul 09 04:02:34.178402 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.178368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wnb\" (UniqueName: \"kubernetes.io/projected/8eeecff0-4166-4fad-9c80-9028aa3e9b7a-kube-api-access-q9wnb\") pod \"dns-operator-controller-manager-864dd78c4c-9jr25\" (UID: \"8eeecff0-4166-4fad-9c80-9028aa3e9b7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:34.279204 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.279164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wnb\" (UniqueName: \"kubernetes.io/projected/8eeecff0-4166-4fad-9c80-9028aa3e9b7a-kube-api-access-q9wnb\") pod \"dns-operator-controller-manager-864dd78c4c-9jr25\" (UID: \"8eeecff0-4166-4fad-9c80-9028aa3e9b7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:34.287141 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.287067    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wnb\" (UniqueName: \"kubernetes.io/projected/8eeecff0-4166-4fad-9c80-9028aa3e9b7a-kube-api-access-q9wnb\") pod \"dns-operator-controller-manager-864dd78c4c-9jr25\" (UID: \"8eeecff0-4166-4fad-9c80-9028aa3e9b7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:34.347178 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.347144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:34.488280 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.488250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"]
Jul 09 04:02:34.491914 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:34.491884    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eeecff0_4166_4fad_9c80_9028aa3e9b7a.slice/crio-8097894ea214253dd485db4dcbdd5797884f492bbee74868cc3eecc68bc0fe5e WatchSource:0}: Error finding container 8097894ea214253dd485db4dcbdd5797884f492bbee74868cc3eecc68bc0fe5e: Status 404 returned error can't find the container with id 8097894ea214253dd485db4dcbdd5797884f492bbee74868cc3eecc68bc0fe5e
Jul 09 04:02:34.800743 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.800689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:34.865207 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.865173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25" event={"ID":"8eeecff0-4166-4fad-9c80-9028aa3e9b7a","Type":"ContainerStarted","Data":"8097894ea214253dd485db4dcbdd5797884f492bbee74868cc3eecc68bc0fe5e"}
Jul 09 04:02:34.892493 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:34.892468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:36.786538 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:36.786501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:37.881788 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:37.881755    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25" event={"ID":"8eeecff0-4166-4fad-9c80-9028aa3e9b7a","Type":"ContainerStarted","Data":"6ca0019891a16cb71fe93fe100f6302a83ae624d148a47e1e24b730048c5ec12"}
Jul 09 04:02:37.882196 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:37.881885    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:37.900433 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:37.900384    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25" podStartSLOduration=1.4382065019999999 podStartE2EDuration="3.900365451s" totalImagesPullingTime="2.462158949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:02:37.898955804 +0000 UTC m=+387.365325498" watchObservedRunningTime="2026-07-09 04:02:37.900365451 +0000 UTC m=+387.366735125"
Jul 09 04:02:37.948720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:37.948692    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:38.517194 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.517142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"]
Jul 09 04:02:38.521234 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.521210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.524469 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.524449    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qrfhf\""
Jul 09 04:02:38.526835 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.526812    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"]
Jul 09 04:02:38.618514 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.618480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.618702 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.618530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5kpp\" (UniqueName: \"kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.718955 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.718922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5kpp\" (UniqueName: \"kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.719173 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.719049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.719411 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.719390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.735312 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.735281    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5kpp\" (UniqueName: \"kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.832732 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.832643    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:38.971630 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:38.971566    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"]
Jul 09 04:02:38.975269 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:38.975234    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc579c14b_578f_46ed_9e35_a12bf8ce85ab.slice/crio-03f295ef89fc3c038b60ceab71e1236557053404fff46ff3b8284aed32717308 WatchSource:0}: Error finding container 03f295ef89fc3c038b60ceab71e1236557053404fff46ff3b8284aed32717308: Status 404 returned error can't find the container with id 03f295ef89fc3c038b60ceab71e1236557053404fff46ff3b8284aed32717308
Jul 09 04:02:39.803818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:39.803781    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:39.894719 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:39.894684    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2" event={"ID":"c579c14b-578f-46ed-9e35-a12bf8ce85ab","Type":"ContainerStarted","Data":"03f295ef89fc3c038b60ceab71e1236557053404fff46ff3b8284aed32717308"}
Jul 09 04:02:39.911142 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:39.911113    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:40.845071 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:40.845022    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:44.867948 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:44.867916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gj9gg"
Jul 09 04:02:44.925573 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:44.925540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2" event={"ID":"c579c14b-578f-46ed-9e35-a12bf8ce85ab","Type":"ContainerStarted","Data":"b3544796d7bd4e32f626a92562a7eac31ab3191c0e42d9353b68020d79412373"}
Jul 09 04:02:44.925743 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:44.925611    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:44.946719 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:44.946661    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2" podStartSLOduration=1.261706336 podStartE2EDuration="6.946645681s" totalImagesPullingTime="5.684939345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:02:44.945293568 +0000 UTC m=+394.411663269" watchObservedRunningTime="2026-07-09 04:02:44.946645681 +0000 UTC m=+394.413015356"
Jul 09 04:02:45.253051 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:45.252946    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:45.357779 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:45.357746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:45.608709 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:45.608624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:45.707741 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:45.707713    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:47.430957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.430920    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"]
Jul 09 04:02:47.434118 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.434093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:47.434553 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.434535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.436606 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.436582    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d4mf4\""
Jul 09 04:02:47.436689 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.436655    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 04:02:47.436751 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.436582    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 04:02:47.440274 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.440252    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"]
Jul 09 04:02:47.494435 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.494400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/090b633f-afef-417b-964c-0eae42ed5ca4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.494601 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.494489    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqhtd\" (UniqueName: \"kubernetes.io/projected/090b633f-afef-417b-964c-0eae42ed5ca4-kube-api-access-wqhtd\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.494601 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.494525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/090b633f-afef-417b-964c-0eae42ed5ca4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.533807 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.533773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:47.595762 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.595721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqhtd\" (UniqueName: \"kubernetes.io/projected/090b633f-afef-417b-964c-0eae42ed5ca4-kube-api-access-wqhtd\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.595958 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.595781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/090b633f-afef-417b-964c-0eae42ed5ca4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.595958 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.595823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/090b633f-afef-417b-964c-0eae42ed5ca4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.596505 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.596483    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/090b633f-afef-417b-964c-0eae42ed5ca4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.598364 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.598346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/090b633f-afef-417b-964c-0eae42ed5ca4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.603150 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.603128    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqhtd\" (UniqueName: \"kubernetes.io/projected/090b633f-afef-417b-964c-0eae42ed5ca4-kube-api-access-wqhtd\") pod \"kuadrant-console-plugin-66b5774985-s4lk9\" (UID: \"090b633f-afef-417b-964c-0eae42ed5ca4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.744752 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.744670    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"
Jul 09 04:02:47.879128 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.879074    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9"]
Jul 09 04:02:47.881345 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:47.881303    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod090b633f_afef_417b_964c_0eae42ed5ca4.slice/crio-470b4392bec6469ad93c930ca6fd64a0ee9a32740f2e3931133140aa25cd033f WatchSource:0}: Error finding container 470b4392bec6469ad93c930ca6fd64a0ee9a32740f2e3931133140aa25cd033f: Status 404 returned error can't find the container with id 470b4392bec6469ad93c930ca6fd64a0ee9a32740f2e3931133140aa25cd033f
Jul 09 04:02:47.940661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:47.940627    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9" event={"ID":"090b633f-afef-417b-964c-0eae42ed5ca4","Type":"ContainerStarted","Data":"470b4392bec6469ad93c930ca6fd64a0ee9a32740f2e3931133140aa25cd033f"}
Jul 09 04:02:48.600711 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:48.600660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:48.659328 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:48.659289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:48.891871 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:48.891792    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9jr25"
Jul 09 04:02:52.737876 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:52.737845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:52.836630 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:52.836555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:55.933252 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:55.933219    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:56.903222 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:56.903184    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"]
Jul 09 04:02:56.906664 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:56.906641    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:56.917389 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:56.917357    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"]
Jul 09 04:02:56.992138 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:56.991991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:56.992138 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:56.992068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffw5\" (UniqueName: \"kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.092593 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.092525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.092763 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.092614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffw5\" (UniqueName: \"kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.093054 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.092987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.101890 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.101862    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffw5\" (UniqueName: \"kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.223583 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.223553    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:57.376242 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.376215    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"]
Jul 09 04:02:57.378230 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:02:57.378199    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode991c768_cc36_4bd7_b636_f9114f99a7d4.slice/crio-d8f65ee4b212ef949d77bc6e54e7a6bcd9b6f168bbf28bf7d140a1b4ba605d05 WatchSource:0}: Error finding container d8f65ee4b212ef949d77bc6e54e7a6bcd9b6f168bbf28bf7d140a1b4ba605d05: Status 404 returned error can't find the container with id d8f65ee4b212ef949d77bc6e54e7a6bcd9b6f168bbf28bf7d140a1b4ba605d05
Jul 09 04:02:57.536451 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.536363    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"]
Jul 09 04:02:57.542206 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.542176    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"]
Jul 09 04:02:57.552102 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.552071    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"]
Jul 09 04:02:57.552310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.552285    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" containerName="manager" containerID="cri-o://b3544796d7bd4e32f626a92562a7eac31ab3191c0e42d9353b68020d79412373" gracePeriod=2
Jul 09 04:02:57.560389 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.559933    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:02:57.561720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.560744    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" containerName="manager"
Jul 09 04:02:57.561720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.560768    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" containerName="manager"
Jul 09 04:02:57.561720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.560881    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" containerName="manager"
Jul 09 04:02:57.565568 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.565544    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"]
Jul 09 04:02:57.565665 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.565622    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.567127 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:57.567049    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c579c14b-578f-46ed-9e35-a12bf8ce85ab\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:57.569073 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.569053    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"]
Jul 09 04:02:57.569295 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.569246    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" containerName="manager" containerID="cri-o://a6a48b6486fde0fd61e7d4bc08af6f8e542714d4472cd2523f405ae13971436d" gracePeriod=2
Jul 09 04:02:57.570630 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:57.570588    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:57.576857 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.576831    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:02:57.578849 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.578825    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:02:57.579226 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.579212    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" containerName="manager"
Jul 09 04:02:57.579226 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.579227    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" containerName="manager"
Jul 09 04:02:57.579310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.579288    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" containerName="manager"
Jul 09 04:02:57.583044 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.582963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.584140 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.584117    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"]
Jul 09 04:02:57.593756 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.593731    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"]
Jul 09 04:02:57.594311 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.594297    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" containerName="manager"
Jul 09 04:02:57.594367 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.594315    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" containerName="manager"
Jul 09 04:02:57.594414 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.594405    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" containerName="manager"
Jul 09 04:02:57.597824 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.597801    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:02:57.603289 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.603264    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:02:57.607437 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.607414    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"]
Jul 09 04:02:57.642925 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:57.642890    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:57.644429 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:57.644398    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45w7k\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:57.698314 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.698283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p54wk\" (UniqueName: \"kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.698484 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.698343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.698484 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.698374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdw6\" (UniqueName: \"kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.698484 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.698396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.698484 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.698418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6fv\" (UniqueName: \"kubernetes.io/projected/a8cc2bc0-0854-49b6-bc00-86f262e5b166-kube-api-access-kf6fv\") pod \"limitador-operator-controller-manager-859d7b78bd-mllsf\" (UID: \"a8cc2bc0-0854-49b6-bc00-86f262e5b166\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:02:57.728628 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.728588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:57.799557 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p54wk\" (UniqueName: \"kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.799557 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799534    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.799784 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdw6\" (UniqueName: \"kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.799784 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799606    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.799784 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6fv\" (UniqueName: \"kubernetes.io/projected/a8cc2bc0-0854-49b6-bc00-86f262e5b166-kube-api-access-kf6fv\") pod \"limitador-operator-controller-manager-859d7b78bd-mllsf\" (UID: \"a8cc2bc0-0854-49b6-bc00-86f262e5b166\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:02:57.800009 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.799976    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.800154 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.800076    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.809958 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.809929    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdw6\" (UniqueName: \"kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9kmd7\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.810389 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.810362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p54wk\" (UniqueName: \"kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rjq9w\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.810522 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.810369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6fv\" (UniqueName: \"kubernetes.io/projected/a8cc2bc0-0854-49b6-bc00-86f262e5b166-kube-api-access-kf6fv\") pod \"limitador-operator-controller-manager-859d7b78bd-mllsf\" (UID: \"a8cc2bc0-0854-49b6-bc00-86f262e5b166\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:02:57.830163 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.830116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:57.979355 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.979313    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:02:57.987656 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.987628    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:02:57.994117 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:57.994088    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:02:58.004382 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:58.004350    2569 generic.go:356] "Generic (PLEG): container finished" podID="967a4712-6de8-45a4-a21d-22daa3a91451" containerID="a6a48b6486fde0fd61e7d4bc08af6f8e542714d4472cd2523f405ae13971436d" exitCode=0
Jul 09 04:02:58.006955 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:58.006724    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd" container="manager"
Jul 09 04:02:58.008502 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:58.008481    2569 generic.go:356] "Generic (PLEG): container finished" podID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" containerID="b3544796d7bd4e32f626a92562a7eac31ab3191c0e42d9353b68020d79412373" exitCode=0
Jul 09 04:02:58.009994 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:58.009944    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:02:58.012044 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:58.011996    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45w7k\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:02:58.013914 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:02:58.013890    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:02:59.542163 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:59.542123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:02:59.696628 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:02:59.696591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:03.268236 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:03.268191    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:03.367869 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:03.367831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:03.469633 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:03.469597    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:03.528319 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:03.528241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:07.069674 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:07.069633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:07.128843 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:07.128810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:11.611053 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:11.611014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:11.711665 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:11.711634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:11.963286    2569 log.go:32] "UpdateContainerResources from runtime service failed" err=<
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:         rpc error: code = Unknown desc = updating resources for container "d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11" failed: sd-bus call: Unit crio-d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11.scope not found.: No such file or directory
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:          : exit status 1
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:  > containerID="d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11"
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:11.963362    2569 kuberuntime_container.go:420] "UpdateContainerResources failed" err=<
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:         rpc error: code = Unknown desc = updating resources for container "d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11" failed: sd-bus call: Unit crio-d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11.scope not found.: No such file or directory
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:          : exit status 1
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:  > container="cri-o://d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11"
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:11.963379    2569 kuberuntime_manager.go:986] "updateContainerResources failed" err=<
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:         rpc error: code = Unknown desc = updating resources for container "d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11" failed: sd-bus call: Unit crio-d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11.scope not found.: No such file or directory
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:          : exit status 1
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:  > container="manager" cID={"Type":"cri-o","ID":"d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11"} pod="kuadrant-operator-controller-manager-6fb7879bc9-xvhzd_kuadrant-system(e991c768-cc36-4bd7-b636-f9114f99a7d4)" resourceName="memory"
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:11.963406    2569 kuberuntime_manager.go:821] "updatePodContainerResources failed" err=<
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:         rpc error: code = Unknown desc = updating resources for container "d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11" failed: sd-bus call: Unit crio-d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11.scope not found.: No such file or directory
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:          : exit status 1
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]:  > pod="kuadrant-operator-controller-manager-6fb7879bc9-xvhzd_kuadrant-system(e991c768-cc36-4bd7-b636-f9114f99a7d4)" resource="memory"
Jul 09 04:03:11.965054 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:11.963464    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"ResizePodInPlace\" for \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd_kuadrant-system(e991c768-cc36-4bd7-b636-f9114f99a7d4)\" with ResizePodInPlaceError: \"rpc error: code = Unknown desc = updating resources for container \\\"d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11\\\" failed: sd-bus call: Unit crio-d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11.scope not found.: No such file or directory\\n : exit status 1\"" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4"
Jul 09 04:03:12.091117 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.090993    2569 generic.go:356] "Generic (PLEG): container finished" podID="e991c768-cc36-4bd7-b636-f9114f99a7d4" containerID="d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11" exitCode=1
Jul 09 04:03:12.093184 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.093146    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:12.131607 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.131528    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:03:12.141676 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:03:12.141634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ea5377_0e07_4049_a48e_b3dc91839167.slice/crio-49a44644218a4f6b70562c0d148aeff398dece9161648a0e81759d4b81c9cc8b WatchSource:0}: Error finding container 49a44644218a4f6b70562c0d148aeff398dece9161648a0e81759d4b81c9cc8b: Status 404 returned error can't find the container with id 49a44644218a4f6b70562c0d148aeff398dece9161648a0e81759d4b81c9cc8b
Jul 09 04:03:12.157855 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.157811    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:03:12.175172 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.175128    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"]
Jul 09 04:03:12.185956 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:03:12.185928    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cc2bc0_0854_49b6_bc00_86f262e5b166.slice/crio-a198dc9761cb4cc1165b5190739d75aeb7bf1db8baf58a16d4270f3cf4fb4d0f WatchSource:0}: Error finding container a198dc9761cb4cc1165b5190739d75aeb7bf1db8baf58a16d4270f3cf4fb4d0f: Status 404 returned error can't find the container with id a198dc9761cb4cc1165b5190739d75aeb7bf1db8baf58a16d4270f3cf4fb4d0f
Jul 09 04:03:12.199570 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.199543    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:12.201509 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.201458    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:12.201978 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.201959    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:03:12.203309 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.203276    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:12.204974 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.204943    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:12.206533 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.206444    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45w7k\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:03:12.207986 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.207958    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:12.250660 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.250639    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:12.252707 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.252680    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:12.254180 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.254155    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45w7k\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:03:12.255588 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:12.255566    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:12.346094 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346055    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume\") pod \"e991c768-cc36-4bd7-b636-f9114f99a7d4\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") "
Jul 09 04:03:12.346256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346153    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cffw5\" (UniqueName: \"kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5\") pod \"e991c768-cc36-4bd7-b636-f9114f99a7d4\" (UID: \"e991c768-cc36-4bd7-b636-f9114f99a7d4\") "
Jul 09 04:03:12.346256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5kpp\" (UniqueName: \"kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp\") pod \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") "
Jul 09 04:03:12.346256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346212    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume\") pod \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\" (UID: \"c579c14b-578f-46ed-9e35-a12bf8ce85ab\") "
Jul 09 04:03:12.346256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346246    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmrqf\" (UniqueName: \"kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf\") pod \"967a4712-6de8-45a4-a21d-22daa3a91451\" (UID: \"967a4712-6de8-45a4-a21d-22daa3a91451\") "
Jul 09 04:03:12.346510 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346353    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e991c768-cc36-4bd7-b636-f9114f99a7d4" (UID: "e991c768-cc36-4bd7-b636-f9114f99a7d4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:03:12.346579 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346565    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e991c768-cc36-4bd7-b636-f9114f99a7d4-extensions-socket-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:12.346774 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.346748    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c579c14b-578f-46ed-9e35-a12bf8ce85ab" (UID: "c579c14b-578f-46ed-9e35-a12bf8ce85ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:03:12.348445 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.348424    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp" (OuterVolumeSpecName: "kube-api-access-m5kpp") pod "c579c14b-578f-46ed-9e35-a12bf8ce85ab" (UID: "c579c14b-578f-46ed-9e35-a12bf8ce85ab"). InnerVolumeSpecName "kube-api-access-m5kpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:03:12.348513 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.348477    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5" (OuterVolumeSpecName: "kube-api-access-cffw5") pod "e991c768-cc36-4bd7-b636-f9114f99a7d4" (UID: "e991c768-cc36-4bd7-b636-f9114f99a7d4"). InnerVolumeSpecName "kube-api-access-cffw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:03:12.348551 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.348518    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf" (OuterVolumeSpecName: "kube-api-access-hmrqf") pod "967a4712-6de8-45a4-a21d-22daa3a91451" (UID: "967a4712-6de8-45a4-a21d-22daa3a91451"). InnerVolumeSpecName "kube-api-access-hmrqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:03:12.447106 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.447024    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cffw5\" (UniqueName: \"kubernetes.io/projected/e991c768-cc36-4bd7-b636-f9114f99a7d4-kube-api-access-cffw5\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:12.447106 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.447051    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5kpp\" (UniqueName: \"kubernetes.io/projected/c579c14b-578f-46ed-9e35-a12bf8ce85ab-kube-api-access-m5kpp\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:12.447106 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.447060    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c579c14b-578f-46ed-9e35-a12bf8ce85ab-extensions-socket-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:12.447106 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:12.447071    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmrqf\" (UniqueName: \"kubernetes.io/projected/967a4712-6de8-45a4-a21d-22daa3a91451-kube-api-access-hmrqf\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:13.070649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.070615    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" path="/var/lib/kubelet/pods/967a4712-6de8-45a4-a21d-22daa3a91451/volumes"
Jul 09 04:03:13.071236 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.070978    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" path="/var/lib/kubelet/pods/c579c14b-578f-46ed-9e35-a12bf8ce85ab/volumes"
Jul 09 04:03:13.071392 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.071287    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" path="/var/lib/kubelet/pods/e991c768-cc36-4bd7-b636-f9114f99a7d4/volumes"
Jul 09 04:03:13.097370 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.097335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9" event={"ID":"090b633f-afef-417b-964c-0eae42ed5ca4","Type":"ContainerStarted","Data":"6b1873bbc27b5e43a06835befbd87871db5183d3843ef928c6443972747e7229"}
Jul 09 04:03:13.099069 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.099041    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" event={"ID":"73ea5377-0e07-4049-a48e-b3dc91839167","Type":"ContainerStarted","Data":"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"}
Jul 09 04:03:13.099208 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.099095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" event={"ID":"73ea5377-0e07-4049-a48e-b3dc91839167","Type":"ContainerStarted","Data":"49a44644218a4f6b70562c0d148aeff398dece9161648a0e81759d4b81c9cc8b"}
Jul 09 04:03:13.099208 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.099120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:03:13.100530 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.100505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" event={"ID":"48a67e23-d506-468d-8936-9cd2da99f7b8","Type":"ContainerStarted","Data":"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"}
Jul 09 04:03:13.100647 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.100550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" event={"ID":"48a67e23-d506-468d-8936-9cd2da99f7b8","Type":"ContainerStarted","Data":"174ec9d4c5344374ff01ad74c952f9bf5e4707d3432aa35cfdc375834389f7d2"}
Jul 09 04:03:13.100709 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.100658    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:03:13.101942 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.101926    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:13.101942 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.101939    2569 scope.go:117] "RemoveContainer" containerID="b3544796d7bd4e32f626a92562a7eac31ab3191c0e42d9353b68020d79412373"
Jul 09 04:03:13.103898 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.103844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf" event={"ID":"a8cc2bc0-0854-49b6-bc00-86f262e5b166","Type":"ContainerStarted","Data":"7a8c0d4b89bda12fe50b5c0883ab8f35ddf0a1eb314a9d5bfe444b3f8a77cc4a"}
Jul 09 04:03:13.104187 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.104077    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:03:13.104276 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.104201    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf" event={"ID":"a8cc2bc0-0854-49b6-bc00-86f262e5b166","Type":"ContainerStarted","Data":"a198dc9761cb4cc1165b5190739d75aeb7bf1db8baf58a16d4270f3cf4fb4d0f"}
Jul 09 04:03:13.105215 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.105197    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:03:13.106566 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.106544    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:13.112372 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.112353    2569 scope.go:117] "RemoveContainer" containerID="a6a48b6486fde0fd61e7d4bc08af6f8e542714d4472cd2523f405ae13971436d"
Jul 09 04:03:13.113147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.113108    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4lk9" podStartSLOduration=1.948893214 podStartE2EDuration="26.113092702s" totalImagesPullingTime="24.164199488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:13.111917213 +0000 UTC m=+422.578286889" watchObservedRunningTime="2026-07-09 04:03:13.113092702 +0000 UTC m=+422.579462379"
Jul 09 04:03:13.121180 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.121155    2569 scope.go:117] "RemoveContainer" containerID="d02b00dc779d4fac2a92178b530e0d50b0a7e20f326525fcf734ccb905f7fb11"
Jul 09 04:03:13.132271 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.132228    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" podStartSLOduration=16.132213878 podStartE2EDuration="16.132213878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:13.129899714 +0000 UTC m=+422.596269406" watchObservedRunningTime="2026-07-09 04:03:13.132213878 +0000 UTC m=+422.598583554"
Jul 09 04:03:13.144678 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.144629    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf" podStartSLOduration=16.144608523 podStartE2EDuration="16.144608523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:13.143713564 +0000 UTC m=+422.610083266" watchObservedRunningTime="2026-07-09 04:03:13.144608523 +0000 UTC m=+422.610978201"
Jul 09 04:03:13.145419 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:13.145371    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xj6z2\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="c579c14b-578f-46ed-9e35-a12bf8ce85ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj6z2"
Jul 09 04:03:13.163995 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:13.163958    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45w7k\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="967a4712-6de8-45a4-a21d-22daa3a91451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45w7k"
Jul 09 04:03:13.164304 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:13.164264    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" podStartSLOduration=16.164249752 podStartE2EDuration="16.164249752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:13.162100324 +0000 UTC m=+422.628470026" watchObservedRunningTime="2026-07-09 04:03:13.164249752 +0000 UTC m=+422.630619427"
Jul 09 04:03:13.165515 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:13.165489    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xvhzd\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="e991c768-cc36-4bd7-b636-f9114f99a7d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xvhzd"
Jul 09 04:03:20.242232 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:20.242188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:20.342115 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:20.342083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:24.116275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.116241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mllsf"
Jul 09 04:03:24.116735 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.116316    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:03:24.116735 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.116359    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:03:24.197521 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.197485    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:03:24.197725 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.197696    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" podUID="73ea5377-0e07-4049-a48e-b3dc91839167" containerName="manager" containerID="cri-o://bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484" gracePeriod=10
Jul 09 04:03:24.454977 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.454947    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:03:24.457739 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.457716    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.461095 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.461066    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:03:24.469405 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.469384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:03:24.550732 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.550694    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume\") pod \"73ea5377-0e07-4049-a48e-b3dc91839167\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") "
Jul 09 04:03:24.550891 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.550767    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p54wk\" (UniqueName: \"kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk\") pod \"73ea5377-0e07-4049-a48e-b3dc91839167\" (UID: \"73ea5377-0e07-4049-a48e-b3dc91839167\") "
Jul 09 04:03:24.550932 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.550894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgkn\" (UniqueName: \"kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.550932 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.550921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.551143 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.551116    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73ea5377-0e07-4049-a48e-b3dc91839167" (UID: "73ea5377-0e07-4049-a48e-b3dc91839167"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:03:24.552893 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.552874    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk" (OuterVolumeSpecName: "kube-api-access-p54wk") pod "73ea5377-0e07-4049-a48e-b3dc91839167" (UID: "73ea5377-0e07-4049-a48e-b3dc91839167"). InnerVolumeSpecName "kube-api-access-p54wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:03:24.651511 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.651476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgkn\" (UniqueName: \"kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.651511 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.651518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.651777 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.651583    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ea5377-0e07-4049-a48e-b3dc91839167-extensions-socket-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:24.651777 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.651594    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p54wk\" (UniqueName: \"kubernetes.io/projected/73ea5377-0e07-4049-a48e-b3dc91839167-kube-api-access-p54wk\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:24.651938 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.651922    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.660834 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.660803    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgkn\" (UniqueName: \"kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn\") pod \"kuadrant-operator-controller-manager-86878c769f-wfsnh\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.768785 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.768736    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:24.907451 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:24.907427    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:03:24.909773 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:03:24.909745    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531cfe45_909a_4fef_9d5d_0d00d9f77eb2.slice/crio-259f286c4551cb128078581c0a3971dfd0d4c4b4cf423c54726c38b7708fde2c WatchSource:0}: Error finding container 259f286c4551cb128078581c0a3971dfd0d4c4b4cf423c54726c38b7708fde2c: Status 404 returned error can't find the container with id 259f286c4551cb128078581c0a3971dfd0d4c4b4cf423c54726c38b7708fde2c
Jul 09 04:03:25.171838 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.171799    2569 generic.go:356] "Generic (PLEG): container finished" podID="73ea5377-0e07-4049-a48e-b3dc91839167" containerID="bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484" exitCode=0
Jul 09 04:03:25.172330 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.171851    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"
Jul 09 04:03:25.172330 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.171889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" event={"ID":"73ea5377-0e07-4049-a48e-b3dc91839167","Type":"ContainerDied","Data":"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"}
Jul 09 04:03:25.172330 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.171951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w" event={"ID":"73ea5377-0e07-4049-a48e-b3dc91839167","Type":"ContainerDied","Data":"49a44644218a4f6b70562c0d148aeff398dece9161648a0e81759d4b81c9cc8b"}
Jul 09 04:03:25.172330 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.171979    2569 scope.go:117] "RemoveContainer" containerID="bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"
Jul 09 04:03:25.173784 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.173746    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" event={"ID":"531cfe45-909a-4fef-9d5d-0d00d9f77eb2","Type":"ContainerStarted","Data":"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"}
Jul 09 04:03:25.173888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.173793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" event={"ID":"531cfe45-909a-4fef-9d5d-0d00d9f77eb2","Type":"ContainerStarted","Data":"259f286c4551cb128078581c0a3971dfd0d4c4b4cf423c54726c38b7708fde2c"}
Jul 09 04:03:25.173888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.173823    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:25.181239 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.181222    2569 scope.go:117] "RemoveContainer" containerID="bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"
Jul 09 04:03:25.181501 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:25.181483    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484\": container with ID starting with bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484 not found: ID does not exist" containerID="bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"
Jul 09 04:03:25.181567 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.181512    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484"} err="failed to get container status \"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484\": rpc error: code = NotFound desc = could not find container \"bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484\": container with ID starting with bac5e14226d46a7f52f9caaad7a2e7fc1f631e7944d1938ca499ceef8dbfe484 not found: ID does not exist"
Jul 09 04:03:25.198100 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.198031    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" podStartSLOduration=1.197994434 podStartE2EDuration="1.197994434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:25.196111564 +0000 UTC m=+434.662481259" watchObservedRunningTime="2026-07-09 04:03:25.197994434 +0000 UTC m=+434.664364111"
Jul 09 04:03:25.211525 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.211497    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:03:25.214557 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:25.214530    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rjq9w"]
Jul 09 04:03:27.071949 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:27.071903    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ea5377-0e07-4049-a48e-b3dc91839167" path="/var/lib/kubelet/pods/73ea5377-0e07-4049-a48e-b3dc91839167/volumes"
Jul 09 04:03:30.994439 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:30.994403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:31.196207 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:31.196114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:31.250377 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:31.250302    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:36.182619 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:36.182591    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:03:36.228599 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:36.228568    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:03:36.228816 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:36.228787    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" podUID="48a67e23-d506-468d-8936-9cd2da99f7b8" containerName="manager" containerID="cri-o://15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7" gracePeriod=10
Jul 09 04:03:37.033709 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.033676    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:03:37.063649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.063586    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume\") pod \"48a67e23-d506-468d-8936-9cd2da99f7b8\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") "
Jul 09 04:03:37.063831 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.063757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzdw6\" (UniqueName: \"kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6\") pod \"48a67e23-d506-468d-8936-9cd2da99f7b8\" (UID: \"48a67e23-d506-468d-8936-9cd2da99f7b8\") "
Jul 09 04:03:37.068975 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.068937    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48a67e23-d506-468d-8936-9cd2da99f7b8" (UID: "48a67e23-d506-468d-8936-9cd2da99f7b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:03:37.071432 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.071381    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6" (OuterVolumeSpecName: "kube-api-access-fzdw6") pod "48a67e23-d506-468d-8936-9cd2da99f7b8" (UID: "48a67e23-d506-468d-8936-9cd2da99f7b8"). InnerVolumeSpecName "kube-api-access-fzdw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:03:37.165207 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.165114    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48a67e23-d506-468d-8936-9cd2da99f7b8-extensions-socket-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:37.165207 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.165149    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzdw6\" (UniqueName: \"kubernetes.io/projected/48a67e23-d506-468d-8936-9cd2da99f7b8-kube-api-access-fzdw6\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:03:37.239129 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.239094    2569 generic.go:356] "Generic (PLEG): container finished" podID="48a67e23-d506-468d-8936-9cd2da99f7b8" containerID="15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7" exitCode=0
Jul 09 04:03:37.239529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.239153    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"
Jul 09 04:03:37.239529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.239186    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" event={"ID":"48a67e23-d506-468d-8936-9cd2da99f7b8","Type":"ContainerDied","Data":"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"}
Jul 09 04:03:37.239529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.239243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7" event={"ID":"48a67e23-d506-468d-8936-9cd2da99f7b8","Type":"ContainerDied","Data":"174ec9d4c5344374ff01ad74c952f9bf5e4707d3432aa35cfdc375834389f7d2"}
Jul 09 04:03:37.239529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.239265    2569 scope.go:117] "RemoveContainer" containerID="15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"
Jul 09 04:03:37.248506 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.248487    2569 scope.go:117] "RemoveContainer" containerID="15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"
Jul 09 04:03:37.248797 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:03:37.248778    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7\": container with ID starting with 15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7 not found: ID does not exist" containerID="15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"
Jul 09 04:03:37.248852 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.248812    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7"} err="failed to get container status \"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7\": rpc error: code = NotFound desc = could not find container \"15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7\": container with ID starting with 15849fa85dbd6951f8b2df4f7f64c1002fd96bfff01ed9aab973fb068335bef7 not found: ID does not exist"
Jul 09 04:03:37.263876 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.263844    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:03:37.265587 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:37.265568    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9kmd7"]
Jul 09 04:03:39.070913 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:39.070877    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a67e23-d506-468d-8936-9cd2da99f7b8" path="/var/lib/kubelet/pods/48a67e23-d506-468d-8936-9cd2da99f7b8/volumes"
Jul 09 04:03:40.535711 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:40.535672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:41.033131 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:41.033093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.042499 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.042455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.043248 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043229    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:03:56.043603 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043590    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ea5377-0e07-4049-a48e-b3dc91839167" containerName="manager"
Jul 09 04:03:56.043641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043605    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ea5377-0e07-4049-a48e-b3dc91839167" containerName="manager"
Jul 09 04:03:56.043641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043614    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a67e23-d506-468d-8936-9cd2da99f7b8" containerName="manager"
Jul 09 04:03:56.043641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043622    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a67e23-d506-468d-8936-9cd2da99f7b8" containerName="manager"
Jul 09 04:03:56.043732 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043683    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a67e23-d506-468d-8936-9cd2da99f7b8" containerName="manager"
Jul 09 04:03:56.043732 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.043695    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ea5377-0e07-4049-a48e-b3dc91839167" containerName="manager"
Jul 09 04:03:56.067195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.067157    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:03:56.067374 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.067291    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.069518 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.069489    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 04:03:56.147949 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.147872    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:03:56.152206 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.152169    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.211445 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.211382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.232204 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.232171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75mn6\" (UniqueName: \"kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.232383 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.232248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.333052 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.332943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.333219 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.333062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75mn6\" (UniqueName: \"kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.333589 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.333564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.340548 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.340519    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75mn6\" (UniqueName: \"kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6\") pod \"limitador-limitador-64c94fd64f-d6pdb\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.378789 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.378753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:03:56.514797 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.514770    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:03:56.517126 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:03:56.517099    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123574a8_2b35_4799_8c66_ceecb9003168.slice/crio-66ae3228ced2aa26f8015b79d7c72ac027e181b29b346417607ea33571fbeff2 WatchSource:0}: Error finding container 66ae3228ced2aa26f8015b79d7c72ac027e181b29b346417607ea33571fbeff2: Status 404 returned error can't find the container with id 66ae3228ced2aa26f8015b79d7c72ac027e181b29b346417607ea33571fbeff2
Jul 09 04:03:56.859030 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.858955    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.914388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.914347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:03:56.946857 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.946821    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:03:56.951727 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.951702    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:03:56.953580 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.953558    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:03:56.953966 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:56.953947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kgtrg\""
Jul 09 04:03:57.039022 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.038970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knskd\" (UniqueName: \"kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd\") pod \"authorino-75d556bd77-x6zl6\" (UID: \"b0b85f7d-5c02-4601-90ef-6bdb8e318945\") " pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:03:57.140335 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.140256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knskd\" (UniqueName: \"kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd\") pod \"authorino-75d556bd77-x6zl6\" (UID: \"b0b85f7d-5c02-4601-90ef-6bdb8e318945\") " pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:03:57.148177 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.148151    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knskd\" (UniqueName: \"kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd\") pod \"authorino-75d556bd77-x6zl6\" (UID: \"b0b85f7d-5c02-4601-90ef-6bdb8e318945\") " pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:03:57.261665 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.261402    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:03:57.352735 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.352612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" event={"ID":"123574a8-2b35-4799-8c66-ceecb9003168","Type":"ContainerStarted","Data":"66ae3228ced2aa26f8015b79d7c72ac027e181b29b346417607ea33571fbeff2"}
Jul 09 04:03:57.456434 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:57.455311    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:03:57.460980 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:03:57.460951    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0b85f7d_5c02_4601_90ef_6bdb8e318945.slice/crio-21ccc9e58d79ff7522c6d14d010a12686ac665d8a455633b8affc5415a943909 WatchSource:0}: Error finding container 21ccc9e58d79ff7522c6d14d010a12686ac665d8a455633b8affc5415a943909: Status 404 returned error can't find the container with id 21ccc9e58d79ff7522c6d14d010a12686ac665d8a455633b8affc5415a943909
Jul 09 04:03:58.361542 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:03:58.361493    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x6zl6" event={"ID":"b0b85f7d-5c02-4601-90ef-6bdb8e318945","Type":"ContainerStarted","Data":"21ccc9e58d79ff7522c6d14d010a12686ac665d8a455633b8affc5415a943909"}
Jul 09 04:04:00.374349 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:00.374319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" event={"ID":"123574a8-2b35-4799-8c66-ceecb9003168","Type":"ContainerStarted","Data":"970956c1382601e2ade12f8c2d14751fe52743e2d96aaa66b4626df141aac8f4"}
Jul 09 04:04:00.374784 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:00.374447    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:04:00.396474 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:00.394665    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" podStartSLOduration=1.529408452 podStartE2EDuration="4.394644874s" totalImagesPullingTime="2.865236422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:00.39168183 +0000 UTC m=+469.858051504" watchObservedRunningTime="2026-07-09 04:04:00.394644874 +0000 UTC m=+469.861014541"
Jul 09 04:04:01.382359 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:01.382315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x6zl6" event={"ID":"b0b85f7d-5c02-4601-90ef-6bdb8e318945","Type":"ContainerStarted","Data":"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"}
Jul 09 04:04:01.396289 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:01.396110    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-x6zl6" podStartSLOduration=1.624500235 podStartE2EDuration="5.396092613s" totalImagesPullingTime="3.771592378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:01.395921695 +0000 UTC m=+470.862291370" watchObservedRunningTime="2026-07-09 04:04:01.396092613 +0000 UTC m=+470.862462288"
Jul 09 04:04:11.384065 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:11.383951    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:04:13.057244 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:13.057202    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:04:13.057810 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:13.057475    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" podUID="123574a8-2b35-4799-8c66-ceecb9003168" containerName="limitador" containerID="cri-o://970956c1382601e2ade12f8c2d14751fe52743e2d96aaa66b4626df141aac8f4" gracePeriod=30
Jul 09 04:04:13.444992 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:13.444957    2569 generic.go:356] "Generic (PLEG): container finished" podID="123574a8-2b35-4799-8c66-ceecb9003168" containerID="970956c1382601e2ade12f8c2d14751fe52743e2d96aaa66b4626df141aac8f4" exitCode=0
Jul 09 04:04:13.445197 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:13.445035    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" event={"ID":"123574a8-2b35-4799-8c66-ceecb9003168","Type":"ContainerDied","Data":"970956c1382601e2ade12f8c2d14751fe52743e2d96aaa66b4626df141aac8f4"}
Jul 09 04:04:14.014537 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.014509    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:04:14.095079 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.095039    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file\") pod \"123574a8-2b35-4799-8c66-ceecb9003168\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") "
Jul 09 04:04:14.095079 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.095089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75mn6\" (UniqueName: \"kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6\") pod \"123574a8-2b35-4799-8c66-ceecb9003168\" (UID: \"123574a8-2b35-4799-8c66-ceecb9003168\") "
Jul 09 04:04:14.095613 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.095480    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file" (OuterVolumeSpecName: "config-file") pod "123574a8-2b35-4799-8c66-ceecb9003168" (UID: "123574a8-2b35-4799-8c66-ceecb9003168"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:04:14.097289 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.097267    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6" (OuterVolumeSpecName: "kube-api-access-75mn6") pod "123574a8-2b35-4799-8c66-ceecb9003168" (UID: "123574a8-2b35-4799-8c66-ceecb9003168"). InnerVolumeSpecName "kube-api-access-75mn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:04:14.196314 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.196280    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/123574a8-2b35-4799-8c66-ceecb9003168-config-file\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:04:14.196314 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.196311    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75mn6\" (UniqueName: \"kubernetes.io/projected/123574a8-2b35-4799-8c66-ceecb9003168-kube-api-access-75mn6\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:04:14.405157 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.405126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:14.451463 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.451370    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb" event={"ID":"123574a8-2b35-4799-8c66-ceecb9003168","Type":"ContainerDied","Data":"66ae3228ced2aa26f8015b79d7c72ac027e181b29b346417607ea33571fbeff2"}
Jul 09 04:04:14.451463 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.451436    2569 scope.go:117] "RemoveContainer" containerID="970956c1382601e2ade12f8c2d14751fe52743e2d96aaa66b4626df141aac8f4"
Jul 09 04:04:14.451716 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.451391    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"
Jul 09 04:04:14.476178 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.476143    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:04:14.479612 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.479577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:14.480614 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.480592    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d6pdb"]
Jul 09 04:04:14.834256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.834169    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"]
Jul 09 04:04:14.834757 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.834741    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123574a8-2b35-4799-8c66-ceecb9003168" containerName="limitador"
Jul 09 04:04:14.834801 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.834760    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="123574a8-2b35-4799-8c66-ceecb9003168" containerName="limitador"
Jul 09 04:04:14.834886 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.834863    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="123574a8-2b35-4799-8c66-ceecb9003168" containerName="limitador"
Jul 09 04:04:14.839800 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.839772    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:14.843535 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.843514    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 04:04:14.844195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.844152    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7cptt\""
Jul 09 04:04:14.844323 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.844178    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 04:04:14.844703 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.844680    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 04:04:14.847396 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.847337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"]
Jul 09 04:04:14.865534 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.865503    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:14.902228 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.902190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwqz\" (UniqueName: \"kubernetes.io/projected/ce519f69-698c-4c9b-9132-5c187243229f-kube-api-access-5lwqz\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:14.902416 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:14.902252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce519f69-698c-4c9b-9132-5c187243229f-data\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.003274 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.003236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwqz\" (UniqueName: \"kubernetes.io/projected/ce519f69-698c-4c9b-9132-5c187243229f-kube-api-access-5lwqz\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.003480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.003300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce519f69-698c-4c9b-9132-5c187243229f-data\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.003677 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.003646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce519f69-698c-4c9b-9132-5c187243229f-data\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.012450 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.012424    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwqz\" (UniqueName: \"kubernetes.io/projected/ce519f69-698c-4c9b-9132-5c187243229f-kube-api-access-5lwqz\") pod \"postgres-69fb4594cf-46mz2\" (UID: \"ce519f69-698c-4c9b-9132-5c187243229f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.071277 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.071243    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="123574a8-2b35-4799-8c66-ceecb9003168" path="/var/lib/kubelet/pods/123574a8-2b35-4799-8c66-ceecb9003168/volumes"
Jul 09 04:04:15.153629 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.153539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:15.302684 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.302657    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"]
Jul 09 04:04:15.304845 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:04:15.304821    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce519f69_698c_4c9b_9132_5c187243229f.slice/crio-3b88889268855f7f06936aa10a378c28f8c4d6ab2eff92398620a0589f4a4ef6 WatchSource:0}: Error finding container 3b88889268855f7f06936aa10a378c28f8c4d6ab2eff92398620a0589f4a4ef6: Status 404 returned error can't find the container with id 3b88889268855f7f06936aa10a378c28f8c4d6ab2eff92398620a0589f4a4ef6
Jul 09 04:04:15.463053 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:15.462989    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2" event={"ID":"ce519f69-698c-4c9b-9132-5c187243229f","Type":"ContainerStarted","Data":"3b88889268855f7f06936aa10a378c28f8c4d6ab2eff92398620a0589f4a4ef6"}
Jul 09 04:04:20.496562 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:20.496468    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2" event={"ID":"ce519f69-698c-4c9b-9132-5c187243229f","Type":"ContainerStarted","Data":"915f81d536588ba67854812f5f6d1ef27f1b2a84e033dd5327fba61935f7564c"}
Jul 09 04:04:20.496562 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:20.496558    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:20.510817 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:20.510762    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2" podStartSLOduration=1.579825649 podStartE2EDuration="6.510742221s" totalImagesPullingTime="4.930916572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:20.510095391 +0000 UTC m=+489.976465093" watchObservedRunningTime="2026-07-09 04:04:20.510742221 +0000 UTC m=+489.977111899"
Jul 09 04:04:26.531955 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:26.531925    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-46mz2"
Jul 09 04:04:26.844181 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:26.844100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:27.211778 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.211740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:27.311107 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.311070    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78d6f4f7d-jsrls"]
Jul 09 04:04:27.317642 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.317619    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.319500 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.319471    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78d6f4f7d-jsrls"]
Jul 09 04:04:27.404766 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.404732    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d6f4f7d-jsrls"]
Jul 09 04:04:27.405045 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:04:27.404991    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7qqnx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-78d6f4f7d-jsrls" podUID="16233d8a-fc29-43e9-937b-c2d5d2cd774b"
Jul 09 04:04:27.414200 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.414167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqnx\" (UniqueName: \"kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx\") pod \"authorino-78d6f4f7d-jsrls\" (UID: \"16233d8a-fc29-43e9-937b-c2d5d2cd774b\") " pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.515411 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.515332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqnx\" (UniqueName: \"kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx\") pod \"authorino-78d6f4f7d-jsrls\" (UID: \"16233d8a-fc29-43e9-937b-c2d5d2cd774b\") " pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.523375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.523342    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqnx\" (UniqueName: \"kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx\") pod \"authorino-78d6f4f7d-jsrls\" (UID: \"16233d8a-fc29-43e9-937b-c2d5d2cd774b\") " pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.532247 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.532221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.540309 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.540288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:27.615836 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.615799    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qqnx\" (UniqueName: \"kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx\") pod \"16233d8a-fc29-43e9-937b-c2d5d2cd774b\" (UID: \"16233d8a-fc29-43e9-937b-c2d5d2cd774b\") "
Jul 09 04:04:27.618097 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.618072    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx" (OuterVolumeSpecName: "kube-api-access-7qqnx") pod "16233d8a-fc29-43e9-937b-c2d5d2cd774b" (UID: "16233d8a-fc29-43e9-937b-c2d5d2cd774b"). InnerVolumeSpecName "kube-api-access-7qqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:04:27.717486 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:27.717445    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qqnx\" (UniqueName: \"kubernetes.io/projected/16233d8a-fc29-43e9-937b-c2d5d2cd774b-kube-api-access-7qqnx\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:04:28.536753 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:28.536722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d6f4f7d-jsrls"
Jul 09 04:04:28.564307 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:28.564272    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d6f4f7d-jsrls"]
Jul 09 04:04:28.567509 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:28.567483    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78d6f4f7d-jsrls"]
Jul 09 04:04:29.070529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.070494    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16233d8a-fc29-43e9-937b-c2d5d2cd774b" path="/var/lib/kubelet/pods/16233d8a-fc29-43e9-937b-c2d5d2cd774b/volumes"
Jul 09 04:04:29.193894 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.193862    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:04:29.194194 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.194081    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-x6zl6" podUID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" containerName="authorino" containerID="cri-o://d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c" gracePeriod=30
Jul 09 04:04:29.447118 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.447092    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:04:29.533240 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.533205    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knskd\" (UniqueName: \"kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd\") pod \"b0b85f7d-5c02-4601-90ef-6bdb8e318945\" (UID: \"b0b85f7d-5c02-4601-90ef-6bdb8e318945\") "
Jul 09 04:04:29.535446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.535417    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd" (OuterVolumeSpecName: "kube-api-access-knskd") pod "b0b85f7d-5c02-4601-90ef-6bdb8e318945" (UID: "b0b85f7d-5c02-4601-90ef-6bdb8e318945"). InnerVolumeSpecName "kube-api-access-knskd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:04:29.543446 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.543417    2569 generic.go:356] "Generic (PLEG): container finished" podID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" containerID="d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c" exitCode=0
Jul 09 04:04:29.543818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.543479    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x6zl6"
Jul 09 04:04:29.543818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.543502    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x6zl6" event={"ID":"b0b85f7d-5c02-4601-90ef-6bdb8e318945","Type":"ContainerDied","Data":"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"}
Jul 09 04:04:29.543818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.543560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x6zl6" event={"ID":"b0b85f7d-5c02-4601-90ef-6bdb8e318945","Type":"ContainerDied","Data":"21ccc9e58d79ff7522c6d14d010a12686ac665d8a455633b8affc5415a943909"}
Jul 09 04:04:29.543818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.543584    2569 scope.go:117] "RemoveContainer" containerID="d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"
Jul 09 04:04:29.553656 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.553639    2569 scope.go:117] "RemoveContainer" containerID="d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"
Jul 09 04:04:29.553990 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:04:29.553967    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c\": container with ID starting with d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c not found: ID does not exist" containerID="d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"
Jul 09 04:04:29.554105 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.554068    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c"} err="failed to get container status \"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c\": rpc error: code = NotFound desc = could not find container \"d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c\": container with ID starting with d3bf7a0402c82f9021a3b45742c5732d4af13b87284d9106d2d4c64540ee270c not found: ID does not exist"
Jul 09 04:04:29.564063 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.564032    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:04:29.567412 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.567389    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x6zl6"]
Jul 09 04:04:29.634059 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:29.633959    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knskd\" (UniqueName: \"kubernetes.io/projected/b0b85f7d-5c02-4601-90ef-6bdb8e318945-kube-api-access-knskd\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:04:31.071075 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:31.071041    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" path="/var/lib/kubelet/pods/b0b85f7d-5c02-4601-90ef-6bdb8e318945/volumes"
Jul 09 04:04:33.705277 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:33.705229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:33.763730 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:33.763696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:33.846610 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:33.846572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:36.940484 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:36.940425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:04:37.033290 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:04:37.033249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:09.579544 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:09.579457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:10.021720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.021689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:10.063918 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.063888    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"]
Jul 09 04:05:10.064343 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.064326    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" containerName="authorino"
Jul 09 04:05:10.064397 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.064345    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" containerName="authorino"
Jul 09 04:05:10.064440 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.064428    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b85f7d-5c02-4601-90ef-6bdb8e318945" containerName="authorino"
Jul 09 04:05:10.067546 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.067523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.069888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.069865    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-znghr\""
Jul 09 04:05:10.070375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.070348    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 04:05:10.078831 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.078798    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"]
Jul 09 04:05:10.205229 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.205196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn82z\" (UniqueName: \"kubernetes.io/projected/45ad64f0-6d12-4e2e-902e-07a31459b6e2-kube-api-access-xn82z\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.205433 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.205244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45ad64f0-6d12-4e2e-902e-07a31459b6e2-openshift-service-ca\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.205433 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.205385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45ad64f0-6d12-4e2e-902e-07a31459b6e2-maas-api-tls\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.282498 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.282405    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:10.305939 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.305906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45ad64f0-6d12-4e2e-902e-07a31459b6e2-maas-api-tls\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.306146 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.305960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn82z\" (UniqueName: \"kubernetes.io/projected/45ad64f0-6d12-4e2e-902e-07a31459b6e2-kube-api-access-xn82z\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.306146 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.306016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45ad64f0-6d12-4e2e-902e-07a31459b6e2-openshift-service-ca\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.306649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.306623    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45ad64f0-6d12-4e2e-902e-07a31459b6e2-openshift-service-ca\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.308501 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.308477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45ad64f0-6d12-4e2e-902e-07a31459b6e2-maas-api-tls\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.314481 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.314453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn82z\" (UniqueName: \"kubernetes.io/projected/45ad64f0-6d12-4e2e-902e-07a31459b6e2-kube-api-access-xn82z\") pod \"maas-api-5d6d755b6c-69n9f\" (UID: \"45ad64f0-6d12-4e2e-902e-07a31459b6e2\") " pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.379644 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.379611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:10.529581 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.529439    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"]
Jul 09 04:05:10.532212 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:05:10.532179    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ad64f0_6d12_4e2e_902e_07a31459b6e2.slice/crio-6e4f7bac11741a79a7601f7b3d0ea59ea98ca09aad0176e0d726941a85b76d1e WatchSource:0}: Error finding container 6e4f7bac11741a79a7601f7b3d0ea59ea98ca09aad0176e0d726941a85b76d1e: Status 404 returned error can't find the container with id 6e4f7bac11741a79a7601f7b3d0ea59ea98ca09aad0176e0d726941a85b76d1e
Jul 09 04:05:10.588959 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.588922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:10.677903 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.677874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:10.681483 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.681454    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-m2w8f"]
Jul 09 04:05:10.697983 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.697942    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-m2w8f"]
Jul 09 04:05:10.698196 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.698071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.700654 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.700624    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 04:05:10.700838 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.700633    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h52ww\""
Jul 09 04:05:10.711866 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.711839    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-99j5z"]
Jul 09 04:05:10.715314 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.715283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.723943 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.723917    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-99j5z"]
Jul 09 04:05:10.754992 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.754953    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f" event={"ID":"45ad64f0-6d12-4e2e-902e-07a31459b6e2","Type":"ContainerStarted","Data":"6e4f7bac11741a79a7601f7b3d0ea59ea98ca09aad0176e0d726941a85b76d1e"}
Jul 09 04:05:10.809624 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.809537    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sprmp\" (UniqueName: \"kubernetes.io/projected/977315c8-5211-45b2-863b-b6ff3ddeaa3e-kube-api-access-sprmp\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.809624 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.809585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.809857 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.809690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/977315c8-5211-45b2-863b-b6ff3ddeaa3e-plugins-config-volume\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.809857 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.809771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzcd9\" (UniqueName: \"kubernetes.io/projected/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-kube-api-access-hzcd9\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.910361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.910328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sprmp\" (UniqueName: \"kubernetes.io/projected/977315c8-5211-45b2-863b-b6ff3ddeaa3e-kube-api-access-sprmp\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.910361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.910376    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.910621 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.910416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/977315c8-5211-45b2-863b-b6ff3ddeaa3e-plugins-config-volume\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.910621 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.910452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzcd9\" (UniqueName: \"kubernetes.io/projected/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-kube-api-access-hzcd9\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.911265 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.911237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.911370 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.911239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/977315c8-5211-45b2-863b-b6ff3ddeaa3e-plugins-config-volume\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:10.918529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.918501    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzcd9\" (UniqueName: \"kubernetes.io/projected/cb8a1690-d4c4-4673-a57b-f5b8d9b837e7-kube-api-access-hzcd9\") pod \"payload-pre-processing-7964457696-m2w8f\" (UID: \"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:10.918641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:10.918509    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sprmp\" (UniqueName: \"kubernetes.io/projected/977315c8-5211-45b2-863b-b6ff3ddeaa3e-kube-api-access-sprmp\") pod \"payload-processing-58f86c7798-99j5z\" (UID: \"977315c8-5211-45b2-863b-b6ff3ddeaa3e\") " pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:11.011781 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.011750    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h52ww\""
Jul 09 04:05:11.020875 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.020837    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:11.027090 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.027062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:11.174721 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.174691    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-m2w8f"]
Jul 09 04:05:11.177768 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:05:11.177734    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8a1690_d4c4_4673_a57b_f5b8d9b837e7.slice/crio-c917eb2acc9f08865093845ba12e477ae42dfdf8e9a22cbf811999da773e2bba WatchSource:0}: Error finding container c917eb2acc9f08865093845ba12e477ae42dfdf8e9a22cbf811999da773e2bba: Status 404 returned error can't find the container with id c917eb2acc9f08865093845ba12e477ae42dfdf8e9a22cbf811999da773e2bba
Jul 09 04:05:11.196493 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.196455    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-99j5z"]
Jul 09 04:05:11.199049 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:05:11.199018    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977315c8_5211_45b2_863b_b6ff3ddeaa3e.slice/crio-01959cb9e663b1e8d35be0217db30a60b59231809772d90a8fc3a88595051deb WatchSource:0}: Error finding container 01959cb9e663b1e8d35be0217db30a60b59231809772d90a8fc3a88595051deb: Status 404 returned error can't find the container with id 01959cb9e663b1e8d35be0217db30a60b59231809772d90a8fc3a88595051deb
Jul 09 04:05:11.763202 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.763153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f" event={"ID":"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7","Type":"ContainerStarted","Data":"c917eb2acc9f08865093845ba12e477ae42dfdf8e9a22cbf811999da773e2bba"}
Jul 09 04:05:11.764504 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:11.764474    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-99j5z" event={"ID":"977315c8-5211-45b2-863b-b6ff3ddeaa3e","Type":"ContainerStarted","Data":"01959cb9e663b1e8d35be0217db30a60b59231809772d90a8fc3a88595051deb"}
Jul 09 04:05:13.785563 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.785523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f" event={"ID":"cb8a1690-d4c4-4673-a57b-f5b8d9b837e7","Type":"ContainerStarted","Data":"98a5eb220244e6fbca0df78d55ed10e8556a430bc7fb0967c6760d8b62963876"}
Jul 09 04:05:13.786063 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.785651    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:13.787267 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.787240    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f" event={"ID":"45ad64f0-6d12-4e2e-902e-07a31459b6e2","Type":"ContainerStarted","Data":"c636849acb954045de2aafcb77828d146c35eac7d79576a3bea30b7fac1e2534"}
Jul 09 04:05:13.787389 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.787297    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:13.788770 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.788751    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-99j5z" event={"ID":"977315c8-5211-45b2-863b-b6ff3ddeaa3e","Type":"ContainerStarted","Data":"53143e054f4eee2007f6e2e4fd233214257534345467834af214b8872a053935"}
Jul 09 04:05:13.788865 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.788802    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:13.803887 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.803845    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f" podStartSLOduration=2.133068282 podStartE2EDuration="3.80383127s" totalImagesPullingTime="1.670762988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:13.802025799 +0000 UTC m=+543.268395484" watchObservedRunningTime="2026-07-09 04:05:13.80383127 +0000 UTC m=+543.270200945"
Jul 09 04:05:13.817802 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.817745    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f" podStartSLOduration=1.500315566 podStartE2EDuration="3.817728766s" totalImagesPullingTime="2.3174132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:13.81612173 +0000 UTC m=+543.282491459" watchObservedRunningTime="2026-07-09 04:05:13.817728766 +0000 UTC m=+543.284098448"
Jul 09 04:05:13.831416 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:13.831362    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-99j5z" podStartSLOduration=2.178678462 podStartE2EDuration="3.831343798s" totalImagesPullingTime="1.652665336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:13.829322314 +0000 UTC m=+543.295692004" watchObservedRunningTime="2026-07-09 04:05:13.831343798 +0000 UTC m=+543.297713479"
Jul 09 04:05:19.799609 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:19.799574    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d6d755b6c-69n9f"
Jul 09 04:05:20.754290 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:20.754260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:20.850131 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:20.850096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:24.796180 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:24.796145    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-99j5z"
Jul 09 04:05:24.796577 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:24.796282    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-m2w8f"
Jul 09 04:05:28.357297 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:28.357265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:32.339387 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.339351    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"]
Jul 09 04:05:32.344115 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.344095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.346356 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.346329    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 04:05:32.346487 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.346377    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 04:05:32.347349 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.347325    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lmz6c\""
Jul 09 04:05:32.347546 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.347526    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 04:05:32.350283 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.350258    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"]
Jul 09 04:05:32.375502 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.375458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:32.513467 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.513652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.513652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7bc\" (UniqueName: \"kubernetes.io/projected/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-kube-api-access-7c7bc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.513652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513567    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.513652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.513652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.513619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614536 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614536 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614816 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614816 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7bc\" (UniqueName: \"kubernetes.io/projected/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-kube-api-access-7c7bc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614816 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.614816 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.615086 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614918    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.615086 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.615086 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.614989    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.617311 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.617288    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.617426 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.617403    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.631199 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.631166    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7bc\" (UniqueName: \"kubernetes.io/projected/3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9-kube-api-access-7c7bc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2\" (UID: \"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.657091 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.657063    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:32.669242 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.669214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:32.802491 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.802456    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"]
Jul 09 04:05:32.804264 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:05:32.804240    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae7b50d_b55f_41a7_a2b3_8cb6f7e0d5b9.slice/crio-fa4314a2128fc863f39a39c3f6ad14182a6823ed0c986e939e82e1bf17bacdf8 WatchSource:0}: Error finding container fa4314a2128fc863f39a39c3f6ad14182a6823ed0c986e939e82e1bf17bacdf8: Status 404 returned error can't find the container with id fa4314a2128fc863f39a39c3f6ad14182a6823ed0c986e939e82e1bf17bacdf8
Jul 09 04:05:32.894332 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:32.894244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2" event={"ID":"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9","Type":"ContainerStarted","Data":"fa4314a2128fc863f39a39c3f6ad14182a6823ed0c986e939e82e1bf17bacdf8"}
Jul 09 04:05:34.908060 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:34.907995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2" event={"ID":"3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9","Type":"ContainerStarted","Data":"71ca20ce5abcbe9c5ce0ce908e3619fffe87867d49a59405f281edf9a5834525"}
Jul 09 04:05:34.924019 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:34.923956    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2" podStartSLOduration=1.716027569 podStartE2EDuration="2.923938313s" totalImagesPullingTime="1.207910744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:34.92316436 +0000 UTC m=+564.389534047" watchObservedRunningTime="2026-07-09 04:05:34.923938313 +0000 UTC m=+564.390307987"
Jul 09 04:05:40.254636 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:40.254590    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:41.687018 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:41.686969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:41.787386 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:41.787353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:42.657653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:42.657618    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:42.657833 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:42.657684    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:42.670318 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:42.670293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:42.960190 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:42.960166    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2"
Jul 09 04:05:49.057226 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:49.057194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:52.861429 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:52.861392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:05:53.798970 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:05:53.798931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:06:11.010093 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:11.010066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:06:11.010640 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:11.010610    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:06:11.750782 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:11.750749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:06:15.599042 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:15.598986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:06:15.647537 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:15.647500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:06:22.032196 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:06:22.032164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:04.923529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:04.923491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:29.523254 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.523215    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c7cd8ddf9-jb4gk"]
Jul 09 04:07:29.527273 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.527247    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.530300 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.530268    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 04:07:29.530451 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.530312    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kgtrg\""
Jul 09 04:07:29.533113 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.533090    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7cd8ddf9-jb4gk"]
Jul 09 04:07:29.589653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.589605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlbdh\" (UniqueName: \"kubernetes.io/projected/b754badd-1b7f-401d-b872-ef7260520e96-kube-api-access-nlbdh\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.589846 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.589678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b754badd-1b7f-401d-b872-ef7260520e96-tls-cert\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.690407 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.690373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b754badd-1b7f-401d-b872-ef7260520e96-tls-cert\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.690622 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.690510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbdh\" (UniqueName: \"kubernetes.io/projected/b754badd-1b7f-401d-b872-ef7260520e96-kube-api-access-nlbdh\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.693200 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.693178    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b754badd-1b7f-401d-b872-ef7260520e96-tls-cert\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.698040 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.697984    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbdh\" (UniqueName: \"kubernetes.io/projected/b754badd-1b7f-401d-b872-ef7260520e96-kube-api-access-nlbdh\") pod \"authorino-7c7cd8ddf9-jb4gk\" (UID: \"b754badd-1b7f-401d-b872-ef7260520e96\") " pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.838458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.838363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk"
Jul 09 04:07:29.906779 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.906741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:29.989512 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.989484    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7cd8ddf9-jb4gk"]
Jul 09 04:07:29.992371 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:07:29.992342    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb754badd_1b7f_401d_b872_ef7260520e96.slice/crio-fee224f9365cee660b9abad229866338736c4e0b6b599140a92b76194b031a84 WatchSource:0}: Error finding container fee224f9365cee660b9abad229866338736c4e0b6b599140a92b76194b031a84: Status 404 returned error can't find the container with id fee224f9365cee660b9abad229866338736c4e0b6b599140a92b76194b031a84
Jul 09 04:07:29.992496 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.992427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:29.993819 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:29.993800    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:07:30.497835 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:30.497804    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk" event={"ID":"b754badd-1b7f-401d-b872-ef7260520e96","Type":"ContainerStarted","Data":"fee224f9365cee660b9abad229866338736c4e0b6b599140a92b76194b031a84"}
Jul 09 04:07:31.051803 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:31.051769    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:31.145026 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:31.144967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:07:31.504952 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:31.504915    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk" event={"ID":"b754badd-1b7f-401d-b872-ef7260520e96","Type":"ContainerStarted","Data":"eb3d628c95ed073013f022736aac76a46663351bcbcf333421f8801619d1fa2c"}
Jul 09 04:07:31.522957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:07:31.522901    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c7cd8ddf9-jb4gk" podStartSLOduration=2.088986296 podStartE2EDuration="2.522881962s" totalImagesPullingTime="433.895666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:07:31.520063475 +0000 UTC m=+680.986433147" watchObservedRunningTime="2026-07-09 04:07:31.522881962 +0000 UTC m=+680.989251636"
Jul 09 04:08:41.389109 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:08:41.389070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:08:42.839492 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:08:42.839453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:08:48.729353 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:08:48.729317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:08:59.179169 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:08:59.179130    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:22.466309 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:22.466271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:22.566458 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:22.566424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:22.680686 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:22.680651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:28.381521 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:28.381482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:28.472346 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:28.472316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:28.646274 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:28.646194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:28.787264 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:28.787229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:34.953580 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:34.953504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:09:35.052944 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:09:35.052908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:11:00.890256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:11:00.890210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:11:11.044024 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:11:11.043914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:11:11.045078 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:11:11.045060    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:13:38.182395 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:38.182325    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:13:38.184944 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:38.182996    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" podUID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" containerName="manager" containerID="cri-o://bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a" gracePeriod=10
Jul 09 04:13:41.233744 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.233719    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:13:41.374997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.374915    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flgkn\" (UniqueName: \"kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn\") pod \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") "
Jul 09 04:13:41.375152 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.375078    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume\") pod \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\" (UID: \"531cfe45-909a-4fef-9d5d-0d00d9f77eb2\") "
Jul 09 04:13:41.375466 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.375437    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "531cfe45-909a-4fef-9d5d-0d00d9f77eb2" (UID: "531cfe45-909a-4fef-9d5d-0d00d9f77eb2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:13:41.377175 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.377152    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn" (OuterVolumeSpecName: "kube-api-access-flgkn") pod "531cfe45-909a-4fef-9d5d-0d00d9f77eb2" (UID: "531cfe45-909a-4fef-9d5d-0d00d9f77eb2"). InnerVolumeSpecName "kube-api-access-flgkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:13:41.453149 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.453114    2569 generic.go:356] "Generic (PLEG): container finished" podID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" containerID="bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a" exitCode=0
Jul 09 04:13:41.453329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.453155    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"
Jul 09 04:13:41.453329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.453170    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" event={"ID":"531cfe45-909a-4fef-9d5d-0d00d9f77eb2","Type":"ContainerDied","Data":"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"}
Jul 09 04:13:41.453329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.453215    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh" event={"ID":"531cfe45-909a-4fef-9d5d-0d00d9f77eb2","Type":"ContainerDied","Data":"259f286c4551cb128078581c0a3971dfd0d4c4b4cf423c54726c38b7708fde2c"}
Jul 09 04:13:41.453329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.453235    2569 scope.go:117] "RemoveContainer" containerID="bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"
Jul 09 04:13:41.463560 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.463536    2569 scope.go:117] "RemoveContainer" containerID="bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"
Jul 09 04:13:41.463845 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:13:41.463827    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a\": container with ID starting with bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a not found: ID does not exist" containerID="bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"
Jul 09 04:13:41.463896 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.463855    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a"} err="failed to get container status \"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a\": rpc error: code = NotFound desc = could not find container \"bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a\": container with ID starting with bb7df2855fc649f00f84e1ebb09b32baefa9747bab46323092e83f0a9310a98a not found: ID does not exist"
Jul 09 04:13:41.473689 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.473662    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:13:41.475909 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.475884    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flgkn\" (UniqueName: \"kubernetes.io/projected/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-kube-api-access-flgkn\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:13:41.476019 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.475913    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/531cfe45-909a-4fef-9d5d-0d00d9f77eb2-extensions-socket-volume\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:13:41.477555 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:41.477536    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wfsnh"]
Jul 09 04:13:43.071021 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:13:43.070973    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" path="/var/lib/kubelet/pods/531cfe45-909a-4fef-9d5d-0d00d9f77eb2/volumes"
Jul 09 04:14:39.304634 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.304599    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"]
Jul 09 04:14:39.305147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.305021    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" containerName="manager"
Jul 09 04:14:39.305147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.305035    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" containerName="manager"
Jul 09 04:14:39.305147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.305120    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="531cfe45-909a-4fef-9d5d-0d00d9f77eb2" containerName="manager"
Jul 09 04:14:39.308471 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.308451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.310963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.310941    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qrfhf\""
Jul 09 04:14:39.311997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.311975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql27n\" (UniqueName: \"kubernetes.io/projected/9363da14-8267-4713-9130-31411bc9982e-kube-api-access-ql27n\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.312131 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.312108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9363da14-8267-4713-9130-31411bc9982e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.320653 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.320630    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"]
Jul 09 04:14:39.413127 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.413080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9363da14-8267-4713-9130-31411bc9982e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.413323 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.413181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql27n\" (UniqueName: \"kubernetes.io/projected/9363da14-8267-4713-9130-31411bc9982e-kube-api-access-ql27n\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.413475 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.413453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9363da14-8267-4713-9130-31411bc9982e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.422207 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.422172    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql27n\" (UniqueName: \"kubernetes.io/projected/9363da14-8267-4713-9130-31411bc9982e-kube-api-access-ql27n\") pod \"kuadrant-operator-controller-manager-86878c769f-2pfp7\" (UID: \"9363da14-8267-4713-9130-31411bc9982e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.620083 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.619969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:39.770094 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:39.770059    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"]
Jul 09 04:14:39.773739 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:14:39.773713    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9363da14_8267_4713_9130_31411bc9982e.slice/crio-25543874c4629fb5fdf36159253e7340bbde4862a84b5d9fb6fe93a7c219357c WatchSource:0}: Error finding container 25543874c4629fb5fdf36159253e7340bbde4862a84b5d9fb6fe93a7c219357c: Status 404 returned error can't find the container with id 25543874c4629fb5fdf36159253e7340bbde4862a84b5d9fb6fe93a7c219357c
Jul 09 04:14:40.771147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:40.771102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7" event={"ID":"9363da14-8267-4713-9130-31411bc9982e","Type":"ContainerStarted","Data":"9c04336a03e77d01c14a048711bf1d4a88483ba2918ce95fa65deee3f663fb0f"}
Jul 09 04:14:40.771611 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:40.771157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7" event={"ID":"9363da14-8267-4713-9130-31411bc9982e","Type":"ContainerStarted","Data":"25543874c4629fb5fdf36159253e7340bbde4862a84b5d9fb6fe93a7c219357c"}
Jul 09 04:14:40.771611 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:40.771190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:14:40.792663 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:40.792606    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7" podStartSLOduration=1.79259057 podStartE2EDuration="1.79259057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:14:40.79170398 +0000 UTC m=+1110.258073655" watchObservedRunningTime="2026-07-09 04:14:40.79259057 +0000 UTC m=+1110.258960245"
Jul 09 04:14:51.778456 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:14:51.778424    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pfp7"
Jul 09 04:15:25.986656 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:15:25.986621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:15:27.764695 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:15:27.764660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:15:31.434554 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:15:31.434478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:15:31.501783 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:15:31.501749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:16:11.076329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:16:11.076303    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:16:11.078511 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:16:11.078488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:16:49.864997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:16:49.864953    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:19:10.882222 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:19:10.882186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:19:10.970325 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:19:10.970290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:34.159308 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:34.159275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:41.743294 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:41.743250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:50.671583 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:50.671536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:55.074997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:55.074964    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:57.933465 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:57.933427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:58.032267 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:58.032229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:20:58.347114 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:20:58.346992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:04.176735 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:04.176704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:04.248758 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:04.248721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:04.447985 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:04.447886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:04.610711 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:04.610653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:05.621144 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.621107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:05.711803 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.711758    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:05.712819 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.712791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:05.715891 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.715874    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.718215 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.718198    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b35226b1-serving-cert\""
Jul 09 04:21:05.724707 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.724672    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:05.795493 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.795456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:05.855174 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.855136    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.855174 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.855173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtnqx\" (UniqueName: \"kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.855396 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.855255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.925888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.925853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:05.956586 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.956544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.956797 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.956628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtnqx\" (UniqueName: \"kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.956797 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.956711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.957358 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.957328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.959261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.959244    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:05.975712 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:05.975684    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtnqx\" (UniqueName: \"kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx\") pod \"maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:06.027704 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.027665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:06.176591 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.176562    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:06.179525 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:21:06.179495    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051f40e2_3a58_4144_99ea_081650db498c.slice/crio-bb5c4893aead06a34c6943ff1e7131a2d281f1b390d3d59273a324ab76186b0d WatchSource:0}: Error finding container bb5c4893aead06a34c6943ff1e7131a2d281f1b390d3d59273a324ab76186b0d: Status 404 returned error can't find the container with id bb5c4893aead06a34c6943ff1e7131a2d281f1b390d3d59273a324ab76186b0d
Jul 09 04:21:06.181371 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.181351    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:21:06.220709 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.220679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:06.319995 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.319963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:06.776382 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.776345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" event={"ID":"051f40e2-3a58-4144-99ea-081650db498c","Type":"ContainerStarted","Data":"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"}
Jul 09 04:21:06.776808 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.776398    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" event={"ID":"051f40e2-3a58-4144-99ea-081650db498c","Type":"ContainerStarted","Data":"bb5c4893aead06a34c6943ff1e7131a2d281f1b390d3d59273a324ab76186b0d"}
Jul 09 04:21:06.776808 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.776471    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:06.804743 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:06.804688    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" podStartSLOduration=1.354743357 podStartE2EDuration="1.804668644s" totalImagesPullingTime="449.925287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:06.803131667 +0000 UTC m=+1496.269501360" watchObservedRunningTime="2026-07-09 04:21:06.804668644 +0000 UTC m=+1496.271038318"
Jul 09 04:21:07.960450 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:07.960406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:09.411034 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:09.410971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:09.511345 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:09.511314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:10.654205 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:10.654160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:10.842917 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:10.842866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:11.003822 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.003784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:11.017352 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.017315    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:11.017824 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.017788    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" podUID="051f40e2-3a58-4144-99ea-081650db498c" containerName="maas-api" containerID="cri-o://58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8" gracePeriod=30
Jul 09 04:21:11.023311 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.023289    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:11.071935 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.071890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:11.110112 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.110084    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:21:11.111557 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.111535    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:21:11.274255 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.274231    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:11.406363 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.406325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls\") pod \"051f40e2-3a58-4144-99ea-081650db498c\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") "
Jul 09 04:21:11.406551 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.406411    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtnqx\" (UniqueName: \"kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx\") pod \"051f40e2-3a58-4144-99ea-081650db498c\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") "
Jul 09 04:21:11.406551 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.406462    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca\") pod \"051f40e2-3a58-4144-99ea-081650db498c\" (UID: \"051f40e2-3a58-4144-99ea-081650db498c\") "
Jul 09 04:21:11.406837 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.406811    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "051f40e2-3a58-4144-99ea-081650db498c" (UID: "051f40e2-3a58-4144-99ea-081650db498c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:11.408851 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.408828    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx" (OuterVolumeSpecName: "kube-api-access-xtnqx") pod "051f40e2-3a58-4144-99ea-081650db498c" (UID: "051f40e2-3a58-4144-99ea-081650db498c"). InnerVolumeSpecName "kube-api-access-xtnqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:11.408942 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.408925    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "051f40e2-3a58-4144-99ea-081650db498c" (UID: "051f40e2-3a58-4144-99ea-081650db498c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:21:11.507637 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.507549    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/051f40e2-3a58-4144-99ea-081650db498c-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:11.507637 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.507586    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/051f40e2-3a58-4144-99ea-081650db498c-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:11.507637 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.507601    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtnqx\" (UniqueName: \"kubernetes.io/projected/051f40e2-3a58-4144-99ea-081650db498c-kube-api-access-xtnqx\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:11.804610 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.804509    2569 generic.go:356] "Generic (PLEG): container finished" podID="051f40e2-3a58-4144-99ea-081650db498c" containerID="58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8" exitCode=0
Jul 09 04:21:11.804610 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.804561    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"
Jul 09 04:21:11.804610 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.804580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" event={"ID":"051f40e2-3a58-4144-99ea-081650db498c","Type":"ContainerDied","Data":"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"}
Jul 09 04:21:11.805152 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.804623    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl" event={"ID":"051f40e2-3a58-4144-99ea-081650db498c","Type":"ContainerDied","Data":"bb5c4893aead06a34c6943ff1e7131a2d281f1b390d3d59273a324ab76186b0d"}
Jul 09 04:21:11.805152 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.804645    2569 scope.go:117] "RemoveContainer" containerID="58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"
Jul 09 04:21:11.814827 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.814799    2569 scope.go:117] "RemoveContainer" containerID="58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"
Jul 09 04:21:11.815204 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:21:11.815181    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8\": container with ID starting with 58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8 not found: ID does not exist" containerID="58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"
Jul 09 04:21:11.815315 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.815213    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8"} err="failed to get container status \"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8\": rpc error: code = NotFound desc = could not find container \"58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8\": container with ID starting with 58bbc56eeefa5aeefaf238cf6f614c24b36545d7c4d0960e426f61bf17d0bae8 not found: ID does not exist"
Jul 09 04:21:11.825847 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.825812    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:11.831890 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:11.831856    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b35226b1-6d66dcf989-dvttl"]
Jul 09 04:21:12.085980 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:12.085892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:12.333895 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:12.333866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:13.070923 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:13.070889    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="051f40e2-3a58-4144-99ea-081650db498c" path="/var/lib/kubelet/pods/051f40e2-3a58-4144-99ea-081650db498c/volumes"
Jul 09 04:21:16.826111 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:16.826069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:16.934925 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:16.934889    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:17.144997 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:17.144918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:17.284802 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:17.284759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:17.383050 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:17.382920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:17.475529 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:17.475491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:18.553452 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.553422    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:18.620159 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.620125    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:18.620615 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.620601    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051f40e2-3a58-4144-99ea-081650db498c" containerName="maas-api"
Jul 09 04:21:18.620674 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.620620    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="051f40e2-3a58-4144-99ea-081650db498c" containerName="maas-api"
Jul 09 04:21:18.620746 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.620737    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="051f40e2-3a58-4144-99ea-081650db498c" containerName="maas-api"
Jul 09 04:21:18.625328 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.625305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.627788 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.627765    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dc2bcfdc-serving-cert\""
Jul 09 04:21:18.637261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.637235    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:18.664097 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.664068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:18.672187 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.672159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.672187 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.672190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvhc\" (UniqueName: \"kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.672377 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.672210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.772843 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.772804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.772843 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.772841    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvhc\" (UniqueName: \"kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.773103 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.772866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.773542 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.773509    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.775489 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.775470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.787633 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.787604    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvhc\" (UniqueName: \"kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc\") pod \"maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:18.824905 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.824820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:18.936864 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:18.936810    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:19.095238 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.095205    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:19.097982 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:21:19.097955    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95eb421_6b8f_4174_8a05_5a8c2bd14ac1.slice/crio-59393831f86d92cdd846407c6c069ac3bf4e27c7fcd27b1d782ca2068e9c6b73 WatchSource:0}: Error finding container 59393831f86d92cdd846407c6c069ac3bf4e27c7fcd27b1d782ca2068e9c6b73: Status 404 returned error can't find the container with id 59393831f86d92cdd846407c6c069ac3bf4e27c7fcd27b1d782ca2068e9c6b73
Jul 09 04:21:19.137345 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.137311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:19.249285 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.249255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:19.851053 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.850947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" event={"ID":"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1","Type":"ContainerStarted","Data":"94bad1aa717fdeea609324cc7938a73154af0a61c5ac46e891893df24333abec"}
Jul 09 04:21:19.851053 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.851039    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" event={"ID":"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1","Type":"ContainerStarted","Data":"59393831f86d92cdd846407c6c069ac3bf4e27c7fcd27b1d782ca2068e9c6b73"}
Jul 09 04:21:19.851431 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.851070    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:19.869230 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:19.869181    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" podStartSLOduration=1.486053884 podStartE2EDuration="1.869165657s" totalImagesPullingTime="383.111773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:19.867382077 +0000 UTC m=+1509.333751764" watchObservedRunningTime="2026-07-09 04:21:19.869165657 +0000 UTC m=+1509.335535331"
Jul 09 04:21:20.720859 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:20.720827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:23.098356 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.098314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:23.314448 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.314400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:23.414358 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.414257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:23.670348 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.670307    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:23.670586 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.670553    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" podUID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" containerName="maas-api" containerID="cri-o://94bad1aa717fdeea609324cc7938a73154af0a61c5ac46e891893df24333abec" gracePeriod=30
Jul 09 04:21:23.701745 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.701719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:23.875267 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.875237    2569 generic.go:356] "Generic (PLEG): container finished" podID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" containerID="94bad1aa717fdeea609324cc7938a73154af0a61c5ac46e891893df24333abec" exitCode=0
Jul 09 04:21:23.875419 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.875296    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" event={"ID":"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1","Type":"ContainerDied","Data":"94bad1aa717fdeea609324cc7938a73154af0a61c5ac46e891893df24333abec"}
Jul 09 04:21:23.931558 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:23.931498    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:24.019961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.019924    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvhc\" (UniqueName: \"kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc\") pod \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") "
Jul 09 04:21:24.020185 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.020084    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls\") pod \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") "
Jul 09 04:21:24.020185 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.020116    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca\") pod \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\" (UID: \"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1\") "
Jul 09 04:21:24.020498 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.020471    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" (UID: "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:24.022201 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.022181    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc" (OuterVolumeSpecName: "kube-api-access-2tvhc") pod "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" (UID: "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1"). InnerVolumeSpecName "kube-api-access-2tvhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:24.022292 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.022273    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" (UID: "d95eb421-6b8f-4174-8a05-5a8c2bd14ac1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:21:24.120750 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.120718    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tvhc\" (UniqueName: \"kubernetes.io/projected/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-kube-api-access-2tvhc\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:24.120750 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.120748    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:24.120750 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.120757    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:24.704834 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.704806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:24.883235 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.883201    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp" event={"ID":"d95eb421-6b8f-4174-8a05-5a8c2bd14ac1","Type":"ContainerDied","Data":"59393831f86d92cdd846407c6c069ac3bf4e27c7fcd27b1d782ca2068e9c6b73"}
Jul 09 04:21:24.883392 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.883213    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"
Jul 09 04:21:24.883392 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.883269    2569 scope.go:117] "RemoveContainer" containerID="94bad1aa717fdeea609324cc7938a73154af0a61c5ac46e891893df24333abec"
Jul 09 04:21:24.904474 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.904450    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:24.907775 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:24.907752    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc2bcfdc-6f8cd5c768-82kgp"]
Jul 09 04:21:25.070768 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:25.070688    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" path="/var/lib/kubelet/pods/d95eb421-6b8f-4174-8a05-5a8c2bd14ac1/volumes"
Jul 09 04:21:29.168661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:29.168630    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:29.261068 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:29.261031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:29.389743 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:29.389705    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:29.454299 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:29.454217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:30.509770 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.509718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:30.591876 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.591846    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:30.592323 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.592309    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" containerName="maas-api"
Jul 09 04:21:30.592379 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.592326    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" containerName="maas-api"
Jul 09 04:21:30.592428 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.592389    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95eb421-6b8f-4174-8a05-5a8c2bd14ac1" containerName="maas-api"
Jul 09 04:21:30.596931 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.596901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.599437 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.599412    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-85095648-serving-cert\""
Jul 09 04:21:30.609228 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.609205    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:30.624146 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.624116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:30.681510 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.681470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prwvt\" (UniqueName: \"kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.681705 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.681591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.681705 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.681628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.697258 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.697226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:30.783287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.783196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prwvt\" (UniqueName: \"kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.783287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.783282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.783515 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.783312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.783585 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:21:30.783551    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-85095648-serving-cert: secret "maas-api-e2e-ait-85095648-serving-cert" not found
Jul 09 04:21:30.783677 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:21:30.783649    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls podName:0e46bdb1-73b8-4326-a57d-46343e23fb4d nodeName:}" failed. No retries permitted until 2026-07-09 04:21:31.283624256 +0000 UTC m=+1520.749993927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls") pod "maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" (UID: "0e46bdb1-73b8-4326-a57d-46343e23fb4d") : secret "maas-api-e2e-ait-85095648-serving-cert" not found
Jul 09 04:21:30.784147 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.784125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:30.798528 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:30.798499    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prwvt\" (UniqueName: \"kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:31.226355 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.226276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:31.288559 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.288524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:31.291296 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.291268    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") pod \"maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:31.353251 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.353215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:31.437232 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.437194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:31.509073 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.508972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:31.657868 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.657843    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:31.659496 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:21:31.659466    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e46bdb1_73b8_4326_a57d_46343e23fb4d.slice/crio-4c6fdcead1417aeaa7e5b8e355ccc6cc0cfe234178614cd90933b883dbc92cc1 WatchSource:0}: Error finding container 4c6fdcead1417aeaa7e5b8e355ccc6cc0cfe234178614cd90933b883dbc92cc1: Status 404 returned error can't find the container with id 4c6fdcead1417aeaa7e5b8e355ccc6cc0cfe234178614cd90933b883dbc92cc1
Jul 09 04:21:31.918868 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:31.918833    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" event={"ID":"0e46bdb1-73b8-4326-a57d-46343e23fb4d","Type":"ContainerStarted","Data":"4c6fdcead1417aeaa7e5b8e355ccc6cc0cfe234178614cd90933b883dbc92cc1"}
Jul 09 04:21:32.468930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:32.468887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:32.926075 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:32.926042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" event={"ID":"0e46bdb1-73b8-4326-a57d-46343e23fb4d","Type":"ContainerStarted","Data":"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"}
Jul 09 04:21:32.926471 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:32.926168    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:32.942388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:32.942335    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" podStartSLOduration=2.623385952 podStartE2EDuration="2.942316369s" totalImagesPullingTime="318.930417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:32.941121614 +0000 UTC m=+1522.407491315" watchObservedRunningTime="2026-07-09 04:21:32.942316369 +0000 UTC m=+1522.408686089"
Jul 09 04:21:35.592254 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:35.592214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:35.923387 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:35.923345    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:35.923695 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:35.923661    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" podUID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" containerName="maas-api" containerID="cri-o://61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823" gracePeriod=30
Jul 09 04:21:35.944751 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:35.944721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:36.176522 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.176457    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:36.233139 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.233108    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") pod \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") "
Jul 09 04:21:36.233308 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.233204    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca\") pod \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") "
Jul 09 04:21:36.233308 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.233244    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prwvt\" (UniqueName: \"kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt\") pod \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\" (UID: \"0e46bdb1-73b8-4326-a57d-46343e23fb4d\") "
Jul 09 04:21:36.233540 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.233517    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e46bdb1-73b8-4326-a57d-46343e23fb4d" (UID: "0e46bdb1-73b8-4326-a57d-46343e23fb4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:36.235336 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.235313    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e46bdb1-73b8-4326-a57d-46343e23fb4d" (UID: "0e46bdb1-73b8-4326-a57d-46343e23fb4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:21:36.235452 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.235431    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt" (OuterVolumeSpecName: "kube-api-access-prwvt") pod "0e46bdb1-73b8-4326-a57d-46343e23fb4d" (UID: "0e46bdb1-73b8-4326-a57d-46343e23fb4d"). InnerVolumeSpecName "kube-api-access-prwvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:36.334718 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.334680    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e46bdb1-73b8-4326-a57d-46343e23fb4d-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:36.334718 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.334703    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prwvt\" (UniqueName: \"kubernetes.io/projected/0e46bdb1-73b8-4326-a57d-46343e23fb4d-kube-api-access-prwvt\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:36.334718 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.334714    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e46bdb1-73b8-4326-a57d-46343e23fb4d-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:21:36.948721 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.948687    2569 generic.go:356] "Generic (PLEG): container finished" podID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" containerID="61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823" exitCode=0
Jul 09 04:21:36.949217 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.948736    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"
Jul 09 04:21:36.949217 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.948770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" event={"ID":"0e46bdb1-73b8-4326-a57d-46343e23fb4d","Type":"ContainerDied","Data":"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"}
Jul 09 04:21:36.949217 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.948825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr" event={"ID":"0e46bdb1-73b8-4326-a57d-46343e23fb4d","Type":"ContainerDied","Data":"4c6fdcead1417aeaa7e5b8e355ccc6cc0cfe234178614cd90933b883dbc92cc1"}
Jul 09 04:21:36.949217 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.948848    2569 scope.go:117] "RemoveContainer" containerID="61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"
Jul 09 04:21:36.958610 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.958578    2569 scope.go:117] "RemoveContainer" containerID="61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"
Jul 09 04:21:36.958897 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:21:36.958878    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823\": container with ID starting with 61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823 not found: ID does not exist" containerID="61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"
Jul 09 04:21:36.958960 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.958906    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823"} err="failed to get container status \"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823\": rpc error: code = NotFound desc = could not find container \"61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823\": container with ID starting with 61091346445b7f0ee5821b8748671fc00dc93e941778c89585d16bda764e2823 not found: ID does not exist"
Jul 09 04:21:36.969183 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.969159    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:36.973018 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:36.972984    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85095648-8fd5b8f79-7wzzr"]
Jul 09 04:21:37.072305 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:37.072274    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" path="/var/lib/kubelet/pods/0e46bdb1-73b8-4326-a57d-46343e23fb4d/volumes"
Jul 09 04:21:41.629614 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:41.629572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:41.739051 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:41.738977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:44.912411 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:44.912379    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:48.035705 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:48.035673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:48.136051 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:48.136014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:48.398911 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:48.398873    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:48.500280 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:48.500219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:49.573814 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:49.573782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:49.794569 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:49.794536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:49.942192 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:49.942163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:50.084354 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:50.084321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:50.720550 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:50.720523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:50.849301 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:50.849267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:52.032066 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:52.032035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:53.958520 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:53.958483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:54.083196 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:54.083168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:54.166279 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:54.166248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:54.382908 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:54.382812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:21:55.514609 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:21:55.514571    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:00.321620 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:00.321591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:00.387668 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:00.387639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:00.861542 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:00.861507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:00.949547 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:00.949514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:02.399617 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:02.399583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:08.201300 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:08.201261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:08.311041 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:08.310990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:08.409942 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:08.409910    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:08.501888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:08.501808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:08.982885 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:08.982848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:34.915440 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:34.915400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:40.789296 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:40.789260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:40.855961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:40.855927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:40.948059 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:40.948024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:41.040481 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:41.040403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:22:56.870765 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:22:56.870730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:02.795673 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:02.795589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:02.900686 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:02.900656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:03.014401 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:03.014371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:13.476121 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:13.476086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:14.268533 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:14.268493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:20.536320 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:20.536283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:20.639356 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:20.639293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:20.739197 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:20.739168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:20.840451 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:20.840365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:21.674547 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:21.674516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:21.769559 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:21.769523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:21.868796 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:21.868761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:23.410303 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:23.410265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:29.861567 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:29.861532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:29.961058 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:29.960996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:30.606827 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:30.606792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:36.776597 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:36.776562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:36.853168 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:36.853124    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:37.125276 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:37.125193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:37.373401 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:37.373368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:37.797102 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:37.797065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:40.202641 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.202591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:40.268382 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.268345    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:40.268950 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.268931    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" containerName="maas-api"
Jul 09 04:23:40.268950 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.268951    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" containerName="maas-api"
Jul 09 04:23:40.269110 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.269097    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e46bdb1-73b8-4326-a57d-46343e23fb4d" containerName="maas-api"
Jul 09 04:23:40.272508 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.272484    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.275139 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.275114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-61e15e21-serving-cert\""
Jul 09 04:23:40.284666 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.284640    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:40.303762 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.303735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:40.378840 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.378804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.378840 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.378841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.379161 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.378936    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkvm\" (UniqueName: \"kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.423654 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.423612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:40.480295 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.480207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.480295 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.480245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.480521 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.480332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkvm\" (UniqueName: \"kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.480959 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.480932    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.482932 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.482904    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.494564 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.494540    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkvm\" (UniqueName: \"kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm\") pod \"maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.583085 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.583046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:40.586930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.586911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:40.739226 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:40.739196    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:40.741534 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:23:40.741508    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4d88da_d89e_485f_bf40_65d5a289fe20.slice/crio-7931fc37e268d7cba2841f4e3e75aeb195d907d156b06cb8fd3444cdc4e02a91 WatchSource:0}: Error finding container 7931fc37e268d7cba2841f4e3e75aeb195d907d156b06cb8fd3444cdc4e02a91: Status 404 returned error can't find the container with id 7931fc37e268d7cba2841f4e3e75aeb195d907d156b06cb8fd3444cdc4e02a91
Jul 09 04:23:41.000621 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.000528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:41.096299 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.096264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:41.588361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.588320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" event={"ID":"4f4d88da-d89e-485f-bf40-65d5a289fe20","Type":"ContainerStarted","Data":"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"}
Jul 09 04:23:41.588767 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.588389    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" event={"ID":"4f4d88da-d89e-485f-bf40-65d5a289fe20","Type":"ContainerStarted","Data":"7931fc37e268d7cba2841f4e3e75aeb195d907d156b06cb8fd3444cdc4e02a91"}
Jul 09 04:23:41.588767 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.588434    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:41.609904 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:41.609839    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" podStartSLOduration=0.936737145 podStartE2EDuration="1.609820636s" totalImagesPullingTime="673.083491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:41.608372267 +0000 UTC m=+1651.074741955" watchObservedRunningTime="2026-07-09 04:23:41.609820636 +0000 UTC m=+1651.076190492"
Jul 09 04:23:44.596390 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:44.596360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:45.401496 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:45.401464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:45.485897 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:45.485869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:45.747840 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:45.747805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:47.601170 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:47.601140    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:52.907963 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:52.907926    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:53.019448 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:53.019416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:53.309261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:53.309224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:53.762360 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:53.762329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:53.862695 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:53.862655    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:53.862946 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:53.862921    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" podUID="4f4d88da-d89e-485f-bf40-65d5a289fe20" containerName="maas-api" containerID="cri-o://c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8" gracePeriod=30
Jul 09 04:23:54.118984 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.118959    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:54.120984 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.120962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:54.210329 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.210299    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls\") pod \"4f4d88da-d89e-485f-bf40-65d5a289fe20\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") "
Jul 09 04:23:54.210536 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.210357    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdkvm\" (UniqueName: \"kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm\") pod \"4f4d88da-d89e-485f-bf40-65d5a289fe20\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") "
Jul 09 04:23:54.210536 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.210401    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca\") pod \"4f4d88da-d89e-485f-bf40-65d5a289fe20\" (UID: \"4f4d88da-d89e-485f-bf40-65d5a289fe20\") "
Jul 09 04:23:54.210828 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.210800    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f4d88da-d89e-485f-bf40-65d5a289fe20" (UID: "4f4d88da-d89e-485f-bf40-65d5a289fe20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:23:54.212649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.212620    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f4d88da-d89e-485f-bf40-65d5a289fe20" (UID: "4f4d88da-d89e-485f-bf40-65d5a289fe20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:23:54.212649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.212620    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm" (OuterVolumeSpecName: "kube-api-access-tdkvm") pod "4f4d88da-d89e-485f-bf40-65d5a289fe20" (UID: "4f4d88da-d89e-485f-bf40-65d5a289fe20"). InnerVolumeSpecName "kube-api-access-tdkvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:23:54.311473 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.311382    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4d88da-d89e-485f-bf40-65d5a289fe20-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:23:54.311473 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.311418    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdkvm\" (UniqueName: \"kubernetes.io/projected/4f4d88da-d89e-485f-bf40-65d5a289fe20-kube-api-access-tdkvm\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:23:54.311473 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.311431    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4d88da-d89e-485f-bf40-65d5a289fe20-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:23:54.654698 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.654606    2569 generic.go:356] "Generic (PLEG): container finished" podID="4f4d88da-d89e-485f-bf40-65d5a289fe20" containerID="c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8" exitCode=0
Jul 09 04:23:54.654698 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.654655    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"
Jul 09 04:23:54.654930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.654701    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" event={"ID":"4f4d88da-d89e-485f-bf40-65d5a289fe20","Type":"ContainerDied","Data":"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"}
Jul 09 04:23:54.654930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.654759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt" event={"ID":"4f4d88da-d89e-485f-bf40-65d5a289fe20","Type":"ContainerDied","Data":"7931fc37e268d7cba2841f4e3e75aeb195d907d156b06cb8fd3444cdc4e02a91"}
Jul 09 04:23:54.654930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.654785    2569 scope.go:117] "RemoveContainer" containerID="c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"
Jul 09 04:23:54.664195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.664179    2569 scope.go:117] "RemoveContainer" containerID="c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"
Jul 09 04:23:54.664477 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:23:54.664458    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8\": container with ID starting with c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8 not found: ID does not exist" containerID="c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"
Jul 09 04:23:54.664541 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.664489    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8"} err="failed to get container status \"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8\": rpc error: code = NotFound desc = could not find container \"c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8\": container with ID starting with c385cf9b55fdca7b88d6c936acbb0a2937a624ee293ddb2317566cfedbdf18a8 not found: ID does not exist"
Jul 09 04:23:54.678396 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.678363    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:54.683279 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:54.683250    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61e15e21-6678df78f9-zlqjt"]
Jul 09 04:23:55.071463 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:55.071427    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4d88da-d89e-485f-bf40-65d5a289fe20" path="/var/lib/kubelet/pods/4f4d88da-d89e-485f-bf40-65d5a289fe20/volumes"
Jul 09 04:23:59.844238 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:59.844202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:23:59.918311 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:23:59.918260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:00.202140 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:00.202109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:00.367542 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:00.367511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:00.527097 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:00.526995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:00.616315 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:00.616278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:00.727861 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:00.727826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:04.421476 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:04.421437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:04.516461 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:04.516423    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:07.073470 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:07.073431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:07.142858 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:07.142820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:07.260227 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:07.260183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:07.463277 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:07.463248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:13.213865 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:13.213820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:13.313541 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:13.313510    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:19.943215 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:19.943179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:20.275779 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:20.275695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:20.688649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:20.688599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.087883 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.087833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.186163 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.186132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.433270 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.433240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.623664 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.623623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.752208 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.752108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:23.853148 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:23.853117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:27.571921 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:27.571882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:36.868341 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:36.868257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:54.819324 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:54.819291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:24:55.216368 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:24:55.216336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:00.890353 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:00.890320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:05.975705 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:05.975663    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:42.521805 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:42.521766    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:43.924322 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:43.924285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:48.636601 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:48.636566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:54.228888 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:54.228843    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:54.290383 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:54.290344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:54.518345 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:54.518257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:54.725245 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:54.725186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:55.751902 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:55.751864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:55.851660 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:55.851625    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:55.951310 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:55.951277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:56.670202 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:56.670160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:56.767101 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:56.767070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:56.867162 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:56.867127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:25:58.210822 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:25:58.210790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:03.878302 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:03.878191    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:04.004250 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:04.004216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:04.529225 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:04.529179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:10.189757 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:10.189720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:10.290586 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:10.290511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:10.389863 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:10.389836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:11.141050 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:11.141019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:26:11.145159 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:11.145134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:26:20.871989 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:20.871950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:21.214914 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:21.214886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:42.152015 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:42.151971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:43.422405 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:43.422367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:48.324567 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:48.324531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:48.424546 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:48.424500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:48.752629 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:48.752592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:49.042339 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:49.042253    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:49.141442 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:49.141404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:51.705983 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.705953    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:51.805785 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.805752    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:26:51.806183 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.806169    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4d88da-d89e-485f-bf40-65d5a289fe20" containerName="maas-api"
Jul 09 04:26:51.806183 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.806184    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4d88da-d89e-485f-bf40-65d5a289fe20" containerName="maas-api"
Jul 09 04:26:51.806281 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.806274    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f4d88da-d89e-485f-bf40-65d5a289fe20" containerName="maas-api"
Jul 09 04:26:51.807687 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.807651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:51.809905 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.809889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:51.812256 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.812238    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e6ba0c-serving-cert\""
Jul 09 04:26:51.821456 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.821432    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:26:51.921261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.921228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:51.974794 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.974708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:51.974794 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.974760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:51.974983 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:51.974906    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.043199 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.043159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:52.075931 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.075898    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.075931 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.075938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.076219 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.075973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.076580 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.076557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.078914 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.078882    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.083745 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.083720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk\") pod \"maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.123842 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.123806    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:52.258384 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.258301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:52.268365 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.268342    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:26:52.270803 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:26:52.270779    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea55d46_6906_41a3_be53_e871bfe8fcac.slice/crio-b00d98bc12976bad740fcc08ec86cf2adedf684fdf5577b0dcaf6ececb99453a WatchSource:0}: Error finding container b00d98bc12976bad740fcc08ec86cf2adedf684fdf5577b0dcaf6ececb99453a: Status 404 returned error can't find the container with id b00d98bc12976bad740fcc08ec86cf2adedf684fdf5577b0dcaf6ececb99453a
Jul 09 04:26:52.272554 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.272537    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:26:52.361783 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.361745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:52.556045 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:52.555947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" event={"ID":"8ea55d46-6906-41a3-be53-e871bfe8fcac","Type":"ContainerStarted","Data":"b00d98bc12976bad740fcc08ec86cf2adedf684fdf5577b0dcaf6ececb99453a"}
Jul 09 04:26:53.563162 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:53.563116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" event={"ID":"8ea55d46-6906-41a3-be53-e871bfe8fcac","Type":"ContainerStarted","Data":"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"}
Jul 09 04:26:53.563550 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:53.563217    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:53.580558 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:53.580505    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" podStartSLOduration=2.015699232 podStartE2EDuration="2.58049041s" totalImagesPullingTime="564.791178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:26:53.57829892 +0000 UTC m=+1843.044668607" watchObservedRunningTime="2026-07-09 04:26:53.58049041 +0000 UTC m=+1843.046860082"
Jul 09 04:26:56.199277 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:56.199241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:56.548821 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:56.548736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:56.810969 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:56.810874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:56.960866 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:56.960830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:59.573732 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:59.573698    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:26:59.708404 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:59.708369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:59.811199 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:59.811162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:26:59.916213 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:26:59.916120    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:00.300126 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:00.300094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:00.395142 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:00.395096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:00.497597 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:00.497561    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:04.163929 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:04.163895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:04.889799 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:04.889769    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:04.989455 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:04.989422    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:11.660662 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:11.660622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:13.065501 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:13.065462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:13.167361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:13.167324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:21.090919 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:21.090889    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:21.192188 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:21.192157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:27:22.820251 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:27:22.820215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:04.038286 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:04.038207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:22.998592 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:22.998553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.031431 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.031401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.193971 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.193927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.579288 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.579249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.678812 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.678772    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.778386 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.778342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:24.823365 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.823330    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:28:24.823592 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.823565    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" podUID="8ea55d46-6906-41a3-be53-e871bfe8fcac" containerName="maas-api" containerID="cri-o://9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624" gracePeriod=30
Jul 09 04:28:24.879170 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:24.879059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:28:25.275316 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.275288    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:28:25.365559 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.365527    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca\") pod \"8ea55d46-6906-41a3-be53-e871bfe8fcac\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") "
Jul 09 04:28:25.365733 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.365582    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk\") pod \"8ea55d46-6906-41a3-be53-e871bfe8fcac\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") "
Jul 09 04:28:25.365733 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.365617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls\") pod \"8ea55d46-6906-41a3-be53-e871bfe8fcac\" (UID: \"8ea55d46-6906-41a3-be53-e871bfe8fcac\") "
Jul 09 04:28:25.365873 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.365852    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ea55d46-6906-41a3-be53-e871bfe8fcac" (UID: "8ea55d46-6906-41a3-be53-e871bfe8fcac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:28:25.367801 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.367773    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ea55d46-6906-41a3-be53-e871bfe8fcac" (UID: "8ea55d46-6906-41a3-be53-e871bfe8fcac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:28:25.367801 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.367786    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk" (OuterVolumeSpecName: "kube-api-access-r55bk") pod "8ea55d46-6906-41a3-be53-e871bfe8fcac" (UID: "8ea55d46-6906-41a3-be53-e871bfe8fcac"). InnerVolumeSpecName "kube-api-access-r55bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:28:25.466333 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.466303    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea55d46-6906-41a3-be53-e871bfe8fcac-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:28:25.466333 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.466329    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/8ea55d46-6906-41a3-be53-e871bfe8fcac-kube-api-access-r55bk\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:28:25.466333 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:25.466338    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea55d46-6906-41a3-be53-e871bfe8fcac-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:28:26.034358 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.034317    2569 generic.go:356] "Generic (PLEG): container finished" podID="8ea55d46-6906-41a3-be53-e871bfe8fcac" containerID="9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624" exitCode=0
Jul 09 04:28:26.034358 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.034363    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"
Jul 09 04:28:26.034599 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.034395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" event={"ID":"8ea55d46-6906-41a3-be53-e871bfe8fcac","Type":"ContainerDied","Data":"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"}
Jul 09 04:28:26.034599 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.034452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7" event={"ID":"8ea55d46-6906-41a3-be53-e871bfe8fcac","Type":"ContainerDied","Data":"b00d98bc12976bad740fcc08ec86cf2adedf684fdf5577b0dcaf6ececb99453a"}
Jul 09 04:28:26.034599 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.034478    2569 scope.go:117] "RemoveContainer" containerID="9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"
Jul 09 04:28:26.044272 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.044256    2569 scope.go:117] "RemoveContainer" containerID="9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"
Jul 09 04:28:26.044557 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:28:26.044532    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624\": container with ID starting with 9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624 not found: ID does not exist" containerID="9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"
Jul 09 04:28:26.044658 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.044564    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624"} err="failed to get container status \"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624\": rpc error: code = NotFound desc = could not find container \"9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624\": container with ID starting with 9c1c7ccea775d9d9a728a81eb95885f59eb7a64c2595d6e1e9e99441abc3a624 not found: ID does not exist"
Jul 09 04:28:26.054436 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.054404    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:28:26.059628 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:26.059606    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e6ba0c-74d96fc5dd-mctq7"]
Jul 09 04:28:27.071396 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:27.071365    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ea55d46-6906-41a3-be53-e871bfe8fcac" path="/var/lib/kubelet/pods/8ea55d46-6906-41a3-be53-e871bfe8fcac/volumes"
Jul 09 04:28:29.652991 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:28:29.652950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:05.295386 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:05.295298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:05.395633 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:05.395599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:06.197443 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:06.197404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:06.458633 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:06.458527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:06.686452 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:06.686418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:06.843485 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:06.843395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:07.253280 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:07.253246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:07.445158 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:07.445122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:07.545429 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:07.545347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:07.702048 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:07.701992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:13.074768 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:13.074735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:13.135403 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:13.135372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:13.410111 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:13.410033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:13.570869 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:13.570838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:13.917639 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:13.917602    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:14.207541 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:14.207449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:14.841923 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:14.841885    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:17.346667 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:17.346627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:17.447071 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:17.447034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:17.545504 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:17.545465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:17.671395 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:17.671367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:18.046172 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:18.046080    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:18.146409 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:18.146365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:21.817842 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:21.817807    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:22.260195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:22.260164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:22.551268 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:22.551170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:23.719881 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:23.719848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:25.403353 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:25.403319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:25.534622 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:25.534558    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:25.648416 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:25.648386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:25.769709 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:25.769673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:26.081433 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:26.081341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:26.182973 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:26.182939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:29.843578 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:29.843538    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:37.880305 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:37.880264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:38.295375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:38.295323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:38.549958 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:38.549864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:38.650169 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:38.650134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:38.913039 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:38.912934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:44.098796 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:44.098752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:44.169829 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:44.169798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:44.597372 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:44.597340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:44.697315 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:44.697283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:44.802069 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:44.802033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:45.223826 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:45.223790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:45.439266 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:45.439226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:45.561896 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:45.561816    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:45.782701 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:45.782667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:51.565927 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:51.565896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:51.665603 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:51.665568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:51.819867 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:51.819784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:52.038086 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:52.038043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:52.361957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:52.361926    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:52.647806 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:52.647726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:52.801661 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:52.801626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:53.663506 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:53.663477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:55.547156 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:55.547120    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:55.641718 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:55.641685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:55.854070 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:55.853963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:55.957153 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:55.957121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:56.203544 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:56.203507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:29:56.303128 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:29:56.303101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:00.000845 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.000814    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:00.134514 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.134476    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:30:00.134935 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.134921    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea55d46-6906-41a3-be53-e871bfe8fcac" containerName="maas-api"
Jul 09 04:30:00.134983 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.134937    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea55d46-6906-41a3-be53-e871bfe8fcac" containerName="maas-api"
Jul 09 04:30:00.135055 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.135046    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea55d46-6906-41a3-be53-e871bfe8fcac" containerName="maas-api"
Jul 09 04:30:00.138126 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.138108    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:30:00.146691 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.146666    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:30:00.328404 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.328303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sks9t\" (UniqueName: \"kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t\") pod \"maas-api-key-cleanup-29726190-rvv64\" (UID: \"620320ff-0771-453d-99a9-bb1ceb3ca160\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:30:00.397794 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.397760    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:00.429141 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.429102    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sks9t\" (UniqueName: \"kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t\") pod \"maas-api-key-cleanup-29726190-rvv64\" (UID: \"620320ff-0771-453d-99a9-bb1ceb3ca160\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:30:00.438806 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.438777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sks9t\" (UniqueName: \"kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t\") pod \"maas-api-key-cleanup-29726190-rvv64\" (UID: \"620320ff-0771-453d-99a9-bb1ceb3ca160\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:30:00.449562 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.449537    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:30:00.639083 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.638984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:00.793096 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:00.793063    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:30:00.796372 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:30:00.796345    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620320ff_0771_453d_99a9_bb1ceb3ca160.slice/crio-8c67f396b21bed5484b6faf53bf835b762cd7d1d1a12b45b2ef52ad455f3bcff WatchSource:0}: Error finding container 8c67f396b21bed5484b6faf53bf835b762cd7d1d1a12b45b2ef52ad455f3bcff: Status 404 returned error can't find the container with id 8c67f396b21bed5484b6faf53bf835b762cd7d1d1a12b45b2ef52ad455f3bcff
Jul 09 04:30:01.060176 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:01.060143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:01.529341 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:01.529308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" event={"ID":"620320ff-0771-453d-99a9-bb1ceb3ca160","Type":"ContainerStarted","Data":"8c67f396b21bed5484b6faf53bf835b762cd7d1d1a12b45b2ef52ad455f3bcff"}
Jul 09 04:30:03.636620 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.636583    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:30:03.646312 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.646286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.650071 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.648798    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-589b59-serving-cert\""
Jul 09 04:30:03.650071 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.649694    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:30:03.656581 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.656339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.656581 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.656381    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.656581 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.656433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzt7\" (UniqueName: \"kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.756936 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.756895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.756936 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.756938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.757226 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.756988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzt7\" (UniqueName: \"kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.757226 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:30:03.757136    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-serving-cert: secret "maas-api-e2e-shared-b-589b59-serving-cert" not found
Jul 09 04:30:03.757352 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:30:03.757235    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls podName:85935653-8888-4873-903f-10bba678cd24 nodeName:}" failed. No retries permitted until 2026-07-09 04:30:04.257210465 +0000 UTC m=+2033.723580117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls") pod "maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" (UID: "85935653-8888-4873-903f-10bba678cd24") : secret "maas-api-e2e-shared-b-589b59-serving-cert" not found
Jul 09 04:30:03.757683 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.757662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.765875 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.765846    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzt7\" (UniqueName: \"kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:03.824916 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.824875    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:03.925800 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:03.925763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:04.026899 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.026862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:04.229720 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.229686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:04.260930 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.260893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:04.263571 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.263544    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") pod \"maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:04.330899 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.330861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:04.549171 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.549132    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" event={"ID":"620320ff-0771-453d-99a9-bb1ceb3ca160","Type":"ContainerStarted","Data":"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"}
Jul 09 04:30:04.560502 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.560470    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:04.564418 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.564373    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" podStartSLOduration=1.195343827 podStartE2EDuration="4.564357321s" totalImagesPullingTime="3.369013494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:04.563572791 +0000 UTC m=+2034.029942483" watchObservedRunningTime="2026-07-09 04:30:04.564357321 +0000 UTC m=+2034.030726996"
Jul 09 04:30:04.703187 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:04.703162    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:30:04.704924 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:30:04.704896    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85935653_8888_4873_903f_10bba678cd24.slice/crio-0d6ac67359abf098fd5289aef56d9335964373d552eac64b7532d7f7e76ea031 WatchSource:0}: Error finding container 0d6ac67359abf098fd5289aef56d9335964373d552eac64b7532d7f7e76ea031: Status 404 returned error can't find the container with id 0d6ac67359abf098fd5289aef56d9335964373d552eac64b7532d7f7e76ea031
Jul 09 04:30:05.555112 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:05.555073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" event={"ID":"85935653-8888-4873-903f-10bba678cd24","Type":"ContainerStarted","Data":"0d6ac67359abf098fd5289aef56d9335964373d552eac64b7532d7f7e76ea031"}
Jul 09 04:30:06.562731 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:06.562692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" event={"ID":"85935653-8888-4873-903f-10bba678cd24","Type":"ContainerStarted","Data":"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"}
Jul 09 04:30:06.563150 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:06.562770    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:06.580491 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:06.580438    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" podStartSLOduration=2.599603331 podStartE2EDuration="3.580421918s" totalImagesPullingTime="980.818587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:06.578590962 +0000 UTC m=+2036.044960646" watchObservedRunningTime="2026-07-09 04:30:06.580421918 +0000 UTC m=+2036.046791591"
Jul 09 04:30:08.080587 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:08.080553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:12.573568 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:12.573535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:30:16.964092 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:16.964056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:17.066271 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:17.066234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:17.166215 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:17.166177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:25.893311 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:25.893276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:25.993591 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:25.993557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:30:39.389703 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:30:39.389621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:31:00.010979 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:00.010941    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:31:00.011554 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:00.011190    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" podUID="620320ff-0771-453d-99a9-bb1ceb3ca160" containerName="cleanup" containerID="cri-o://18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc" gracePeriod=30
Jul 09 04:31:11.181646 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:11.181612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:31:11.186571 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:11.186540    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:31:30.206854 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:30.206822    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:31:30.358371 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:30.358272    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sks9t\" (UniqueName: \"kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t\") pod \"620320ff-0771-453d-99a9-bb1ceb3ca160\" (UID: \"620320ff-0771-453d-99a9-bb1ceb3ca160\") "
Jul 09 04:31:30.360540 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:30.360511    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t" (OuterVolumeSpecName: "kube-api-access-sks9t") pod "620320ff-0771-453d-99a9-bb1ceb3ca160" (UID: "620320ff-0771-453d-99a9-bb1ceb3ca160"). InnerVolumeSpecName "kube-api-access-sks9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:31:30.459630 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:30.459588    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sks9t\" (UniqueName: \"kubernetes.io/projected/620320ff-0771-453d-99a9-bb1ceb3ca160-kube-api-access-sks9t\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:31:31.012663 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.012631    2569 generic.go:356] "Generic (PLEG): container finished" podID="620320ff-0771-453d-99a9-bb1ceb3ca160" containerID="18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc" exitCode=137
Jul 09 04:31:31.012853 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.012677    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"
Jul 09 04:31:31.012853 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.012716    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" event={"ID":"620320ff-0771-453d-99a9-bb1ceb3ca160","Type":"ContainerDied","Data":"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"}
Jul 09 04:31:31.012853 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.012773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64" event={"ID":"620320ff-0771-453d-99a9-bb1ceb3ca160","Type":"ContainerDied","Data":"8c67f396b21bed5484b6faf53bf835b762cd7d1d1a12b45b2ef52ad455f3bcff"}
Jul 09 04:31:31.012853 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.012798    2569 scope.go:117] "RemoveContainer" containerID="18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"
Jul 09 04:31:31.022742 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.022609    2569 scope.go:117] "RemoveContainer" containerID="18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"
Jul 09 04:31:31.022944 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:31:31.022922    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc\": container with ID starting with 18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc not found: ID does not exist" containerID="18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"
Jul 09 04:31:31.023028 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.022956    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc"} err="failed to get container status \"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc\": rpc error: code = NotFound desc = could not find container \"18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc\": container with ID starting with 18ee6098b74098bd11e24f85df4305325c37b540f0148c180caa0f7be8f390dc not found: ID does not exist"
Jul 09 04:31:31.034467 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.034434    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:31:31.040014 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.039970    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-rvv64"]
Jul 09 04:31:31.073480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:31:31.073449    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620320ff-0771-453d-99a9-bb1ceb3ca160" path="/var/lib/kubelet/pods/620320ff-0771-453d-99a9-bb1ceb3ca160/volumes"
Jul 09 04:32:08.002131 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:32:08.002040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:32:12.292712 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:32:12.292669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:32:57.614170 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:32:57.614127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:32:58.585433 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:32:58.585395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:33:07.670441 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:33:07.670400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:33:19.505792 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:33:19.505750    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:04.571936 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:04.571840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:06.294317 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:06.294279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:06.395211 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:06.395177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:41.754789 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:41.754754    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:42.655652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:42.655621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:34:53.096971 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:34:53.096938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:00.651346 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:00.651280    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:13.798648 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:13.798613    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:17.683519 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:17.683486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:17.782724 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:17.782685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:26.679756 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:26.679716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:26.804182 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:26.804138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:31.794809 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:31.794759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:31.847874 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:31.847826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:35:42.734487 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:35:42.734440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:11.212361 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:11.212328    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:36:11.220830 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:11.220801    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n6wj6_6931612f-076e-43df-9711-a683369a3dd4/ovn-acl-logging/0.log"
Jul 09 04:36:24.086165 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:24.086113    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:25.108912 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:25.108875    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:29.493343 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.493303    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7616-140030239792176"]
Jul 09 04:36:29.493734 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.493722    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620320ff-0771-453d-99a9-bb1ceb3ca160" containerName="cleanup"
Jul 09 04:36:29.493734 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.493735    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="620320ff-0771-453d-99a9-bb1ceb3ca160" containerName="cleanup"
Jul 09 04:36:29.493815 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.493799    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="620320ff-0771-453d-99a9-bb1ceb3ca160" containerName="cleanup"
Jul 09 04:36:29.496883 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.496866    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:29.501466 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.501444    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xtjnz\""
Jul 09 04:36:29.519716 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.519685    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239792176"]
Jul 09 04:36:29.585992 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.585958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrzp\" (UniqueName: \"kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp\") pod \"test-curl-7616-140030239792176\" (UID: \"7b2c3ee8-adc9-4f14-9926-b108cc040f8f\") " pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:29.687663 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.687617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrzp\" (UniqueName: \"kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp\") pod \"test-curl-7616-140030239792176\" (UID: \"7b2c3ee8-adc9-4f14-9926-b108cc040f8f\") " pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:29.695916 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.695890    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrzp\" (UniqueName: \"kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp\") pod \"test-curl-7616-140030239792176\" (UID: \"7b2c3ee8-adc9-4f14-9926-b108cc040f8f\") " pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:29.805549 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.805464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:29.945794 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.945768    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239792176"]
Jul 09 04:36:29.948034 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:36:29.947990    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b2c3ee8_adc9_4f14_9926_b108cc040f8f.slice/crio-aa2a8f57b32af32bb98c0f31cf566d97590fa711c5382c2d266df568a77385a7 WatchSource:0}: Error finding container aa2a8f57b32af32bb98c0f31cf566d97590fa711c5382c2d266df568a77385a7: Status 404 returned error can't find the container with id aa2a8f57b32af32bb98c0f31cf566d97590fa711c5382c2d266df568a77385a7
Jul 09 04:36:29.949356 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:29.949336    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:36:30.613757 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:30.613721    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239792176" event={"ID":"7b2c3ee8-adc9-4f14-9926-b108cc040f8f","Type":"ContainerStarted","Data":"aa2a8f57b32af32bb98c0f31cf566d97590fa711c5382c2d266df568a77385a7"}
Jul 09 04:36:31.621502 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:31.621424    2569 generic.go:356] "Generic (PLEG): container finished" podID="7b2c3ee8-adc9-4f14-9926-b108cc040f8f" containerID="b56811e832211e237a9ff824354f6dcf1a7022016c1717cbc3ea9190501dace0" exitCode=0
Jul 09 04:36:31.621502 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:31.621473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239792176" event={"ID":"7b2c3ee8-adc9-4f14-9926-b108cc040f8f","Type":"ContainerDied","Data":"b56811e832211e237a9ff824354f6dcf1a7022016c1717cbc3ea9190501dace0"}
Jul 09 04:36:32.775408 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.775378    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:32.793758 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.793730    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7616-140030239792176_7b2c3ee8-adc9-4f14-9926-b108cc040f8f/test-curl-7616-140030239792176/0.log"
Jul 09 04:36:32.816897 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.816861    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7616-140030239792176"]
Jul 09 04:36:32.818697 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.818669    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7616-140030239792176"]
Jul 09 04:36:32.917222 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.917195    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glrzp\" (UniqueName: \"kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp\") pod \"7b2c3ee8-adc9-4f14-9926-b108cc040f8f\" (UID: \"7b2c3ee8-adc9-4f14-9926-b108cc040f8f\") "
Jul 09 04:36:32.919442 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:32.919418    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp" (OuterVolumeSpecName: "kube-api-access-glrzp") pod "7b2c3ee8-adc9-4f14-9926-b108cc040f8f" (UID: "7b2c3ee8-adc9-4f14-9926-b108cc040f8f"). InnerVolumeSpecName "kube-api-access-glrzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:33.017980 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:33.017943    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrzp\" (UniqueName: \"kubernetes.io/projected/7b2c3ee8-adc9-4f14-9926-b108cc040f8f-kube-api-access-glrzp\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:33.071478 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:33.071442    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2c3ee8-adc9-4f14-9926-b108cc040f8f" path="/var/lib/kubelet/pods/7b2c3ee8-adc9-4f14-9926-b108cc040f8f/volumes"
Jul 09 04:36:33.633441 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:33.633410    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239792176"
Jul 09 04:36:33.633632 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:33.633458    2569 scope.go:117] "RemoveContainer" containerID="b56811e832211e237a9ff824354f6dcf1a7022016c1717cbc3ea9190501dace0"
Jul 09 04:36:35.465297 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.465262    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7616-140030239894528"]
Jul 09 04:36:35.465696 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.465683    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2c3ee8-adc9-4f14-9926-b108cc040f8f" containerName="test-curl-7616-140030239792176"
Jul 09 04:36:35.465740 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.465697    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2c3ee8-adc9-4f14-9926-b108cc040f8f" containerName="test-curl-7616-140030239792176"
Jul 09 04:36:35.465781 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.465772    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2c3ee8-adc9-4f14-9926-b108cc040f8f" containerName="test-curl-7616-140030239792176"
Jul 09 04:36:35.470323 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.470301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:35.473403 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.473370    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xtjnz\""
Jul 09 04:36:35.474405 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.474383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239894528"]
Jul 09 04:36:35.642942 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.642913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86pk\" (UniqueName: \"kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk\") pod \"test-curl-7616-140030239894528\" (UID: \"8ad3270f-9873-447d-918f-8a76c4ff534a\") " pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:35.744523 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.744437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86pk\" (UniqueName: \"kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk\") pod \"test-curl-7616-140030239894528\" (UID: \"8ad3270f-9873-447d-918f-8a76c4ff534a\") " pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:35.752195 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.752165    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86pk\" (UniqueName: \"kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk\") pod \"test-curl-7616-140030239894528\" (UID: \"8ad3270f-9873-447d-918f-8a76c4ff534a\") " pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:35.781895 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.781849    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:35.928957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:35.928872    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239894528"]
Jul 09 04:36:35.931414 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:36:35.931383    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ad3270f_9873_447d_918f_8a76c4ff534a.slice/crio-2523cec1c052cd85df82ca9e5af5b9636041f722f92d1ed1b879d26506c8f60c WatchSource:0}: Error finding container 2523cec1c052cd85df82ca9e5af5b9636041f722f92d1ed1b879d26506c8f60c: Status 404 returned error can't find the container with id 2523cec1c052cd85df82ca9e5af5b9636041f722f92d1ed1b879d26506c8f60c
Jul 09 04:36:36.652275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:36.652174    2569 generic.go:356] "Generic (PLEG): container finished" podID="8ad3270f-9873-447d-918f-8a76c4ff534a" containerID="b7b42c8ca593a6a0a56d2e5fe01c3afb1d91bcfcef96165b1ef3d3f6bd0758a0" exitCode=0
Jul 09 04:36:36.652655 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:36.652266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239894528" event={"ID":"8ad3270f-9873-447d-918f-8a76c4ff534a","Type":"ContainerDied","Data":"b7b42c8ca593a6a0a56d2e5fe01c3afb1d91bcfcef96165b1ef3d3f6bd0758a0"}
Jul 09 04:36:36.652655 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:36.652319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239894528" event={"ID":"8ad3270f-9873-447d-918f-8a76c4ff534a","Type":"ContainerStarted","Data":"2523cec1c052cd85df82ca9e5af5b9636041f722f92d1ed1b879d26506c8f60c"}
Jul 09 04:36:37.806444 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.806415    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:37.827915 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.827889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7616-140030239894528_8ad3270f-9873-447d-918f-8a76c4ff534a/test-curl-7616-140030239894528/0.log"
Jul 09 04:36:37.852101 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.852073    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7616-140030239894528"]
Jul 09 04:36:37.856272 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.856246    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7616-140030239894528"]
Jul 09 04:36:37.965516 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.965482    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h86pk\" (UniqueName: \"kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk\") pod \"8ad3270f-9873-447d-918f-8a76c4ff534a\" (UID: \"8ad3270f-9873-447d-918f-8a76c4ff534a\") "
Jul 09 04:36:37.967702 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.967675    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk" (OuterVolumeSpecName: "kube-api-access-h86pk") pod "8ad3270f-9873-447d-918f-8a76c4ff534a" (UID: "8ad3270f-9873-447d-918f-8a76c4ff534a"). InnerVolumeSpecName "kube-api-access-h86pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:37.975706 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.975678    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7616-140030239895392"]
Jul 09 04:36:37.976121 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.976107    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad3270f-9873-447d-918f-8a76c4ff534a" containerName="test-curl-7616-140030239894528"
Jul 09 04:36:37.976171 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.976123    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad3270f-9873-447d-918f-8a76c4ff534a" containerName="test-curl-7616-140030239894528"
Jul 09 04:36:37.976245 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.976236    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad3270f-9873-447d-918f-8a76c4ff534a" containerName="test-curl-7616-140030239894528"
Jul 09 04:36:37.979521 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.979499    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:37.985559 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:37.985523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239895392"]
Jul 09 04:36:38.066871 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.066832    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h86pk\" (UniqueName: \"kubernetes.io/projected/8ad3270f-9873-447d-918f-8a76c4ff534a-kube-api-access-h86pk\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:38.168023 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.167968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njm4v\" (UniqueName: \"kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v\") pod \"test-curl-7616-140030239895392\" (UID: \"c994e246-e587-4d82-b695-a557860b922b\") " pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:38.268779 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.268675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njm4v\" (UniqueName: \"kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v\") pod \"test-curl-7616-140030239895392\" (UID: \"c994e246-e587-4d82-b695-a557860b922b\") " pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:38.276689 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.276662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njm4v\" (UniqueName: \"kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v\") pod \"test-curl-7616-140030239895392\" (UID: \"c994e246-e587-4d82-b695-a557860b922b\") " pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:38.296316 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.296281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:38.438173 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.438144    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7616-140030239895392"]
Jul 09 04:36:38.439953 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:36:38.439927    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc994e246_e587_4d82_b695_a557860b922b.slice/crio-e23c51cb14a837d72e890fa330745cdc7d5a82a44383557a41978cf792a5b7bb WatchSource:0}: Error finding container e23c51cb14a837d72e890fa330745cdc7d5a82a44383557a41978cf792a5b7bb: Status 404 returned error can't find the container with id e23c51cb14a837d72e890fa330745cdc7d5a82a44383557a41978cf792a5b7bb
Jul 09 04:36:38.663586 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.663495    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239895392" event={"ID":"c994e246-e587-4d82-b695-a557860b922b","Type":"ContainerStarted","Data":"e23c51cb14a837d72e890fa330745cdc7d5a82a44383557a41978cf792a5b7bb"}
Jul 09 04:36:38.664672 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.664650    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2523cec1c052cd85df82ca9e5af5b9636041f722f92d1ed1b879d26506c8f60c"
Jul 09 04:36:38.664791 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:38.664673    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:38.675343 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:36:38.675313    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7616-140030239894528\" is forbidden: User \"system:node:ip-10-0-143-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-172.ec2.internal' and this object" podUID="8ad3270f-9873-447d-918f-8a76c4ff534a" pod="openshift-ingress/test-curl-7616-140030239894528"
Jul 09 04:36:39.071651 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:39.071617    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad3270f-9873-447d-918f-8a76c4ff534a" path="/var/lib/kubelet/pods/8ad3270f-9873-447d-918f-8a76c4ff534a/volumes"
Jul 09 04:36:39.672814 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:39.672780    2569 generic.go:356] "Generic (PLEG): container finished" podID="c994e246-e587-4d82-b695-a557860b922b" containerID="ea80518ba87b663af07bd146e56618be1c8b3138e2c97ff39bf4456d9528cce1" exitCode=0
Jul 09 04:36:39.672992 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:39.672837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7616-140030239895392" event={"ID":"c994e246-e587-4d82-b695-a557860b922b","Type":"ContainerDied","Data":"ea80518ba87b663af07bd146e56618be1c8b3138e2c97ff39bf4456d9528cce1"}
Jul 09 04:36:40.826328 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.826303    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:40.844591 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.844546    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7616-140030239895392_c994e246-e587-4d82-b695-a557860b922b/test-curl-7616-140030239895392/0.log"
Jul 09 04:36:40.865461 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.865424    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7616-140030239895392"]
Jul 09 04:36:40.869620 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.869593    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7616-140030239895392"]
Jul 09 04:36:40.891934 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.891902    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njm4v\" (UniqueName: \"kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v\") pod \"c994e246-e587-4d82-b695-a557860b922b\" (UID: \"c994e246-e587-4d82-b695-a557860b922b\") "
Jul 09 04:36:40.894200 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.894171    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v" (OuterVolumeSpecName: "kube-api-access-njm4v") pod "c994e246-e587-4d82-b695-a557860b922b" (UID: "c994e246-e587-4d82-b695-a557860b922b"). InnerVolumeSpecName "kube-api-access-njm4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:40.992921 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:40.992834    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njm4v\" (UniqueName: \"kubernetes.io/projected/c994e246-e587-4d82-b695-a557860b922b-kube-api-access-njm4v\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:41.072293 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:41.072259    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c994e246-e587-4d82-b695-a557860b922b" path="/var/lib/kubelet/pods/c994e246-e587-4d82-b695-a557860b922b/volumes"
Jul 09 04:36:41.686974 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:41.686942    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7616-140030239895392"
Jul 09 04:36:41.687237 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:41.687047    2569 scope.go:117] "RemoveContainer" containerID="ea80518ba87b663af07bd146e56618be1c8b3138e2c97ff39bf4456d9528cce1"
Jul 09 04:36:43.632912 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:43.632878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:44.022711 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:44.022682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:44.122588 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:44.122545    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:44.222925 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:44.222888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:44.358908 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:44.358825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:50.287170 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:50.287137    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:50.386987 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:50.386954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:50.570954 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:50.570874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:50.786426 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:50.786393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.056959 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.056922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.398480 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.398399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.501899 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.501860    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.600074 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.600038    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.729854 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.729824    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:36:51.730250 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.730220    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" podUID="85935653-8888-4873-903f-10bba678cd24" containerName="maas-api" containerID="cri-o://ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab" gracePeriod=30
Jul 09 04:36:51.756507 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.756483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:51.986286 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:51.986224    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:36:52.090934 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.090902    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") pod \"85935653-8888-4873-903f-10bba678cd24\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") "
Jul 09 04:36:52.091117 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.091041    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca\") pod \"85935653-8888-4873-903f-10bba678cd24\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") "
Jul 09 04:36:52.091117 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.091079    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nzt7\" (UniqueName: \"kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7\") pod \"85935653-8888-4873-903f-10bba678cd24\" (UID: \"85935653-8888-4873-903f-10bba678cd24\") "
Jul 09 04:36:52.091478 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.091443    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85935653-8888-4873-903f-10bba678cd24" (UID: "85935653-8888-4873-903f-10bba678cd24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:36:52.093165 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.093143    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85935653-8888-4873-903f-10bba678cd24" (UID: "85935653-8888-4873-903f-10bba678cd24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:36:52.093272 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.093249    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7" (OuterVolumeSpecName: "kube-api-access-9nzt7") pod "85935653-8888-4873-903f-10bba678cd24" (UID: "85935653-8888-4873-903f-10bba678cd24"). InnerVolumeSpecName "kube-api-access-9nzt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:52.192469 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.192429    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85935653-8888-4873-903f-10bba678cd24-maas-api-tls\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:52.192469 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.192463    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85935653-8888-4873-903f-10bba678cd24-openshift-service-ca\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:52.192469 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.192474    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nzt7\" (UniqueName: \"kubernetes.io/projected/85935653-8888-4873-903f-10bba678cd24-kube-api-access-9nzt7\") on node \"ip-10-0-143-172.ec2.internal\" DevicePath \"\""
Jul 09 04:36:52.747985 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.747948    2569 generic.go:356] "Generic (PLEG): container finished" podID="85935653-8888-4873-903f-10bba678cd24" containerID="ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab" exitCode=0
Jul 09 04:36:52.748375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.747998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"
Jul 09 04:36:52.748375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.748031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" event={"ID":"85935653-8888-4873-903f-10bba678cd24","Type":"ContainerDied","Data":"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"}
Jul 09 04:36:52.748375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.748081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p" event={"ID":"85935653-8888-4873-903f-10bba678cd24","Type":"ContainerDied","Data":"0d6ac67359abf098fd5289aef56d9335964373d552eac64b7532d7f7e76ea031"}
Jul 09 04:36:52.748375 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.748107    2569 scope.go:117] "RemoveContainer" containerID="ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"
Jul 09 04:36:52.758102 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.758077    2569 scope.go:117] "RemoveContainer" containerID="ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"
Jul 09 04:36:52.758400 ip-10-0-143-172 kubenswrapper[2569]: E0709 04:36:52.758382    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab\": container with ID starting with ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab not found: ID does not exist" containerID="ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"
Jul 09 04:36:52.758471 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.758409    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab"} err="failed to get container status \"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab\": rpc error: code = NotFound desc = could not find container \"ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab\": container with ID starting with ca721be833cbe7aae0380dca7dea3a7610da297bcd674eadf515ae56785be1ab not found: ID does not exist"
Jul 09 04:36:52.769314 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.769282    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:36:52.772662 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:52.772637    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-589b59-6dc54876fb-4h47p"]
Jul 09 04:36:53.070621 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:53.070536    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85935653-8888-4873-903f-10bba678cd24" path="/var/lib/kubelet/pods/85935653-8888-4873-903f-10bba678cd24/volumes"
Jul 09 04:36:57.252384 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:57.252346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:57.351073 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:57.351033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:57.495911 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:57.495879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:57.714427 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:57.714390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:36:58.138649 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:36:58.138557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7cd8ddf9-jb4gk_b754badd-1b7f-401d-b872-ef7260520e96/authorino/0.log"
Jul 09 04:37:02.819818 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:02.819784    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bqr78_1e3d8045-c803-4033-9805-da200fd01044/manager/0.log"
Jul 09 04:37:02.934298 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:02.934269    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rl62t_0b198e0a-de2b-4c4c-a7aa-1c18309154a6/manager/0.log"
Jul 09 04:37:03.176702 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:03.176669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sz7rd_dc19156f-39f5-4d77-8f9c-91f02e92b69a/server/0.log"
Jul 09 04:37:03.288512 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:03.288478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kqkg8_90cdd39e-daa5-476e-b55f-9429299c40bc/manager/0.log"
Jul 09 04:37:03.630604 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:03.630517    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-zwqnv_59308d0b-deb0-4d5e-9518-50988a37ce59/copy-manifests/0.log"
Jul 09 04:37:03.639652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:03.639625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-zwqnv_59308d0b-deb0-4d5e-9518-50988a37ce59/manager/0.log"
Jul 09 04:37:03.962126 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:03.962092    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d6d755b6c-69n9f_45ad64f0-6d12-4e2e-902e-07a31459b6e2/maas-api/0.log"
Jul 09 04:37:04.071627 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:04.071601    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-46mz2_ce519f69-698c-4c9b-9132-5c187243229f/postgres/0.log"
Jul 09 04:37:05.277189 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.277161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7cd8ddf9-jb4gk_b754badd-1b7f-401d-b872-ef7260520e96/authorino/0.log"
Jul 09 04:37:05.385181 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.385152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gj9gg_cea4230f-7ca9-4641-9816-fc1b3f4bf95b/manager/0.log"
Jul 09 04:37:05.488853 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.488821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9jr25_8eeecff0-4166-4fad-9c80-9028aa3e9b7a/manager/0.log"
Jul 09 04:37:05.595885 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.595805    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4lk9_090b633f-afef-417b-964c-0eae42ed5ca4/kuadrant-console-plugin/0.log"
Jul 09 04:37:05.712049 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.712019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kw9kj_c20c7e43-b8a9-4740-bb29-efcf2877d7b7/registry-server/0.log"
Jul 09 04:37:05.824786 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:05.824743    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2pfp7_9363da14-8267-4713-9130-31411bc9982e/manager/0.log"
Jul 09 04:37:06.036019 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:06.035954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mllsf_a8cc2bc0-0854-49b6-bc00-86f262e5b166/manager/0.log"
Jul 09 04:37:06.595467 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:06.595435    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-644c76db6f-7pdcf_674ff913-7db7-4dd6-8f13-7c5942e7b1b2/kube-auth-proxy/0.log"
Jul 09 04:37:06.921698 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:06.921668    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-m2w8f_cb8a1690-d4c4-4673-a57b-f5b8d9b837e7/payload-pre-processing/0.log"
Jul 09 04:37:07.031150 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:07.031119    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-99j5z_977315c8-5211-45b2-863b-b6ff3ddeaa3e/payload-processing/0.log"
Jul 09 04:37:07.452541 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:07.452505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6xpl2_3ae7b50d-b55f-41a7-a2b3-8cb6f7e0d5b9/main/0.log"
Jul 09 04:37:11.504224 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:11.504184    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:37:11.606456 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:11.606361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log" limit=1024
Jul 09 04:37:14.284313 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:14.284285    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r2nqr_dbe200bd-0abe-4b23-92a8-f4676f1550c7/global-pull-secret-syncer/0.log"
Jul 09 04:37:14.329725 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:14.329695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pv5gz_cf7d9c18-6b3d-479c-9312-20fd1657f11b/konnectivity-agent/0.log"
Jul 09 04:37:14.501251 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:14.501223    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-172.ec2.internal_b593d636fd188f994c401884793c416d/haproxy/0.log"
Jul 09 04:37:19.286145 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.286107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7cd8ddf9-jb4gk_b754badd-1b7f-401d-b872-ef7260520e96/authorino/0.log"
Jul 09 04:37:19.317509 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.317481    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gj9gg_cea4230f-7ca9-4641-9816-fc1b3f4bf95b/manager/0.log"
Jul 09 04:37:19.349613 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.349584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9jr25_8eeecff0-4166-4fad-9c80-9028aa3e9b7a/manager/0.log"
Jul 09 04:37:19.382892 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.382867    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4lk9_090b633f-afef-417b-964c-0eae42ed5ca4/kuadrant-console-plugin/0.log"
Jul 09 04:37:19.425275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.425245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kw9kj_c20c7e43-b8a9-4740-bb29-efcf2877d7b7/registry-server/0.log"
Jul 09 04:37:19.542598 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.542509    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2pfp7_9363da14-8267-4713-9130-31411bc9982e/manager/0.log"
Jul 09 04:37:19.653252 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:19.653215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mllsf_a8cc2bc0-0854-49b6-bc00-86f262e5b166/manager/0.log"
Jul 09 04:37:21.377560 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.377488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/alertmanager/0.log"
Jul 09 04:37:21.398113 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.398085    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/config-reloader/0.log"
Jul 09 04:37:21.422525 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.422499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/kube-rbac-proxy-web/0.log"
Jul 09 04:37:21.444367 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.444333    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/kube-rbac-proxy/0.log"
Jul 09 04:37:21.467802 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.467769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/kube-rbac-proxy-metric/0.log"
Jul 09 04:37:21.489812 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.489786    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/prom-label-proxy/0.log"
Jul 09 04:37:21.510013 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.509979    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70627548-0eb3-4d81-a394-60a18b8cb68c/init-config-reloader/0.log"
Jul 09 04:37:21.658283 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.658210    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57997df9db-c84fd_f32131de-cb36-46e0-9815-245311cba16c/metrics-server/0.log"
Jul 09 04:37:21.695450 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.695416    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-fvk7s_0cffd28a-108a-4a1f-a868-228d2e39004a/monitoring-plugin/0.log"
Jul 09 04:37:21.727466 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.727441    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7v8t_5b64fba4-b63a-434e-9243-b7fb4019885d/node-exporter/0.log"
Jul 09 04:37:21.751882 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.751857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7v8t_5b64fba4-b63a-434e-9243-b7fb4019885d/kube-rbac-proxy/0.log"
Jul 09 04:37:21.772855 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:21.772828    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7v8t_5b64fba4-b63a-434e-9243-b7fb4019885d/init-textfile/0.log"
Jul 09 04:37:22.209215 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.209152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dlvsj_6bfd27ab-0ba1-4605-a6fd-1140e989222c/prometheus-operator/0.log"
Jul 09 04:37:22.231675 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.231649    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dlvsj_6bfd27ab-0ba1-4605-a6fd-1140e989222c/kube-rbac-proxy/0.log"
Jul 09 04:37:22.260225 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.260195    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-724vk_c0e35796-dc81-4651-a623-f9b7031d6af8/prometheus-operator-admission-webhook/0.log"
Jul 09 04:37:22.351385 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.351354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/thanos-query/0.log"
Jul 09 04:37:22.372091 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.372064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/kube-rbac-proxy-web/0.log"
Jul 09 04:37:22.392137 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.392097    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/kube-rbac-proxy/0.log"
Jul 09 04:37:22.412319 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.412296    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/prom-label-proxy/0.log"
Jul 09 04:37:22.431819 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.431794    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/kube-rbac-proxy-rules/0.log"
Jul 09 04:37:22.451561 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:22.451538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64494f98d9-6thdd_213ee34b-9521-490d-9a5b-34547c064245/kube-rbac-proxy-metrics/0.log"
Jul 09 04:37:24.201568 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.201528    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"]
Jul 09 04:37:24.202136 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202116    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85935653-8888-4873-903f-10bba678cd24" containerName="maas-api"
Jul 09 04:37:24.202231 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202137    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="85935653-8888-4873-903f-10bba678cd24" containerName="maas-api"
Jul 09 04:37:24.202231 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202191    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994e246-e587-4d82-b695-a557860b922b" containerName="test-curl-7616-140030239895392"
Jul 09 04:37:24.202231 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202200    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994e246-e587-4d82-b695-a557860b922b" containerName="test-curl-7616-140030239895392"
Jul 09 04:37:24.202388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202287    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994e246-e587-4d82-b695-a557860b922b" containerName="test-curl-7616-140030239895392"
Jul 09 04:37:24.202388 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.202301    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="85935653-8888-4873-903f-10bba678cd24" containerName="maas-api"
Jul 09 04:37:24.205501 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.205482    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.208390 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.208366    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mv72\"/\"openshift-service-ca.crt\""
Jul 09 04:37:24.208519 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.208441    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mv72\"/\"kube-root-ca.crt\""
Jul 09 04:37:24.209404 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.209386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2mv72\"/\"default-dockercfg-cgqvf\""
Jul 09 04:37:24.214440 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.214415    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"]
Jul 09 04:37:24.395737 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.395698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-sys\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.395737 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.395747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7fh\" (UniqueName: \"kubernetes.io/projected/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-kube-api-access-bf7fh\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.395961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.395769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-podres\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.395961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.395858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-proc\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.395961 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.395937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-lib-modules\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.496972 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.496872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7fh\" (UniqueName: \"kubernetes.io/projected/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-kube-api-access-bf7fh\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.496972 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.496920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-podres\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.496972 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.496970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-proc\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-lib-modules\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497110    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-podres\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-sys\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497171    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-proc\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497177    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-sys\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.497275 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.497218    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-lib-modules\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.513749 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.513714    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7fh\" (UniqueName: \"kubernetes.io/projected/e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae-kube-api-access-bf7fh\") pod \"perf-node-gather-daemonset-5znvn\" (UID: \"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.515651 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.515629    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.651932 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.651908    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"]
Jul 09 04:37:24.654190 ip-10-0-143-172 kubenswrapper[2569]: W0709 04:37:24.654164    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode1e09f0e_9c67_4d80_a86c_f0e8076fa8ae.slice/crio-86178fa74c6ea98cfb7c623c70e5edf8931946c586c759dce6b57564f77d4f84 WatchSource:0}: Error finding container 86178fa74c6ea98cfb7c623c70e5edf8931946c586c759dce6b57564f77d4f84: Status 404 returned error can't find the container with id 86178fa74c6ea98cfb7c623c70e5edf8931946c586c759dce6b57564f77d4f84
Jul 09 04:37:24.927298 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.927262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn" event={"ID":"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae","Type":"ContainerStarted","Data":"26e4da4a0bbffd77603632e0727ef0a9bdf57dacca8de8ae8fc9d91ae741016f"}
Jul 09 04:37:24.927483 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.927342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn" event={"ID":"e1e09f0e-9c67-4d80-a86c-f0e8076fa8ae","Type":"ContainerStarted","Data":"86178fa74c6ea98cfb7c623c70e5edf8931946c586c759dce6b57564f77d4f84"}
Jul 09 04:37:24.927483 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.927383    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:24.944652 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:24.944598    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn" podStartSLOduration=0.944581309 podStartE2EDuration="944.581309ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:24.942464056 +0000 UTC m=+2474.408833729" watchObservedRunningTime="2026-07-09 04:37:24.944581309 +0000 UTC m=+2474.410950984"
Jul 09 04:37:26.491403 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:26.491373    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ps84_bbcba894-86a9-407b-b8cf-1c8d024d1938/dns/0.log"
Jul 09 04:37:26.511685 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:26.511660    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ps84_bbcba894-86a9-407b-b8cf-1c8d024d1938/kube-rbac-proxy/0.log"
Jul 09 04:37:26.642622 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:26.642585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qqmz6_2be0a3be-a1b3-4f4f-9abf-3a1cf6c66870/dns-node-resolver/0.log"
Jul 09 04:37:27.158960 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:27.158928    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bd4b99868-4hzvn_ee4442d9-78c3-4920-9b23-98efd3982181/registry/0.log"
Jul 09 04:37:27.224222 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:27.224190    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6xvc_56739082-4b8c-4add-96e4-77de7ec950c4/node-ca/0.log"
Jul 09 04:37:28.344689 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:28.344659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-644c76db6f-7pdcf_674ff913-7db7-4dd6-8f13-7c5942e7b1b2/kube-auth-proxy/0.log"
Jul 09 04:37:28.484639 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:28.484610    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-m2w8f_cb8a1690-d4c4-4673-a57b-f5b8d9b837e7/payload-pre-processing/0.log"
Jul 09 04:37:28.529717 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:28.529683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-99j5z_977315c8-5211-45b2-863b-b6ff3ddeaa3e/payload-processing/0.log"
Jul 09 04:37:29.271261 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:29.271233    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rb6c2_a1691833-5c1a-4418-b9b5-ca3cb4d3d8a7/serve-healthcheck-canary/0.log"
Jul 09 04:37:29.732280 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:29.732253    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57r96_36c06bc7-7dfc-40ae-912a-36585b17d45c/kube-rbac-proxy/0.log"
Jul 09 04:37:29.752582 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:29.752550    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57r96_36c06bc7-7dfc-40ae-912a-36585b17d45c/exporter/0.log"
Jul 09 04:37:29.776879 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:29.776855    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57r96_36c06bc7-7dfc-40ae-912a-36585b17d45c/extractor/0.log"
Jul 09 04:37:30.943048 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:30.943021    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-5znvn"
Jul 09 04:37:31.964697 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:31.964667    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bqr78_1e3d8045-c803-4033-9805-da200fd01044/manager/0.log"
Jul 09 04:37:32.088762 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:32.088728    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rl62t_0b198e0a-de2b-4c4c-a7aa-1c18309154a6/manager/0.log"
Jul 09 04:37:32.263925 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:32.263847    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sz7rd_dc19156f-39f5-4d77-8f9c-91f02e92b69a/server/0.log"
Jul 09 04:37:32.325073 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:32.325035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kqkg8_90cdd39e-daa5-476e-b55f-9429299c40bc/manager/0.log"
Jul 09 04:37:32.531301 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:32.531219    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-zwqnv_59308d0b-deb0-4d5e-9518-50988a37ce59/manager/0.log"
Jul 09 04:37:32.551498 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:32.551471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-zwqnv_59308d0b-deb0-4d5e-9518-50988a37ce59/copy-manifests/0.log"
Jul 09 04:37:33.968024 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:33.967977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dd28n_46c03f67-ec3e-4e7e-980f-06933ee07d55/openshift-lws-operator/0.log"
Jul 09 04:37:34.663285 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:34.663203    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-644c76db6f-7pdcf_674ff913-7db7-4dd6-8f13-7c5942e7b1b2/kube-auth-proxy/0.log"
Jul 09 04:37:34.799287 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:34.799257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-m2w8f_cb8a1690-d4c4-4673-a57b-f5b8d9b837e7/payload-pre-processing/0.log"
Jul 09 04:37:34.832580 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:34.832544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-99j5z_977315c8-5211-45b2-863b-b6ff3ddeaa3e/payload-processing/0.log"
Jul 09 04:37:36.244051 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:36.243995    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-644c76db6f-7pdcf_674ff913-7db7-4dd6-8f13-7c5942e7b1b2/kube-auth-proxy/0.log"
Jul 09 04:37:36.372100 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:36.372061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-m2w8f_cb8a1690-d4c4-4673-a57b-f5b8d9b837e7/payload-pre-processing/0.log"
Jul 09 04:37:36.409360 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:36.409327    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-99j5z_977315c8-5211-45b2-863b-b6ff3ddeaa3e/payload-processing/0.log"
Jul 09 04:37:40.085555 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.085512    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2xx6q_256f37c4-4a7b-4727-99dd-26fd2a92fd7f/kube-multus/0.log"
Jul 09 04:37:40.302385 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.302359    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/kube-multus-additional-cni-plugins/0.log"
Jul 09 04:37:40.322236 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.322215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/egress-router-binary-copy/0.log"
Jul 09 04:37:40.342414 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.342338    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/cni-plugins/0.log"
Jul 09 04:37:40.362957 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.362928    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/bond-cni-plugin/0.log"
Jul 09 04:37:40.382638 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.382605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/routeoverride-cni/0.log"
Jul 09 04:37:40.401973 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.401943    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/whereabouts-cni-bincopy/0.log"
Jul 09 04:37:40.422673 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.422639    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2s9b_abeb58a7-9ad2-4ccd-b8ca-437f398cb7d8/whereabouts-cni/0.log"
Jul 09 04:37:40.668252 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.668228    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-86g8s_2ef85f6b-3690-4562-b909-9a3611217316/network-metrics-daemon/0.log"
Jul 09 04:37:40.693541 ip-10-0-143-172 kubenswrapper[2569]: I0709 04:37:40.693511    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-86g8s_2ef85f6b-3690-4562-b909-9a3611217316/kube-rbac-proxy/0.log"