Jul 06 19:20:52.463462 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:20:52.463477 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:20:52.463485 ip-10-0-135-41 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:20:52.463834 ip-10-0-135-41 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:21:02.485571 ip-10-0-135-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:21:02.485590 ip-10-0-135-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5f959e81e35c40aeb33765d6c2f61a25 --
Jul 06 19:22:57.236939 ip-10-0-135-41 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:22:57.668848 ip-10-0-135-41 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:22:57.668848 ip-10-0-135-41 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:22:57.668848 ip-10-0-135-41 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:22:57.668848 ip-10-0-135-41 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:22:57.668848 ip-10-0-135-41 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:22:57.671749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.671658    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:22:57.676210 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676194    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.676210 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676210    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676213    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676217    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676220    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676223    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676227    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676230    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676233    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676236    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676239    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676242    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676244    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676247    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676250    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676252    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676255    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676257    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676260    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676262    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676265    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676273    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.676278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676276    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676279    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676283    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676286    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676289    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676292    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676295    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676297    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676300    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676303    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676306    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676308    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676311    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676314    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676317    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676319    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676323    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676325    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676328    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.676779 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676331    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676333    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676336    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676339    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676341    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676343    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676346    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676348    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676352    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676354    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676357    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676360    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676362    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676365    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676368    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676371    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676373    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676376    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676380    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.677245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676384    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676387    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676390    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676392    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676395    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676398    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676401    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676403    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676406    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676408    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676411    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676414    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676416    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676419    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676422    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676424    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676426    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676429    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676431    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676434    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.677700 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676438    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676440    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676445    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676448    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676451    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676454    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676456    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676459    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676462    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676465    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676468    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676470    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676473    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676475    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676478    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676480    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676483    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676485    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.676489    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.678199 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677209    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677216    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677219    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677222    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677225    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677228    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677231    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677233    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677236    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677238    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677241    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677244    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677247    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677250    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677254    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677259    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677262    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677264    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677267    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.678696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677270    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677272    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677275    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677277    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677280    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677283    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677285    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677288    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677291    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677293    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677296    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677298    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677301    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677303    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677306    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677309    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677311    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677314    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677317    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677320    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.679204 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677322    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677325    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677328    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677330    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677333    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677335    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677338    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677340    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677344    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677346    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677349    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677351    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677354    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677358    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677361    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677365    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677368    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677370    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677373    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.679703 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677376    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677379    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677381    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677384    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677386    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677390    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677393    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677395    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677397    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677400    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677403    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677406    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677408    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677411    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677414    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677417    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677419    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677422    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677424    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677427    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.680200 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677429    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677432    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677434    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677436    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677440    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677443    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677446    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677449    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677452    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677455    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677458    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677460    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677463    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677465    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677468    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677470    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677473    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677475    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677478    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.680692 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677480    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677483    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677887    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677893    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677895    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677898    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677901    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677904    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677907    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677910    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677913    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677915    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677918    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677921    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677923    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677926    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677928    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677931    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677934    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677936    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.681147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677939    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677941    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677944    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677946    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677949    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677951    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677953    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677956    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677959    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677961    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677964    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677966    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677969    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677971    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677974    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677977    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677979    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677982    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677985    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677988    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.681645 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677990    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677995    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.677998    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678000    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678003    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678005    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678007    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678010    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678012    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678015    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678018    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678020    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678023    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678025    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678028    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678030    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678033    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678036    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678039    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678041    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.682147 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678044    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678046    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678049    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678053    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678057    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678059    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678063    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678066    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678069    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678072    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678076    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678079    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678082    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678086    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678089    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678091    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678094    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678096    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678099    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.682635 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678102    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678106    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678110    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678113    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678115    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678118    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678121    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678124    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678127    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678129    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678132    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678134    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678137    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678139    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678142    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678144    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678147    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678149    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678152    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.683138 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678154    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678157    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678159    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678233    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678240    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678247    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678261    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678267    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678270    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678274    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678278    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678282    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678285    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678288    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678291    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678294    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678297    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678300    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678303    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678306    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678309    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678313    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678316    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678319    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:22:57.683588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678322    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678325    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678329    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678332    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678335    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678339    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678342    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678345    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678348    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678351    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678354    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678358    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678361    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678364    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678367    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678370    2559 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678374    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678378    2559 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678382    2559 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678385    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678388    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678391    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678394    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678397    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678401    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:22:57.684175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678404    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678407    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678410    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678412    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678415    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678418    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678421    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678424    2559 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678428    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678432    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678436    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678439    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678442    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678445    2559 flags.go:64] FLAG: --help="false"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678448    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678451    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678454    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678457    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678460    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678464    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678466    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678469    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678472    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:22:57.684768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678475    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678478    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678482    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678484    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678487    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678490    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678493    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678496    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678499    2559 flags.go:64] FLAG: --lock-file=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678502    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678505    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678508    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678513    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678516    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678519    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678522    2559 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678525    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678528    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678532    2559 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678535    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678539    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678542    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678547    2559 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678550    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678553    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:22:57.685361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678556    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678559    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678562    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678565    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678568    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678576    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678579    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678582    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678585    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678588    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678593    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678596    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678599    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678602    2559 flags.go:64] FLAG: --port="10250"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678604    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678607    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab388d7b666f27e9"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678610    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678614    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678617    2559 flags.go:64] FLAG: --register-node="true"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678619    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678636    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678639    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678642    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678645    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678649    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:22:57.685985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678652    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678657    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678660    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678663    2559 flags.go:64] FLAG: --runonce="false"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678667    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678670    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678673    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678675    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678678    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678681    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678684    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678688    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678691    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678694    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678697    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678700    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678703    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678708    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678710    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678716    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678719    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678722    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678725    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678728    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678731    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:22:57.686590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678734    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678737    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678740    2559 flags.go:64] FLAG: --v="2"
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678744    2559 flags.go:64] FLAG: --version="false"
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678747    2559 flags.go:64] FLAG: --vmodule=""
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678752    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.678755    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678877    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678883    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678886    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678888    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678892    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678895    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678898    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678900    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678903    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678905    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678908    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678910    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678913    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678915    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.687213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678918    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678920    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678923    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678926    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678930    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678934    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678938    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678940    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678943    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678946    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678948    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678951    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678954    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678956    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678959    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678962    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678964    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678967    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678969    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678973    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.687770 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678975    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678978    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678982    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678984    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678987    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678990    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678992    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678995    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.678998    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679000    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679002    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679005    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679008    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679010    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679012    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679015    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679017    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679021    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679023    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.688242 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679026    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679028    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679031    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679033    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679036    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679038    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679041    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679043    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679046    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679048    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679051    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679054    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679057    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679060    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679062    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679066    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679069    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679072    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679074    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679077    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.688710 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679079    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679082    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679084    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679087    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679089    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679092    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679095    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679099    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679103    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679106    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679109    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679115    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679118    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679121    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679123    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679126    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679130    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679133    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679135    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.689229 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679137    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679140    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679143    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679145    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679148    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679152    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.679154    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.680033    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.686531    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.686546    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.686565    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.686570    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686638    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686644    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686648    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.689690 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686651    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686654    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686658    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686661    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686664    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686667    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686671    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686675    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686678    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686682    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686684    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686687    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686690    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686692    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686695    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686698    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686700    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686703    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686705    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686711    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.690054 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686714    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686716    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686719    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686721    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686724    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686727    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686730    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686733    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686736    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686738    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686741    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686744    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686746    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686749    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686751    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686754    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686756    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686759    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686761    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686764    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.690534 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686766    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686769    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686773    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686775    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686779    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686783    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686786    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686789    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686791    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686794    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686797    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686799    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686802    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686831    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686835    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686839    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686841    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686844    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686848    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.691094 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686850    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686855    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686858    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686862    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686865    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686867    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686870    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686872    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686875    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686878    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686880    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686883    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686885    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686888    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686891    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686893    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686897    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686899    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686902    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.691585 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686905    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686907    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686910    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686912    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686915    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686917    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686920    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686923    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686925    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686928    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686931    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686933    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686937    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686939    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686942    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686945    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686947    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.692049 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.686950    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.686955    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687067    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687072    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687075    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687077    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687080    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687083    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687085    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687088    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687090    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687093    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687096    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687099    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687101    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:22:57.692451 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687104    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687106    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687109    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687111    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687114    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687116    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687120    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687124    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687127    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687130    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687133    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687135    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687138    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687141    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687143    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687146    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687149    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687151    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687154    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687157    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:22:57.692842 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687159    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687162    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687164    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687167    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687169    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687172    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687175    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687177    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687180    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687183    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687185    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687188    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687191    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687193    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687196    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687198    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687201    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687203    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687205    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:22:57.693321 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687208    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687211    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687213    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687216    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687218    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687221    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687223    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687226    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687229    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687231    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687234    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687236    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687238    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687241    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687243    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687246    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687248    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687250    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687253    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687255    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:22:57.693781 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687258    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687260    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687263    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687265    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687268    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687271    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687273    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687277    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687280    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687283    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687285    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687289    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687292    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687295    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687298    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687301    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687303    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687306    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687309    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:22:57.694266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687312    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687314    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687317    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687319    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687322    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687324    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687327    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:57.687329    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.687335    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.687436    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.689885    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.691329    2559 server.go:1019] "Starting client certificate rotation"
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.691428    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:22:57.694729 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.691463    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:22:57.697548 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.697526    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:22:57.698787 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.698765    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:22:57.711000 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.710984    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:22:57.713342 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.713066    2559 log.go:25] "Validated CRI v1 image API"
Jul 06 19:22:57.714674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.714654    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:22:57.717501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.717479    2559 fs.go:135] Filesystem UUIDs: map[5c8a2c70-628d-4292-848d-f5ca95ce7f39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8d2c85a0-8a15-49a3-a82d-6a1c2ca2a9cb:/dev/nvme0n1p4]
Jul 06 19:22:57.717563 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.717501    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:22:57.724069 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.723957    2559 manager.go:216] Machine: {Timestamp:2026-07-06 19:22:57.722510663 +0000 UTC m=+0.360009385 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100348 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29e6b91541f29e2e8e4ac1c7406bca SystemUUID:ec29e6b9-1541-f29e-2e8e-4ac1c7406bca BootID:5f959e81-e35c-40ae-b337-65d6c2f61a25 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:1a:2e:f0:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:1a:2e:f0:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:c7:0d:de:1d:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:22:57.724069 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.724062    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:22:57.724194 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.724184    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:22:57.727552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.727520    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:22:57.727712 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.727556    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:22:57.728387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.728375    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:22:57.728421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.728391    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:22:57.728421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.728407    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:22:57.729111 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.729100    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:22:57.731052 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.731040    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:22:57.734183 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.734170    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:22:57.734310 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.734300    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:22:57.735373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735363    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:22:57.735414 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735384    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:22:57.735414 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735398    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:22:57.735414 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735411    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:22:57.735508 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735425    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:22:57.735837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735820    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:22:57.735837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.735840    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:22:57.739758 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.739503    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:22:57.741694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.741678    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:22:57.741795 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.741724    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:22:57.742917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742904    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742922    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742929    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742935    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742944    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742950    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742959    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:22:57.742965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742965    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:22:57.743198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742973    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:22:57.743198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742980    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:22:57.743198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742989    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:22:57.743198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.742996    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:22:57.743874 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.743865    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:22:57.743874 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.743874    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:22:57.747496 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.747481    2559 server.go:1268] "Started kubelet"
Jul 06 19:22:57.747603 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.747552    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:22:57.748030 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.747963    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:22:57.748115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.748057    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:22:57.748634 ip-10-0-135-41 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:22:57.750011 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.749990    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:22:57.750553 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.750529    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:22:57.752781 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.752759    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:22:57.753336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.753320    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:22:57.755070 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.754954    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:22:57.755070 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.754961    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:22:57.757034 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.757011    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:22:57.757034 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.757030    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:22:57.757245 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.757185    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:57.757955 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.757736    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:22:57.757955 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.757930    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:22:57.757955 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.757780    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:22:57.758149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758016    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:22:57.758149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758036    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:22:57.758149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758128    2559 factory.go:153] Registering CRI-O factory
Jul 06 19:22:57.758149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758145    2559 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:22:57.758336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758261    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:22:57.758336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758271    2559 factory.go:55] Registering systemd factory
Jul 06 19:22:57.758336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758279    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:22:57.758336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758312    2559 factory.go:103] Registering Raw factory
Jul 06 19:22:57.758336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758329    2559 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:22:57.758793 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.758778    2559 manager.go:349] Starting recovery of all containers
Jul 06 19:22:57.762954 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.762923    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:22:57.764604 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.763421    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e739a3ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.747452909 +0000 UTC m=+0.384951631,LastTimestamp:2026-07-06 19:22:57.747452909 +0000 UTC m=+0.384951631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.770986 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.770950    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:22:57.771154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.771142    2559 manager.go:354] Recovery completed
Jul 06 19:22:57.776171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.776154    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:57.778274 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778250    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:57.778373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778288    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:57.778373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778302    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:57.778945 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778924    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:22:57.778945 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778941    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:22:57.779062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778958    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:57.779062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.778961    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:22:57.779869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.779850    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:57.779943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.779884    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:57.779943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.779898    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:57.780448 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.780434    2559 policy_none.go:49] "None policy: Start"
Jul 06 19:22:57.780482 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.780453    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:22:57.780482 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.780465    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:22:57.781771 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.781757    2559 policy_none.go:47] "Start"
Jul 06 19:22:57.796363 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.796255    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e90fe9ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.778272751 +0000 UTC m=+0.415771476,LastTimestamp:2026-07-06 19:22:57.778272751 +0000 UTC m=+0.415771476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.802643 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.802566    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e910407e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.77829491 +0000 UTC m=+0.415793633,LastTimestamp:2026-07-06 19:22:57.77829491 +0000 UTC m=+0.415793633,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.808076 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.808054    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:22:57.816320 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.816256    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e9106d1c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.778306332 +0000 UTC m=+0.415805054,LastTimestamp:2026-07-06 19:22:57.778306332 +0000 UTC m=+0.415805054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.831003 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.830921    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18bfc9b9e90fe9ef\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e90fe9ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.778272751 +0000 UTC m=+0.415771476,LastTimestamp:2026-07-06 19:22:57.77986743 +0000 UTC m=+0.417366156,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.831424 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831391    2559 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:22:57.831490 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.831462    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:22:57.831490 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831475    2559 server.go:87] "Starting device plugin registration server"
Jul 06 19:22:57.831802 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831785    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:22:57.831884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831806    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:22:57.831949 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831889    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:22:57.832010 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831979    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:22:57.832010 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.831991    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:22:57.832645 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.832623    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:22:57.832726 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.832710    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:57.852175 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.852056    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18bfc9b9e910407e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e910407e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.77829491 +0000 UTC m=+0.415793633,LastTimestamp:2026-07-06 19:22:57.779890803 +0000 UTC m=+0.417389525,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.886228 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.886127    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18bfc9b9e9106d1c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e9106d1c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.778306332 +0000 UTC m=+0.415805054,LastTimestamp:2026-07-06 19:22:57.77990415 +0000 UTC m=+0.417402873,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.894630 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.894608    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmrhj"
Jul 06 19:22:57.901088 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.901007    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9ec5f2edc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.833799388 +0000 UTC m=+0.471298100,LastTimestamp:2026-07-06 19:22:57.833799388 +0000 UTC m=+0.471298100,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.907582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.907552    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:22:57.908943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.908923    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:22:57.909048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.908970    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:22:57.909048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.908998    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:22:57.909048 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.909040    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:22:57.926745 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.926667    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 06 19:22:57.932773 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.932756    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:57.933585 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.933556    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:57.933710 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.933596    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:57.933710 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.933608    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:57.933710 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.933633    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:57.944759 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:57.944737    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmrhj"
Jul 06 19:22:57.954326 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.954232    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18bfc9b9e90fe9ef\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18bfc9b9e90fe9ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-06 19:22:57.778272751 +0000 UTC m=+0.415771476,LastTimestamp:2026-07-06 19:22:57.93357887 +0000 UTC m=+0.571077595,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}"
Jul 06 19:22:57.962334 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.962312    2559 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:57.982987 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:57.982962    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.009505 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.009454    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"]
Jul 06 19:22:58.009590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.009554    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:58.010667 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.010647    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:58.010737 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.010699    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:58.010737 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.010711    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:58.012039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012026    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:58.012151 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.012221 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012166    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:58.012903 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012888    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:58.012977 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012918    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:58.012977 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.012932    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:58.013615 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.013600    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:58.013697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.013637    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:58.013697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.013682    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:58.014867 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.014851    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.014934 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.014878    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:58.016670 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.016649    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:58.016781 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.016676    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:58.016781 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.016686    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:58.042532 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.042510    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.047588 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.047572    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.059510 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.059486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.059576 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.059515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.059576 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.059533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01a71ea3922c1a01f528cd43e38bc2b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"01a71ea3922c1a01f528cd43e38bc2b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.159957 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.159923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.160082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.159969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.160082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.159996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01a71ea3922c1a01f528cd43e38bc2b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"01a71ea3922c1a01f528cd43e38bc2b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.160082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.160035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.160082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.160051    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab5dbf370003fb5a5a9cfc9f743962bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"ab5dbf370003fb5a5a9cfc9f743962bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.160255 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.160047    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01a71ea3922c1a01f528cd43e38bc2b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"01a71ea3922c1a01f528cd43e38bc2b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.163245 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.163230    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:22:58.164361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.164336    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:22:58.164484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.164372    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:22:58.164484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.164388    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:22:58.164484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.164413    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.173595 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.173575    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.173679 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.173598    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-41.ec2.internal\": node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.235022 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.234917    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.339007 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.338981    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.345373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.345347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.351677 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.351659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.441713 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.441665    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.543065 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.542987    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.643416 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.643382    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.691706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.691667    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:22:58.706767 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.706733    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:22:58.743925 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.743887    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.753186 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.753164    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:22:58.844795 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:58.844717    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found"
Jul 06 19:22:58.935002 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.934974    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:22:58.947484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.947449    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:17:58 +0000 UTC" deadline="2028-02-26 20:02:46.538143921 +0000 UTC"
Jul 06 19:22:58.947484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.947476    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14400h39m47.590671047s"
Jul 06 19:22:58.957960 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.957933    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:58.959841 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:58.959817    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a71ea3922c1a01f528cd43e38bc2b2.slice/crio-ef589a28a82d452c9cf60a958b276aedde727edaf073c1da1d7b8ebf9ce7bd92 WatchSource:0}: Error finding container ef589a28a82d452c9cf60a958b276aedde727edaf073c1da1d7b8ebf9ce7bd92: Status 404 returned error can't find the container with id ef589a28a82d452c9cf60a958b276aedde727edaf073c1da1d7b8ebf9ce7bd92
Jul 06 19:22:58.968180 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.968161    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:22:58.971396 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:22:58.971368    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5dbf370003fb5a5a9cfc9f743962bb.slice/crio-7cd7acc335983a2e12a181ff5f7bb5dad7ed6bc72dcf3babf6e88a71a4012ce7 WatchSource:0}: Error finding container 7cd7acc335983a2e12a181ff5f7bb5dad7ed6bc72dcf3babf6e88a71a4012ce7: Status 404 returned error can't find the container with id 7cd7acc335983a2e12a181ff5f7bb5dad7ed6bc72dcf3babf6e88a71a4012ce7
Jul 06 19:22:58.978174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.978156    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:22:58.979302 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:58.979283    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"
Jul 06 19:22:59.007063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.007033    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:22:59.294535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.294452    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:22:59.737042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.736946    2559 apiserver.go:52] "Watching apiserver"
Jul 06 19:22:59.744171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.744140    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:22:59.744620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.744597    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-k2tkj","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm","openshift-image-registry/node-ca-79jkp","openshift-multus/multus-additional-cni-plugins-v6hrv","openshift-multus/multus-mfmlj","openshift-network-diagnostics/network-check-target-dl8l5","openshift-network-operator/iptables-alerter-79gws","kube-system/global-pull-secret-syncer-2gj7k","openshift-cluster-node-tuning-operator/tuned-ppbt2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","openshift-multus/network-metrics-daemon-vc9xk","openshift-ovn-kubernetes/ovnkube-node-pxjq6"]
Jul 06 19:22:59.746292 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.746263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:22:59.746404 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.746365    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:22:59.747582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.747561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.748855 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.748835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.750178 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.750152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.751429 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.751411    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.752813 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.752787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.754011 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.753995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.755473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.755453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.755571 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.755525    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:22:59.757171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.757149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.758844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.758809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:22:59.758998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.758972    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pkb6c\""
Jul 06 19:22:59.759115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759021    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.759115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759068    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:22:59.759115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759102    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759291    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759308    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759361    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759434    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759477    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759502    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cf67r\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759510    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.759537    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759565    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759510    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759568    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l7t67\""
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759749    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:22:59.759969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.759951    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:22:59.761124 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.760977    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:22:59.761618 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.761474    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:22:59.761618 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.761547    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.761833 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.761821    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:22:59.761990 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.761968    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dl52g\""
Jul 06 19:22:59.762140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.762113    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:22:59.762478 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.762457    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.763356 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.763217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5f8zd\""
Jul 06 19:22:59.765050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.763821    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-92rgc\""
Jul 06 19:22:59.765050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.763941    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:22:59.765420 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.765399    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.765497 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.765479    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:22:59.768154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.768131    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.769040 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769009    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:22:59.769135 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769046    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:22:59.769135 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:22:59.769620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-system-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.769724 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-cni-binary-copy\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.769787 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.769844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.769908 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-env-overrides\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.769908 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-script-lib\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec75eca3-2343-44b7-9134-e23b7a89b098-serviceca\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.770009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.770009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.769973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-lib-modules\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.770163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90bb1f0e-d09f-4c21-97d3-8879c855e26a-agent-certs\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.770163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-node-log\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cht84\" (UniqueName: \"kubernetes.io/projected/37e99757-e8f6-4835-a539-e60c6ea744fa-kube-api-access-cht84\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6716d948-61c0-40d7-bed8-01269225bfa5-iptables-alerter-script\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-sys\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-systemd-units\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-log-socket\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec75eca3-2343-44b7-9134-e23b7a89b098-host\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.770332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-multus-certs\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-etc-kubernetes\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-os-release\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-kubernetes\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-tmp\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-var-lib-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770545    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-bin\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-hostroot\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.770674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-config\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-modprobe-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysconfig\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjjr\" (UniqueName: \"kubernetes.io/projected/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-kube-api-access-xtjjr\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-multus-daemon-config\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-systemd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-kubelet-config\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-host\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.770998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-ovn\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-cnibin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-bin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-netns\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.771179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-cnibin\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxtqq\" (UniqueName: \"kubernetes.io/projected/f06f04f4-7887-411b-acfe-4136c75c04c3-kube-api-access-wxtqq\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-socket-dir-parent\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-k8s-cni-cncf-io\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-systemd\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-device-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-conf-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9vvj\" (UniqueName: \"kubernetes.io/projected/7b15dc67-1605-44f7-9874-ff7b6cbb406d-kube-api-access-m9vvj\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-netd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-os-release\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6716d948-61c0-40d7-bed8-01269225bfa5-host-slash\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-multus\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-etc-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.772060 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105804d3-b174-4405-8713-0c132dab14bd-ovn-node-metrics-cert\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmf5c\" (UniqueName: \"kubernetes.io/projected/105804d3-b174-4405-8713-0c132dab14bd-kube-api-access-tmf5c\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-kubelet\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6gw\" (UniqueName: \"kubernetes.io/projected/ec75eca3-2343-44b7-9134-e23b7a89b098-kube-api-access-bt6gw\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-system-cni-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld49h\" (UniqueName: \"kubernetes.io/projected/6716d948-61c0-40d7-bed8-01269225bfa5-kube-api-access-ld49h\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-var-lib-kubelet\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-kubelet\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771912    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vht6l\""
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-dbus\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-conf\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-run\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771901    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-76tlm\""
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.771997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgww\" (UniqueName: \"kubernetes.io/projected/717c134c-2e81-4e15-9640-b3617f17f54a-kube-api-access-hkgww\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.772021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90bb1f0e-d09f-4c21-97d3-8879c855e26a-konnectivity-ca\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.772866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.772044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-slash\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.773742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.772093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.773742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.772124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-tuned\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.773742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.772158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-netns\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.779651 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.779628    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:22:59.838900 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.838853    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dz2n5"
Jul 06 19:22:59.867839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.867795    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dz2n5"
Jul 06 19:22:59.872440 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld49h\" (UniqueName: \"kubernetes.io/projected/6716d948-61c0-40d7-bed8-01269225bfa5-kube-api-access-ld49h\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-var-lib-kubelet\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-kubelet\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-dbus\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-conf\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.872594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-run\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgww\" (UniqueName: \"kubernetes.io/projected/717c134c-2e81-4e15-9640-b3617f17f54a-kube-api-access-hkgww\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90bb1f0e-d09f-4c21-97d3-8879c855e26a-konnectivity-ca\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-slash\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872648    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-var-lib-kubelet\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-tuned\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.872829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872824    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-run\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.873237 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.872848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-netns\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.873237 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873027    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-dbus\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.873237 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873082    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-slash\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873237 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873128    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-kubelet\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873277    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-conf\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873269    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-netns\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-system-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-cni-binary-copy\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.873452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-env-overrides\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-script-lib\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec75eca3-2343-44b7-9134-e23b7a89b098-serviceca\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90bb1f0e-d09f-4c21-97d3-8879c855e26a-konnectivity-ca\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.873845 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.873642    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-env-overrides\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.874200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.874200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-lib-modules\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90bb1f0e-d09f-4c21-97d3-8879c855e26a-agent-certs\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-node-log\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cht84\" (UniqueName: \"kubernetes.io/projected/37e99757-e8f6-4835-a539-e60c6ea744fa-kube-api-access-cht84\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6716d948-61c0-40d7-bed8-01269225bfa5-iptables-alerter-script\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-sys\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-systemd-units\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874367    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-script-lib\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-log-socket\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec75eca3-2343-44b7-9134-e23b7a89b098-host\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.874505    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-multus-certs\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-etc-kubernetes\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-os-release\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874614    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec75eca3-2343-44b7-9134-e23b7a89b098-serviceca\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.874628    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:00.374585273 +0000 UTC m=+3.012083982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-kubernetes\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874648    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-os-release\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.874889 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.874702    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-system-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875027    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-kubernetes\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875086    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec75eca3-2343-44b7-9134-e23b7a89b098-host\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875142    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-sys\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875187    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-systemd-units\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-cni-binary-copy\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875236    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-log-socket\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875304    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-multus-certs\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875356    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-etc-kubernetes\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875367    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6716d948-61c0-40d7-bed8-01269225bfa5-iptables-alerter-script\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-tmp\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875422    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-var-lib-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-bin\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875462    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.875499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875507    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-node-log\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-hostroot\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-config\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-modprobe-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysconfig\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjjr\" (UniqueName: \"kubernetes.io/projected/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-kube-api-access-xtjjr\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-multus-daemon-config\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-var-lib-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-systemd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875760    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-kubelet-config\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d72de2bc-6164-472c-bd1c-f2811047f5c6-kubelet-config\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-host\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-ovn\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.876283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875948    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-modprobe-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-cnibin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.875985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-bin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876004    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysconfig\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-netns\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-cnibin\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxtqq\" (UniqueName: \"kubernetes.io/projected/f06f04f4-7887-411b-acfe-4136c75c04c3-kube-api-access-wxtqq\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-socket-dir-parent\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-k8s-cni-cncf-io\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/105804d3-b174-4405-8713-0c132dab14bd-ovnkube-config\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-systemd\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-device-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876235    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-sysctl-d\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.877175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-conf-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-host\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876258    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-bin\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-systemd\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876464    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-device-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876509    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-conf-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876557    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-systemd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876815    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/717c134c-2e81-4e15-9640-b3617f17f54a-multus-daemon-config\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876823    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-cni-dir\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876865    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-hostroot\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9vvj\" (UniqueName: \"kubernetes.io/projected/7b15dc67-1605-44f7-9874-ff7b6cbb406d-kube-api-access-m9vvj\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-netd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876936    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876943    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37e99757-e8f6-4835-a539-e60c6ea744fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876953    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-cni-netd\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.876996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-os-release\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877001    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-multus-socket-dir-parent\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877009    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-cnibin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.878093 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6716d948-61c0-40d7-bed8-01269225bfa5-host-slash\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877056    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-bin\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877061    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-os-release\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-multus\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877107    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-host-run-netns\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877104    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-run-k8s-cni-cncf-io\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877116    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06f04f4-7887-411b-acfe-4136c75c04c3-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877136    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-cnibin\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-etc-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877164    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6716d948-61c0-40d7-bed8-01269225bfa5-host-slash\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-cni-multus\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877190    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-run-ovn\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.877233    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877348    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-lib-modules\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.877398    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:00.37737365 +0000 UTC m=+3.014872356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877381    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/105804d3-b174-4405-8713-0c132dab14bd-etc-openvswitch\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105804d3-b174-4405-8713-0c132dab14bd-ovn-node-metrics-cert\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmf5c\" (UniqueName: \"kubernetes.io/projected/105804d3-b174-4405-8713-0c132dab14bd-kube-api-access-tmf5c\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-kubelet\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6gw\" (UniqueName: \"kubernetes.io/projected/ec75eca3-2343-44b7-9134-e23b7a89b098-kube-api-access-bt6gw\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-system-cni-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877797    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717c134c-2e81-4e15-9640-b3617f17f54a-host-var-lib-kubelet\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.877836    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37e99757-e8f6-4835-a539-e60c6ea744fa-system-cni-dir\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.878899    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-tmp\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.879928 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.879101    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-etc-tuned\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.881300 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.881165    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/105804d3-b174-4405-8713-0c132dab14bd-ovn-node-metrics-cert\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.881464 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.881445    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90bb1f0e-d09f-4c21-97d3-8879c855e26a-agent-certs\") pod \"konnectivity-agent-k2tkj\" (UID: \"90bb1f0e-d09f-4c21-97d3-8879c855e26a\") " pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:22:59.889015 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.888990    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgww\" (UniqueName: \"kubernetes.io/projected/717c134c-2e81-4e15-9640-b3617f17f54a-kube-api-access-hkgww\") pod \"multus-mfmlj\" (UID: \"717c134c-2e81-4e15-9640-b3617f17f54a\") " pod="openshift-multus/multus-mfmlj"
Jul 06 19:22:59.895005 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.894978    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cht84\" (UniqueName: \"kubernetes.io/projected/37e99757-e8f6-4835-a539-e60c6ea744fa-kube-api-access-cht84\") pod \"multus-additional-cni-plugins-v6hrv\" (UID: \"37e99757-e8f6-4835-a539-e60c6ea744fa\") " pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:22:59.895680 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.895656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld49h\" (UniqueName: \"kubernetes.io/projected/6716d948-61c0-40d7-bed8-01269225bfa5-kube-api-access-ld49h\") pod \"iptables-alerter-79gws\" (UID: \"6716d948-61c0-40d7-bed8-01269225bfa5\") " pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:22:59.898552 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.898528    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:22:59.898658 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.898560    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:22:59.898658 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.898575    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:22:59.898804 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:22:59.898783    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:00.398754755 +0000 UTC m=+3.036253481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:22:59.901670 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.901646    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjjr\" (UniqueName: \"kubernetes.io/projected/7c2bb51e-f28c-4c9a-a3b7-b9670456691f-kube-api-access-xtjjr\") pod \"tuned-ppbt2\" (UID: \"7c2bb51e-f28c-4c9a-a3b7-b9670456691f\") " pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:22:59.902552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.902495    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9vvj\" (UniqueName: \"kubernetes.io/projected/7b15dc67-1605-44f7-9874-ff7b6cbb406d-kube-api-access-m9vvj\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:22:59.903036 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.903003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6gw\" (UniqueName: \"kubernetes.io/projected/ec75eca3-2343-44b7-9134-e23b7a89b098-kube-api-access-bt6gw\") pod \"node-ca-79jkp\" (UID: \"ec75eca3-2343-44b7-9134-e23b7a89b098\") " pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:22:59.903164 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.903140    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxtqq\" (UniqueName: \"kubernetes.io/projected/f06f04f4-7887-411b-acfe-4136c75c04c3-kube-api-access-wxtqq\") pod \"aws-ebs-csi-driver-node-4jkbm\" (UID: \"f06f04f4-7887-411b-acfe-4136c75c04c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:22:59.905113 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.905090    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmf5c\" (UniqueName: \"kubernetes.io/projected/105804d3-b174-4405-8713-0c132dab14bd-kube-api-access-tmf5c\") pod \"ovnkube-node-pxjq6\" (UID: \"105804d3-b174-4405-8713-0c132dab14bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:22:59.916899 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.916821    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"ab5dbf370003fb5a5a9cfc9f743962bb","Type":"ContainerStarted","Data":"7cd7acc335983a2e12a181ff5f7bb5dad7ed6bc72dcf3babf6e88a71a4012ce7"}
Jul 06 19:22:59.918075 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:22:59.918049    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"01a71ea3922c1a01f528cd43e38bc2b2","Type":"ContainerStarted","Data":"ef589a28a82d452c9cf60a958b276aedde727edaf073c1da1d7b8ebf9ce7bd92"}
Jul 06 19:23:00.063500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.063187    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm"
Jul 06 19:23:00.071706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.071684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79jkp"
Jul 06 19:23:00.081867 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.081843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6hrv"
Jul 06 19:23:00.087772 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.087745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mfmlj"
Jul 06 19:23:00.095742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.095715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:23:00.105469 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.105446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-79gws"
Jul 06 19:23:00.114571 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.114548    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppbt2"
Jul 06 19:23:00.120325 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.120301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:00.381568 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.381458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:00.381748 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.381565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:00.381748 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.381659    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:00.381748 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.381720    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:00.381748 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.381727    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:01.381706137 +0000 UTC m=+4.019204848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:00.381990 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.381774    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:01.381757168 +0000 UTC m=+4.019255878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:00.481907 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.481871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:00.482113 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.482066    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:00.482113 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.482090    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:00.482113 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.482103    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:00.482278 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.482171    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:01.482149339 +0000 UTC m=+4.119648051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:00.758629 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.758591    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec75eca3_2343_44b7_9134_e23b7a89b098.slice/crio-7d368c7241eec907d21f75b2e2866103232d0b28d159087065510856a3c449df WatchSource:0}: Error finding container 7d368c7241eec907d21f75b2e2866103232d0b28d159087065510856a3c449df: Status 404 returned error can't find the container with id 7d368c7241eec907d21f75b2e2866103232d0b28d159087065510856a3c449df
Jul 06 19:23:00.761164 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.761136    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105804d3_b174_4405_8713_0c132dab14bd.slice/crio-3de28151b69392b408c5611f2947051d1717ac39d3fae37d4e2ff0e8c8f6d183 WatchSource:0}: Error finding container 3de28151b69392b408c5611f2947051d1717ac39d3fae37d4e2ff0e8c8f6d183: Status 404 returned error can't find the container with id 3de28151b69392b408c5611f2947051d1717ac39d3fae37d4e2ff0e8c8f6d183
Jul 06 19:23:00.764161 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.764136    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2bb51e_f28c_4c9a_a3b7_b9670456691f.slice/crio-9bd4a01e3d20f27f256e0ac991a5893014b63614916b7ed2a5d83b1b23f04e28 WatchSource:0}: Error finding container 9bd4a01e3d20f27f256e0ac991a5893014b63614916b7ed2a5d83b1b23f04e28: Status 404 returned error can't find the container with id 9bd4a01e3d20f27f256e0ac991a5893014b63614916b7ed2a5d83b1b23f04e28
Jul 06 19:23:00.765991 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.765886    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717c134c_2e81_4e15_9640_b3617f17f54a.slice/crio-8b5e473e3cff691b1aaf480f5febbb56e0526f986eb75616af43386d4eeaf0a3 WatchSource:0}: Error finding container 8b5e473e3cff691b1aaf480f5febbb56e0526f986eb75616af43386d4eeaf0a3: Status 404 returned error can't find the container with id 8b5e473e3cff691b1aaf480f5febbb56e0526f986eb75616af43386d4eeaf0a3
Jul 06 19:23:00.766736 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.766703    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6716d948_61c0_40d7_bed8_01269225bfa5.slice/crio-839eed0183b31cbb5a08f3b01e1fcbe191cc7508378c5a7f346eeac22627b995 WatchSource:0}: Error finding container 839eed0183b31cbb5a08f3b01e1fcbe191cc7508378c5a7f346eeac22627b995: Status 404 returned error can't find the container with id 839eed0183b31cbb5a08f3b01e1fcbe191cc7508378c5a7f346eeac22627b995
Jul 06 19:23:00.768353 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.768324    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bb1f0e_d09f_4c21_97d3_8879c855e26a.slice/crio-f9eaff84dd20192e23181aa0c4ffa944b9a2ae7232a648262b2e733ecbcd88e9 WatchSource:0}: Error finding container f9eaff84dd20192e23181aa0c4ffa944b9a2ae7232a648262b2e733ecbcd88e9: Status 404 returned error can't find the container with id f9eaff84dd20192e23181aa0c4ffa944b9a2ae7232a648262b2e733ecbcd88e9
Jul 06 19:23:00.769535 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.769404    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06f04f4_7887_411b_acfe_4136c75c04c3.slice/crio-d60aecf9703d604d3f8947033a5bc79312e659914ff3c6d49add6dbe5a845e6f WatchSource:0}: Error finding container d60aecf9703d604d3f8947033a5bc79312e659914ff3c6d49add6dbe5a845e6f: Status 404 returned error can't find the container with id d60aecf9703d604d3f8947033a5bc79312e659914ff3c6d49add6dbe5a845e6f
Jul 06 19:23:00.770835 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:00.770498    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e99757_e8f6_4835_a539_e60c6ea744fa.slice/crio-7fd3c1bc604ba72de0d8917251cc3c97f6f074eb76e159fb548caae627992d29 WatchSource:0}: Error finding container 7fd3c1bc604ba72de0d8917251cc3c97f6f074eb76e159fb548caae627992d29: Status 404 returned error can't find the container with id 7fd3c1bc604ba72de0d8917251cc3c97f6f074eb76e159fb548caae627992d29
Jul 06 19:23:00.870028 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.869989    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:00 +0000 UTC" deadline="2028-01-29 23:25:47.993863732 +0000 UTC"
Jul 06 19:23:00.870028 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.870023    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13732h2m47.123843775s"
Jul 06 19:23:00.909899 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.909870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:00.910041 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:00.909997    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:00.921596 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.921556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppbt2" event={"ID":"7c2bb51e-f28c-4c9a-a3b7-b9670456691f","Type":"ContainerStarted","Data":"9bd4a01e3d20f27f256e0ac991a5893014b63614916b7ed2a5d83b1b23f04e28"}
Jul 06 19:23:00.922672 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.922626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerStarted","Data":"7fd3c1bc604ba72de0d8917251cc3c97f6f074eb76e159fb548caae627992d29"}
Jul 06 19:23:00.923662 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.923631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2tkj" event={"ID":"90bb1f0e-d09f-4c21-97d3-8879c855e26a","Type":"ContainerStarted","Data":"f9eaff84dd20192e23181aa0c4ffa944b9a2ae7232a648262b2e733ecbcd88e9"}
Jul 06 19:23:00.925025 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.925000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"3de28151b69392b408c5611f2947051d1717ac39d3fae37d4e2ff0e8c8f6d183"}
Jul 06 19:23:00.926100 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.926078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79jkp" event={"ID":"ec75eca3-2343-44b7-9134-e23b7a89b098","Type":"ContainerStarted","Data":"7d368c7241eec907d21f75b2e2866103232d0b28d159087065510856a3c449df"}
Jul 06 19:23:00.928062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.928037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"01a71ea3922c1a01f528cd43e38bc2b2","Type":"ContainerStarted","Data":"8e2a3480d20e954517c09d492bfecb9a2b2ddf2fac99c3e7f4678479afbfcee7"}
Jul 06 19:23:00.929178 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.929153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm" event={"ID":"f06f04f4-7887-411b-acfe-4136c75c04c3","Type":"ContainerStarted","Data":"d60aecf9703d604d3f8947033a5bc79312e659914ff3c6d49add6dbe5a845e6f"}
Jul 06 19:23:00.930371 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.930344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mfmlj" event={"ID":"717c134c-2e81-4e15-9640-b3617f17f54a","Type":"ContainerStarted","Data":"8b5e473e3cff691b1aaf480f5febbb56e0526f986eb75616af43386d4eeaf0a3"}
Jul 06 19:23:00.931432 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.931408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-79gws" event={"ID":"6716d948-61c0-40d7-bed8-01269225bfa5","Type":"ContainerStarted","Data":"839eed0183b31cbb5a08f3b01e1fcbe191cc7508378c5a7f346eeac22627b995"}
Jul 06 19:23:00.944178 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:00.944126    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" podStartSLOduration=1.9441144289999999 podStartE2EDuration="1.944114429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:00.944088457 +0000 UTC m=+3.581587192" watchObservedRunningTime="2026-07-06 19:23:00.944114429 +0000 UTC m=+3.581613160"
Jul 06 19:23:01.389910 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.389871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:01.390068 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.389959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:01.390068 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.390038    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:01.390167 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.390105    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:03.390090276 +0000 UTC m=+6.027588988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:01.390167 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.390044    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:01.390167 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.390163    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:03.390150356 +0000 UTC m=+6.027649065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:01.491313 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.491271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:01.491483 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.491468    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:01.491561 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.491487    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:01.491561 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.491504    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:01.491676 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.491565    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:03.49154578 +0000 UTC m=+6.129044492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:01.870892 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.870694    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:00 +0000 UTC" deadline="2028-02-03 22:56:44.26919188 +0000 UTC"
Jul 06 19:23:01.870892 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.870804    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13851h33m42.398393048s"
Jul 06 19:23:01.911351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.910837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:01.911351 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.910967    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:01.911873 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:01.911709    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:01.911873 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:01.911825    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:02.910310 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:02.910277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:02.910783 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:02.910412    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:02.949267 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:02.949231    2559 generic.go:356] "Generic (PLEG): container finished" podID="ab5dbf370003fb5a5a9cfc9f743962bb" containerID="4cd5d2b629183dee1407b30891d3bc07fb073c443164168fa0cddad1df39dbbf" exitCode=0
Jul 06 19:23:02.949435 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:02.949279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"ab5dbf370003fb5a5a9cfc9f743962bb","Type":"ContainerDied","Data":"4cd5d2b629183dee1407b30891d3bc07fb073c443164168fa0cddad1df39dbbf"}
Jul 06 19:23:03.410312 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.410256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:03.410480 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.410325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:03.410480 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.410471    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:03.410595 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.410533    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:07.410515626 +0000 UTC m=+10.048014336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:03.410945 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.410926    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:03.411043 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.410979    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:07.410965126 +0000 UTC m=+10.048463835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:03.512079 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.511376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:03.512079 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.511568    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:03.512079 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.511588    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:03.512079 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.511600    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:03.512079 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.511674    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:07.511653835 +0000 UTC m=+10.149152551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:03.909575 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.909434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:03.909575 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.909483    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:03.909806 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.909580    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:03.910053 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:03.909983    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:03.954852 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.954815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"ab5dbf370003fb5a5a9cfc9f743962bb","Type":"ContainerStarted","Data":"5b186491d603c548df3d4822993be728ffb6c8de93dd4626ea0682f36556d34a"}
Jul 06 19:23:03.971362 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:03.970892    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" podStartSLOduration=4.970871144 podStartE2EDuration="4.970871144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:03.970763955 +0000 UTC m=+6.608262685" watchObservedRunningTime="2026-07-06 19:23:03.970871144 +0000 UTC m=+6.608369875"
Jul 06 19:23:04.909706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:04.909673    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:04.909907 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:04.909820    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:05.910777 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:05.910739    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:05.911238 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:05.910867    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:05.912930 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:05.912777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:05.912930 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:05.912883    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:06.910201 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:06.910157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:06.910378 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:06.910303    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:07.444473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:07.444128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:07.444473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:07.444193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:07.444473 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.444328    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:07.444473 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.444388    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:15.444370383 +0000 UTC m=+18.081869091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:07.444473 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.444447    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:07.445174 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.444517    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:15.444499723 +0000 UTC m=+18.081998443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:07.545610 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:07.545021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:07.545610 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.545170    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:07.545610 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.545198    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:07.545610 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.545213    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:07.545610 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.545286    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:15.545265859 +0000 UTC m=+18.182764578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:07.910313 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:07.910237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:07.911797 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:07.911237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:07.911797 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.911346    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:07.911797 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:07.911426    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:08.909301 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:08.909262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:08.909792 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:08.909402    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:09.909497 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:09.909460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:09.909497 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:09.909483    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:09.910028 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:09.909597    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:09.910028 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:09.909784    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:10.910186 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:10.910152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:10.910650 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:10.910308    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:11.789455 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.789373    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gn64b"]
Jul 06 19:23:11.800380 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.800354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.802540 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.802517    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:23:11.802708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.802551    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:23:11.802852 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.802827    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8tm5l\""
Jul 06 19:23:11.881592 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.881554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-hosts-file\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.881771 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.881601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pnn\" (UniqueName: \"kubernetes.io/projected/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-kube-api-access-54pnn\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.881771 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.881696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-tmp-dir\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.909621 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.909584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:11.909789 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:11.909738    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:11.909789 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.909781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:11.909904 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:11.909883    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:11.982273 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.982239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-hosts-file\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.982723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.982277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pnn\" (UniqueName: \"kubernetes.io/projected/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-kube-api-access-54pnn\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.982723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.982318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-tmp-dir\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.982723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.982376    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-hosts-file\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.982723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.982688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-tmp-dir\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:11.993163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:11.993137    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pnn\" (UniqueName: \"kubernetes.io/projected/004e02dd-5a2a-40a6-bbb7-d46a1761e2ba-kube-api-access-54pnn\") pod \"node-resolver-gn64b\" (UID: \"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba\") " pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:12.119450 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:12.119359    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gn64b"
Jul 06 19:23:12.909536 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:12.909501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:12.909698 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:12.909642    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:13.909513 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:13.909481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:13.909981 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:13.909521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:13.909981 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:13.909608    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:13.909981 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:13.909722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:14.910096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:14.910060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:14.910705 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:14.910208    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:15.507037 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:15.507000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:15.507214 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.507143    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:15.507214 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:15.507161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:15.507214 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.507212    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:31.507189546 +0000 UTC m=+34.144688270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:15.507393 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.507262    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:15.507393 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.507314    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:23:31.507297947 +0000 UTC m=+34.144796672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:15.608351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:15.608321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:15.608525 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.608443    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:15.608525 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.608460    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:15.608525 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.608468    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:15.608525 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.608517    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:31.608499783 +0000 UTC m=+34.245998510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:15.910095 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:15.910065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:15.910280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:15.910065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:15.910280 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.910199    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:15.910718 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:15.910312    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:16.910029 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:16.909991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:16.910212 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:16.910103    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:17.910817 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:17.910781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:17.911285 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:17.910881    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:17.911285 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:17.910893    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:17.911285 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:17.911015    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:18.909297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:18.909263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:18.909502 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:18.909411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:19.909822 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:19.909783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:19.910233 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:19.909835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:19.910233 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:19.909916    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:19.910233 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:19.910055    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:19.969078 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:19.969042    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004e02dd_5a2a_40a6_bbb7_d46a1761e2ba.slice/crio-1c7ceb6b0960c0e21bece068aa144dbec2a9dbe109d71cc3c8b9a436ea8bf234 WatchSource:0}: Error finding container 1c7ceb6b0960c0e21bece068aa144dbec2a9dbe109d71cc3c8b9a436ea8bf234: Status 404 returned error can't find the container with id 1c7ceb6b0960c0e21bece068aa144dbec2a9dbe109d71cc3c8b9a436ea8bf234
Jul 06 19:23:19.994821 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:19.994641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gn64b" event={"ID":"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba","Type":"ContainerStarted","Data":"1c7ceb6b0960c0e21bece068aa144dbec2a9dbe109d71cc3c8b9a436ea8bf234"}
Jul 06 19:23:20.910018 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:20.909783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:20.910617 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:20.910064    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:20.997952 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:20.997920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2tkj" event={"ID":"90bb1f0e-d09f-4c21-97d3-8879c855e26a","Type":"ContainerStarted","Data":"4d2fd85d467d370216d87695fca90b4d17e19559bc0df1d21142c0bed0d57dbc"}
Jul 06 19:23:21.001321 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"1ad2b9af95de03f8ae458b22e377d74de7ec23f6ef0bb47303f8e071da295ee0"}
Jul 06 19:23:21.001470 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"a22589f694aabc3d2cf9c1ffaa617f199a7d424ceb75dc5adcf2d5313842a0fd"}
Jul 06 19:23:21.001470 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"4b889c09edb5df7b9ce12db2ddb7a3ca7eaebe3e63d7a041f2900a3a9e14d128"}
Jul 06 19:23:21.001470 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"d9c6190b1249062aed16371468f44395eb14a587ceb016271387a1e8aed56f7b"}
Jul 06 19:23:21.001657 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"6d65acba8cf951bfae676e5d883fe7640f86f99e60411c50fd5eaa6f627d8504"}
Jul 06 19:23:21.001657 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.001557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"88760a156dbfd5f213a6df65f15b71d7114fc540f960d4bf8553dd7da2cb46c9"}
Jul 06 19:23:21.002892 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.002866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79jkp" event={"ID":"ec75eca3-2343-44b7-9134-e23b7a89b098","Type":"ContainerStarted","Data":"ebfef0f81ef9d285510aa39a33c9335718e1997d3c2d13974465709bbf593f4d"}
Jul 06 19:23:21.004476 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.004448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm" event={"ID":"f06f04f4-7887-411b-acfe-4136c75c04c3","Type":"ContainerStarted","Data":"399938ded62a5d3d12e28984504ba7717284953b6b3585a43755bed8bcd60869"}
Jul 06 19:23:21.006019 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.005995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mfmlj" event={"ID":"717c134c-2e81-4e15-9640-b3617f17f54a","Type":"ContainerStarted","Data":"7136f5e771d0763ebd8673a82cc0e592aa7a8a7a05e76a42af71797cf5f4e94f"}
Jul 06 19:23:21.007644 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.007609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppbt2" event={"ID":"7c2bb51e-f28c-4c9a-a3b7-b9670456691f","Type":"ContainerStarted","Data":"489f00388a4feaa9409e83c983dd3179f6d094a33c28e169d1b1330756534574"}
Jul 06 19:23:21.009213 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.009179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gn64b" event={"ID":"004e02dd-5a2a-40a6-bbb7-d46a1761e2ba","Type":"ContainerStarted","Data":"3635a16436f2f61c5a98e3ad5819797f14d1f89749f9284859ddf604ee366ad5"}
Jul 06 19:23:21.010867 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.010843    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="755c305829bf17b7d51f366a4bacfa8b0debb7123b02cf28fdb146074a2f1199" exitCode=0
Jul 06 19:23:21.010967 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.010879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"755c305829bf17b7d51f366a4bacfa8b0debb7123b02cf28fdb146074a2f1199"}
Jul 06 19:23:21.012655 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.012556    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k2tkj" podStartSLOduration=3.822772816 podStartE2EDuration="23.012522108s" totalImagesPullingTime="19.189749292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.012498292 +0000 UTC m=+23.649997244" watchObservedRunningTime="2026-07-06 19:23:21.012522108 +0000 UTC m=+23.650020837"
Jul 06 19:23:21.029673 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.029616    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ppbt2" podStartSLOduration=3.834893631 podStartE2EDuration="23.02960093s" totalImagesPullingTime="19.194707299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.029527505 +0000 UTC m=+23.667026233" watchObservedRunningTime="2026-07-06 19:23:21.02960093 +0000 UTC m=+23.667099659"
Jul 06 19:23:21.074080 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.074020    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-79jkp" podStartSLOduration=3.874213603 podStartE2EDuration="23.073999115s" totalImagesPullingTime="19.199785512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.05276171 +0000 UTC m=+23.690260442" watchObservedRunningTime="2026-07-06 19:23:21.073999115 +0000 UTC m=+23.711497843"
Jul 06 19:23:21.088247 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.088197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gn64b" podStartSLOduration=10.088183172 podStartE2EDuration="10.088183172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.087782908 +0000 UTC m=+23.725281639" watchObservedRunningTime="2026-07-06 19:23:21.088183172 +0000 UTC m=+23.725681899"
Jul 06 19:23:21.107346 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.107299    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mfmlj" podStartSLOduration=3.861645271 podStartE2EDuration="23.107284212s" totalImagesPullingTime="19.245638941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.106722855 +0000 UTC m=+23.744221582" watchObservedRunningTime="2026-07-06 19:23:21.107284212 +0000 UTC m=+23.744782943"
Jul 06 19:23:21.153749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.153708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:21.232886 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.232800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:21.336477 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.336301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:21.412762 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.412739    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:23:21.845059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.844923    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:23:21.412757551Z","UUID":"3f81ff4e-1369-4e01-8c9f-4632cbb26047","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:23:21.846298 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.846281    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:23:21.846421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.846317    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:23:21.909539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.909328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:21.909539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:21.909328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:21.909539 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:21.909438    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:21.909539 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:21.909486    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:22.015156 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.015108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-79gws" event={"ID":"6716d948-61c0-40d7-bed8-01269225bfa5","Type":"ContainerStarted","Data":"48174466eb9e3d41f925f2b84691c8732a04952835fafb7a9cd6376a7371b2ca"}
Jul 06 19:23:22.017482 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.017461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm" event={"ID":"f06f04f4-7887-411b-acfe-4136c75c04c3","Type":"ContainerStarted","Data":"2fdd5383279b4c2be922748919b59ea054ec44f7c1e9b0758a997a4f7f8669d6"}
Jul 06 19:23:22.030795 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.030743    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-79gws" podStartSLOduration=4.836971926 podStartE2EDuration="24.030722549s" totalImagesPullingTime="19.193750623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:22.029866283 +0000 UTC m=+24.667365011" watchObservedRunningTime="2026-07-06 19:23:22.030722549 +0000 UTC m=+24.668221278"
Jul 06 19:23:22.151927 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.151815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:22.252525 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.252488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:22.321769 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.321738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:22.909984 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:22.909956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:22.910177 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:22.910072    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:23.022968 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.022934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"4ea2ecdbfe9479264462394ca001d5d7552031e26799a40ba0f2c54c044bbac7"}
Jul 06 19:23:23.025054 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.025023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm" event={"ID":"f06f04f4-7887-411b-acfe-4136c75c04c3","Type":"ContainerStarted","Data":"2e47499482a8ca0f867f3630eca05024486bac0a9beb807961d4e28b9eac625a"}
Jul 06 19:23:23.044224 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.044182    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkbm" podStartSLOduration=3.604427229 podStartE2EDuration="25.044169174s" totalImagesPullingTime="21.439741945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:23.043286436 +0000 UTC m=+25.680785168" watchObservedRunningTime="2026-07-06 19:23:23.044169174 +0000 UTC m=+25.681667901"
Jul 06 19:23:23.702768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.702732    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:23:23.703532 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.703509    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:23:23.909501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.909465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:23.909684 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:23.909465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:23.909684 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:23.909575    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:23.909684 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:23.909663    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:24.012735 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.012638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:24.027542 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.027510    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:23:24.028133 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.027975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2tkj"
Jul 06 19:23:24.121331 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.121291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:24.254545 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.254503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:24.909544 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:24.909517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:24.909743 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:24.909652    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:25.128154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.128078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gn64b_004e02dd-5a2a-40a6-bbb7-d46a1761e2ba/dns-node-resolver/0.log"
Jul 06 19:23:25.271355 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.271326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:25.375063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.375031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:25.909981 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.909800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:25.910151 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.909800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:25.910151 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:25.910092    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:25.910151 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:25.910119    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:25.928045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:25.928016    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79jkp_ec75eca3-2343-44b7-9134-e23b7a89b098/node-ca/0.log"
Jul 06 19:23:26.038761 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.038732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" event={"ID":"105804d3-b174-4405-8713-0c132dab14bd","Type":"ContainerStarted","Data":"c044744c4afdfe21a1027c21cdc2d7b1d1c96fa2350ec48951d33bd22f33d18b"}
Jul 06 19:23:26.042107 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.042080    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:26.042241 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.042167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:26.042241 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.042215    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:26.059502 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.059474    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:26.059653 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.059610    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:26.083291 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.083159    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6" podStartSLOduration=8.803775679 podStartE2EDuration="28.083141799s" totalImagesPullingTime="19.27936612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:26.082230495 +0000 UTC m=+28.719729225" watchObservedRunningTime="2026-07-06 19:23:26.083141799 +0000 UTC m=+28.720640528"
Jul 06 19:23:26.839140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.839109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:26.909850 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:26.909812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:26.910000 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:26.909923    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:27.042998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.042964    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="d46e6957ec8db104df30854586d565d306c3190713e059a74f5a3909a080fb9b" exitCode=0
Jul 06 19:23:27.043216 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.043056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"d46e6957ec8db104df30854586d565d306c3190713e059a74f5a3909a080fb9b"}
Jul 06 19:23:27.323471 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.323437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:27.434463 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.434428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:27.524747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.524717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:27.615509 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.615436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:27.910191 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.910015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:27.910585 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.910083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:27.910585 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:27.910253    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:27.910585 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:27.910336    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:27.999207 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.999063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vc9xk"]
Jul 06 19:23:27.999335 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.999216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:27.999394 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:27.999337    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:27.999902 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:27.999872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gj7k"]
Jul 06 19:23:28.013335 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.013243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dl8l5"]
Jul 06 19:23:28.047994 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.047966    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="bc8d6f4ddf34889f0a0a31456fbbe9485dc051cfb548e1d1dc86e352da1183ec" exitCode=0
Jul 06 19:23:28.048154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.048076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"bc8d6f4ddf34889f0a0a31456fbbe9485dc051cfb548e1d1dc86e352da1183ec"}
Jul 06 19:23:28.048219 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.048154    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:28.048219 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.048179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:28.048317 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:28.048270    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:28.048369 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:28.048344    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:28.721639 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.721588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:28.790499 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:28.790472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.176236 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.176203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.251394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.251358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.484596 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.484565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.651613 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.651581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.734032 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.733988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.839102 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.839028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:29.910038 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.910002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:29.910198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.910002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:29.910198 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:29.910128    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:29.910198 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:29.910015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:29.910375 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:29.910180    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:29.910375 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:29.910261    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:30.055501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:30.055470    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="df6ed5b382c9975f1a379ee337e4a61b487b652514b69ef5c0a157d176518b13" exitCode=0
Jul 06 19:23:30.055685 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:30.055535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"df6ed5b382c9975f1a379ee337e4a61b487b652514b69ef5c0a157d176518b13"}
Jul 06 19:23:31.114520 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.114483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:31.198147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.198109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:31.532644 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.532596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:31.532778 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.532681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:31.532778 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.532739    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:31.532845 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.532786    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:31.532845 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.532802    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs podName:7b15dc67-1605-44f7-9874-ff7b6cbb406d nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.532787219 +0000 UTC m=+66.170285925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs") pod "network-metrics-daemon-vc9xk" (UID: "7b15dc67-1605-44f7-9874-ff7b6cbb406d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:23:31.532845 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.532836    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret podName:d72de2bc-6164-472c-bd1c-f2811047f5c6 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.532820586 +0000 UTC m=+66.170319311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret") pod "global-pull-secret-syncer-2gj7k" (UID: "d72de2bc-6164-472c-bd1c-f2811047f5c6") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:23:31.633739 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.633705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:31.633923 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.633866    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:23:31.633923 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.633891    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:23:31.633923 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.633905    2559 projected.go:196] Error preparing data for projected volume kube-api-access-txcvf for pod openshift-network-diagnostics/network-check-target-dl8l5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:31.634058 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.633971    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf podName:edf961ad-2b9e-467b-be67-963763d73133 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:03.633950464 +0000 UTC m=+66.271449171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-txcvf" (UniqueName: "kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf") pod "network-check-target-dl8l5" (UID: "edf961ad-2b9e-467b-be67-963763d73133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:23:31.909726 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.909688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:31.909893 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.909688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:31.909893 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.909830    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:31.909893 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:31.909705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:31.910074 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.909894    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:31.910074 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:31.909971    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:32.060097 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:32.060053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:33.426151 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.426095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:33.551051 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.551014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:33.652676 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.652641    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:33.790236 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.790145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:33.910246 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.910211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:33.910418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.910252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:33.910418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.910219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:33.910418 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:33.910342    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:33.910579 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:33.910438    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:33.910579 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:33.910531    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:33.914464 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:33.914437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:34.084603 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:34.084521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:34.365930 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:34.365846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:34.727621 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:34.727570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:34.925221 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:34.924985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:35.071671 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.071615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerStarted","Data":"3fb96fd3da3d0541863dd11d62451cfd3fdde94786fc7bee96624bd171fc0bb3"}
Jul 06 19:23:35.541855 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.541808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:35.786062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.786029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:35.909491 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.909455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:35.909673 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.909462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:35.909673 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:35.909557    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:35.909673 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:35.909467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:35.909801 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:35.909668    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:35.909801 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:35.909736    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:36.076369 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:36.076337    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="3fb96fd3da3d0541863dd11d62451cfd3fdde94786fc7bee96624bd171fc0bb3" exitCode=0
Jul 06 19:23:36.076504 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:36.076400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"3fb96fd3da3d0541863dd11d62451cfd3fdde94786fc7bee96624bd171fc0bb3"}
Jul 06 19:23:36.211886 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:36.211856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:36.351114 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:36.351073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:36.569151 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:36.569055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:37.084714 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.084678    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e99757-e8f6-4835-a539-e60c6ea744fa" containerID="c12230564c31faa344743ac29c4830f5fb7a3bae3390bab784548a4d8e924e93" exitCode=0
Jul 06 19:23:37.085086 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.084727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerDied","Data":"c12230564c31faa344743ac29c4830f5fb7a3bae3390bab784548a4d8e924e93"}
Jul 06 19:23:37.427834 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.427806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:37.543808 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.543772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:37.746272 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.746170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:37.910816 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.910781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:37.910983 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:37.910871    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:37.910983 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.910893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:37.910983 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:37.910975    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:37.911170 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.911000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:37.911170 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:37.911083    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:37.952092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:37.952063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:38.089941 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.089861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" event={"ID":"37e99757-e8f6-4835-a539-e60c6ea744fa","Type":"ContainerStarted","Data":"2192eafdb3808a7ab5dc184ce0c6405f5f51259cdb35931fd32329aba0ab9de4"}
Jul 06 19:23:38.129697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.129620    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v6hrv" podStartSLOduration=9.244235045 podStartE2EDuration="40.129600494s" totalImagesPullingTime="30.885365449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:38.125946906 +0000 UTC m=+40.763445637" watchObservedRunningTime="2026-07-06 19:23:38.129600494 +0000 UTC m=+40.767099229"
Jul 06 19:23:38.143888 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.143855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:38.250532 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.250500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:38.361822 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.361737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:38.467124 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.467089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:38.563178 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:38.563137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:39.524731 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:39.524691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:39.909554 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:39.909520    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:39.909742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:39.909526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:39.909742 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:39.909622    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:39.909742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:39.909653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:39.909859 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:39.909748    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:39.909891 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:39.909858    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:39.919464 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:39.919430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:40.007527 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:40.007494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:40.112145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:40.112113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:40.260502 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:40.260421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:40.358648 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:40.358599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:40.513544 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:40.513466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:41.545464 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:41.545427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:41.719067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:41.719035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:41.910145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:41.910116    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:41.910311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:41.910124    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:41.910311 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:41.910235    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:41.910376 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:41.910322    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:41.910376 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:41.910125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:41.910434 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:41.910416    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:42.110516 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:42.110479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:42.305572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:42.305485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:42.911791 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:42.911759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:43.373055 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.373028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:43.686364 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.686286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:43.789881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.789839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:43.910057 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.910019    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:43.910057 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.910062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:43.910314 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.910020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:43.910314 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:43.910155    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:43.910314 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:43.910212    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:43.910314 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:43.910287    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:43.911430 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:43.911400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:44.123041 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:44.123012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:45.909398 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:45.909361    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:45.909398 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:45.909384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:45.909832 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:45.909366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:45.909832 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:45.909487    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:45.909832 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:45.909606    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:45.909832 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:45.909689    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:46.092407 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.092373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.192367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.192273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.635684 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.635649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.742805 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.742770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.813046 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.813017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.975426 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:46.975340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.070703 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.070668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.190097 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.190053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.565933 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.565897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.761408 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.761377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.834798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.834702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:47.910897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.910871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:47.911052 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:47.910960    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:47.911052 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.911040    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:47.911171 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:47.911109    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:47.911218 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:47.911202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:47.911334 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:47.911314    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:49.909941 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:49.909899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:49.909941 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:49.909922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:49.910392 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:49.909910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:49.910392 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:49.910003    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gj7k" podUID="d72de2bc-6164-472c-bd1c-f2811047f5c6"
Jul 06 19:23:49.910392 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:49.910105    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vc9xk" podUID="7b15dc67-1605-44f7-9874-ff7b6cbb406d"
Jul 06 19:23:49.910392 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:49.910163    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dl8l5" podUID="edf961ad-2b9e-467b-be67-963763d73133"
Jul 06 19:23:50.803229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:50.803194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:50.902727 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:50.902690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.004223 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.004192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.107884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.107797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.477699 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.477663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.628860 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.628821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.658605 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.658580    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeReady"
Jul 06 19:23:51.658788 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.658735    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:23:51.757337 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.757262    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gtxd"]
Jul 06 19:23:51.775356 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.775329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:51.784620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.781830    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kgc4k"]
Jul 06 19:23:51.788028 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.788006    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:23:51.788199 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.788009    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:23:51.790297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.790283    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:23:51.790690 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.790677    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qx2jx\""
Jul 06 19:23:51.795468 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.795450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.802927 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.802911    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:23:51.803019 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.803002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:23:51.803413 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.803401    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhtlv\""
Jul 06 19:23:51.813285 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.813263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gtxd"]
Jul 06 19:23:51.831681 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.831657    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2jv62"]
Jul 06 19:23:51.844406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.844383    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgc4k"]
Jul 06 19:23:51.844524 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.844482    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.861733 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.861712    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:23:51.862010 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.861997    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:23:51.862372 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.862360    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:23:51.863678 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.863664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lq9xg\""
Jul 06 19:23:51.865942 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.865927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:23:51.871952 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.871933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jv62"]
Jul 06 19:23:51.879448 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dea2c908-2790-4a43-9de3-ec8a261dd2b9-config-volume\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.879500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dea2c908-2790-4a43-9de3-ec8a261dd2b9-tmp-dir\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.879545 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4b4631-720f-4357-b59e-f4dcb5cec061-data-volume\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.879589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtvj\" (UniqueName: \"kubernetes.io/projected/79c01869-c6ef-405e-9647-a7359ef79882-kube-api-access-tjtvj\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:51.879656 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrzm\" (UniqueName: \"kubernetes.io/projected/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-api-access-ftrzm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.879702 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4b4631-720f-4357-b59e-f4dcb5cec061-crio-socket\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.879738 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c01869-c6ef-405e-9647-a7359ef79882-cert\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:51.879777 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea2c908-2790-4a43-9de3-ec8a261dd2b9-metrics-tls\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.879815 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4b4631-720f-4357-b59e-f4dcb5cec061-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.879855 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.879901 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.879852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w56ql\" (UniqueName: \"kubernetes.io/projected/dea2c908-2790-4a43-9de3-ec8a261dd2b9-kube-api-access-w56ql\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.897158 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.897127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.910208 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.910186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:23:51.910276 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.910219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:23:51.910276 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.910185    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:23:51.937973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.937953    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d9llp\""
Jul 06 19:23:51.939176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.939161    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:23:51.941936 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.941921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tr4sh\""
Jul 06 19:23:51.946603 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.946590    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:23:51.957110 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.957092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:23:51.978572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.978546    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:23:51.980793 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrzm\" (UniqueName: \"kubernetes.io/projected/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-api-access-ftrzm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.980887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4b4631-720f-4357-b59e-f4dcb5cec061-crio-socket\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.980887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c01869-c6ef-405e-9647-a7359ef79882-cert\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:51.980887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea2c908-2790-4a43-9de3-ec8a261dd2b9-metrics-tls\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4b4631-720f-4357-b59e-f4dcb5cec061-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w56ql\" (UniqueName: \"kubernetes.io/projected/dea2c908-2790-4a43-9de3-ec8a261dd2b9-kube-api-access-w56ql\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.980985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dea2c908-2790-4a43-9de3-ec8a261dd2b9-config-volume\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dea2c908-2790-4a43-9de3-ec8a261dd2b9-tmp-dir\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.981039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981014    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4b4631-720f-4357-b59e-f4dcb5cec061-crio-socket\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4b4631-720f-4357-b59e-f4dcb5cec061-data-volume\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtvj\" (UniqueName: \"kubernetes.io/projected/79c01869-c6ef-405e-9647-a7359ef79882-kube-api-access-tjtvj\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:51.981895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981437    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4b4631-720f-4357-b59e-f4dcb5cec061-data-volume\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981476    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.981895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981740    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dea2c908-2790-4a43-9de3-ec8a261dd2b9-tmp-dir\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.982098 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.981984    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dea2c908-2790-4a43-9de3-ec8a261dd2b9-config-volume\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.984870 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.984853    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4b4631-720f-4357-b59e-f4dcb5cec061-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:51.984968 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.984900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea2c908-2790-4a43-9de3-ec8a261dd2b9-metrics-tls\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:51.985027 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:51.984983    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c01869-c6ef-405e-9647-a7359ef79882-cert\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:52.000977 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.000951    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrzm\" (UniqueName: \"kubernetes.io/projected/aa4b4631-720f-4357-b59e-f4dcb5cec061-kube-api-access-ftrzm\") pod \"insights-runtime-extractor-2jv62\" (UID: \"aa4b4631-720f-4357-b59e-f4dcb5cec061\") " pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:52.007023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.006997    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w56ql\" (UniqueName: \"kubernetes.io/projected/dea2c908-2790-4a43-9de3-ec8a261dd2b9-kube-api-access-w56ql\") pod \"dns-default-kgc4k\" (UID: \"dea2c908-2790-4a43-9de3-ec8a261dd2b9\") " pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:52.007411 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.007256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtvj\" (UniqueName: \"kubernetes.io/projected/79c01869-c6ef-405e-9647-a7359ef79882-kube-api-access-tjtvj\") pod \"ingress-canary-8gtxd\" (UID: \"79c01869-c6ef-405e-9647-a7359ef79882\") " pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:52.086025 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.085991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gtxd"
Jul 06 19:23:52.102741 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.102719    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:52.103193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.103166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:52.153983 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.152665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jv62"
Jul 06 19:23:52.266589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.266516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:52.268421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.268392    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gtxd"]
Jul 06 19:23:52.271990 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:52.271953    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c01869_c6ef_405e_9647_a7359ef79882.slice/crio-aa54062d2248a7238ed4216b7d3cbcf10a7d583718730983f948ed57dda0dd7c WatchSource:0}: Error finding container aa54062d2248a7238ed4216b7d3cbcf10a7d583718730983f948ed57dda0dd7c: Status 404 returned error can't find the container with id aa54062d2248a7238ed4216b7d3cbcf10a7d583718730983f948ed57dda0dd7c
Jul 06 19:23:52.286278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:52.286248    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea2c908_2790_4a43_9de3_ec8a261dd2b9.slice/crio-6ebdec03a1f92f562070665b9bc4f35956000b990e149cb91751a8e30830b520 WatchSource:0}: Error finding container 6ebdec03a1f92f562070665b9bc4f35956000b990e149cb91751a8e30830b520: Status 404 returned error can't find the container with id 6ebdec03a1f92f562070665b9bc4f35956000b990e149cb91751a8e30830b520
Jul 06 19:23:52.287306 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.287267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgc4k"]
Jul 06 19:23:52.317841 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:52.317803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jv62"]
Jul 06 19:23:52.322883 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:52.322860    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4b4631_720f_4357_b59e_f4dcb5cec061.slice/crio-16ff172f9f4da029178236139cd67789ff60c29b2fb5cf86ac3daaa1658a56ff WatchSource:0}: Error finding container 16ff172f9f4da029178236139cd67789ff60c29b2fb5cf86ac3daaa1658a56ff: Status 404 returned error can't find the container with id 16ff172f9f4da029178236139cd67789ff60c29b2fb5cf86ac3daaa1658a56ff
Jul 06 19:23:53.131914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.131872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jv62" event={"ID":"aa4b4631-720f-4357-b59e-f4dcb5cec061","Type":"ContainerStarted","Data":"16ff172f9f4da029178236139cd67789ff60c29b2fb5cf86ac3daaa1658a56ff"}
Jul 06 19:23:53.133930 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.133862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gtxd" event={"ID":"79c01869-c6ef-405e-9647-a7359ef79882","Type":"ContainerStarted","Data":"aa54062d2248a7238ed4216b7d3cbcf10a7d583718730983f948ed57dda0dd7c"}
Jul 06 19:23:53.136048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.135985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgc4k" event={"ID":"dea2c908-2790-4a43-9de3-ec8a261dd2b9","Type":"ContainerStarted","Data":"6ebdec03a1f92f562070665b9bc4f35956000b990e149cb91751a8e30830b520"}
Jul 06 19:23:53.816334 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.816234    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:23:53.818513 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.818489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.823347 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.823324    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:23:53.823541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.823519    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:23:53.823982 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.823959    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:23:53.824199 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.824182    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:23:53.824498 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.824482    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:23:53.824589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.824573    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:23:53.824716 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.824700    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:23:53.824781 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.824709    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8v4fg\""
Jul 06 19:23:53.830176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.830145    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:23:53.899087 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.899280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.899280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592zp\" (UniqueName: \"kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.899280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.899280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:53.899280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:53.899280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.000778 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.000934 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.000934 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.000934 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592zp\" (UniqueName: \"kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.001061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.001061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.000957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.001964 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.001917    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.002760 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.002732    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.003259 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.003215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.005507 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.005366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.006867 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.006842    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.011015 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.010972    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592zp\" (UniqueName: \"kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp\") pod \"console-85846b4fc5-8fwx7\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") " pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.133191 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.133147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:23:54.616723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.616637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:54.782485 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:54.782450    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.059000 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.058966    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.132656 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.132609    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"]
Jul 06 19:23:55.144575 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.144550    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.148977 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.148948    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 19:23:55.149674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.149649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zvkcc\""
Jul 06 19:23:55.149674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.149664    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:23:55.149877 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.149712    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:23:55.150350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.150332    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 19:23:55.150446 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.150400    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:23:55.157666 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.157643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"]
Jul 06 19:23:55.212569 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.212524    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.212569 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.212573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d663a04-97c4-4b42-958a-1f33e49189ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.212830 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.212602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6r7t\" (UniqueName: \"kubernetes.io/projected/5d663a04-97c4-4b42-958a-1f33e49189ad-kube-api-access-t6r7t\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.212830 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.212709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.222329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.222292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.313890 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.313801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.314058 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.313912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.314058 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.313951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d663a04-97c4-4b42-958a-1f33e49189ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.314058 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:55.313921    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 19:23:55.314200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.313975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6r7t\" (UniqueName: \"kubernetes.io/projected/5d663a04-97c4-4b42-958a-1f33e49189ad-kube-api-access-t6r7t\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.314200 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:23:55.314113    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls podName:5d663a04-97c4-4b42-958a-1f33e49189ad nodeName:}" failed. No retries permitted until 2026-07-06 19:23:55.81408931 +0000 UTC m=+58.451588028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-wjs7t" (UID: "5d663a04-97c4-4b42-958a-1f33e49189ad") : secret "prometheus-operator-tls" not found
Jul 06 19:23:55.314765 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.314746    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d663a04-97c4-4b42-958a-1f33e49189ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.316812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.316786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.327996 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.327970    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6r7t\" (UniqueName: \"kubernetes.io/projected/5d663a04-97c4-4b42-958a-1f33e49189ad-kube-api-access-t6r7t\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.375243 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.375157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.484296 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.484254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.817748 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.817710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:55.820418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:55.820390    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d663a04-97c4-4b42-958a-1f33e49189ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wjs7t\" (UID: \"5d663a04-97c4-4b42-958a-1f33e49189ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:56.055246 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:56.055205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"
Jul 06 19:23:57.088686 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:57.088652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:23:57.301909 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:57.301702    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c43a2f7_68b8_4a81_90ad_742e7bf5c4f0.slice/crio-7efa153ef4d9cda53cefbd7959c7e659224c15e92e13719d1983e24e5d9236a2 WatchSource:0}: Error finding container 7efa153ef4d9cda53cefbd7959c7e659224c15e92e13719d1983e24e5d9236a2: Status 404 returned error can't find the container with id 7efa153ef4d9cda53cefbd7959c7e659224c15e92e13719d1983e24e5d9236a2
Jul 06 19:23:57.489956 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:57.488482    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t"]
Jul 06 19:23:57.494195 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:23:57.494160    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d663a04_97c4_4b42_958a_1f33e49189ad.slice/crio-d64a697953932213f905e6076b54bf8227071ca20336f319139a108400f3e35b WatchSource:0}: Error finding container d64a697953932213f905e6076b54bf8227071ca20336f319139a108400f3e35b: Status 404 returned error can't find the container with id d64a697953932213f905e6076b54bf8227071ca20336f319139a108400f3e35b
Jul 06 19:23:57.854842 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:57.854800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:57.964107 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:57.964055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:58.064906 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.064879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxjq6"
Jul 06 19:23:58.151649 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.151601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgc4k" event={"ID":"dea2c908-2790-4a43-9de3-ec8a261dd2b9","Type":"ContainerStarted","Data":"1a731f57febcf1ac49d4c69a8f3c11579c679dbb1fbbc073c3852a606def8237"}
Jul 06 19:23:58.152169 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.151683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgc4k" event={"ID":"dea2c908-2790-4a43-9de3-ec8a261dd2b9","Type":"ContainerStarted","Data":"5bd7f89818232b82f699390617add331c3933de28970a632cbea7f550cea1062"}
Jul 06 19:23:58.152169 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.151749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:23:58.153588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.153553    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85846b4fc5-8fwx7" event={"ID":"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0","Type":"ContainerStarted","Data":"7efa153ef4d9cda53cefbd7959c7e659224c15e92e13719d1983e24e5d9236a2"}
Jul 06 19:23:58.155259 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.155221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jv62" event={"ID":"aa4b4631-720f-4357-b59e-f4dcb5cec061","Type":"ContainerStarted","Data":"5ac55217cbbce13c914a050cb9f58833feedbad8094de5b2a9fcd923df0113f9"}
Jul 06 19:23:58.156654 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.156614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t" event={"ID":"5d663a04-97c4-4b42-958a-1f33e49189ad","Type":"ContainerStarted","Data":"d64a697953932213f905e6076b54bf8227071ca20336f319139a108400f3e35b"}
Jul 06 19:23:58.158423 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.158392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gtxd" event={"ID":"79c01869-c6ef-405e-9647-a7359ef79882","Type":"ContainerStarted","Data":"e8813f6eb5b44d66050c9cf4f2a4ec4ef6ddf5fb6d89a6632bf8d721dead5173"}
Jul 06 19:23:58.181020 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.180961    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kgc4k" podStartSLOduration=2.513779552 podStartE2EDuration="7.180939675s" totalImagesPullingTime="4.667160123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:58.180816308 +0000 UTC m=+60.818315050" watchObservedRunningTime="2026-07-06 19:23:58.180939675 +0000 UTC m=+60.818438409"
Jul 06 19:23:58.211476 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.211411    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gtxd" podStartSLOduration=2.184323717 podStartE2EDuration="7.211389811s" totalImagesPullingTime="5.027066094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:58.210221522 +0000 UTC m=+60.847720250" watchObservedRunningTime="2026-07-06 19:23:58.211389811 +0000 UTC m=+60.848888541"
Jul 06 19:23:58.273464 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.273419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:58.373480 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.373427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:58.595513 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.595455    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:58.706033 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:58.705985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:59.164347 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:59.164313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jv62" event={"ID":"aa4b4631-720f-4357-b59e-f4dcb5cec061","Type":"ContainerStarted","Data":"921d73c92ace85e42eb30dd197c740bf59c1ec4405ce1c91efcc4fb5862bd9bd"}
Jul 06 19:23:59.627246 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:23:59.627211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:00.170694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:00.170598    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t" event={"ID":"5d663a04-97c4-4b42-958a-1f33e49189ad","Type":"ContainerStarted","Data":"1b34b70e5e5ba1deeb51844984e82df50fadee5ceb9b8849b2ba1749ee879333"}
Jul 06 19:24:00.170694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:00.170679    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t" event={"ID":"5d663a04-97c4-4b42-958a-1f33e49189ad","Type":"ContainerStarted","Data":"4fd5ddddb912da0aad6e042cfc2e7627c48d8e2241a7dc8d7b986b365920f11a"}
Jul 06 19:24:00.196441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:00.196378    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wjs7t" podStartSLOduration=3.447877801 podStartE2EDuration="5.196357736s" totalImagesPullingTime="1.748479935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:00.195988984 +0000 UTC m=+62.833487715" watchObservedRunningTime="2026-07-06 19:24:00.196357736 +0000 UTC m=+62.833856461"
Jul 06 19:24:01.205828 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:01.205796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:01.340964 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:01.340924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.180535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.180498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jv62" event={"ID":"aa4b4631-720f-4357-b59e-f4dcb5cec061","Type":"ContainerStarted","Data":"8cc47dd1a6a93f71336eaf6932f846d496215c2c363a3d3b47f8fef9167239bc"}
Jul 06 19:24:02.181894 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.181866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85846b4fc5-8fwx7" event={"ID":"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0","Type":"ContainerStarted","Data":"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"}
Jul 06 19:24:02.224930 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.224882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2jv62" podStartSLOduration=1.903746685 podStartE2EDuration="11.224867274s" totalImagesPullingTime="9.321120589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:02.223370332 +0000 UTC m=+64.860869072" watchObservedRunningTime="2026-07-06 19:24:02.224867274 +0000 UTC m=+64.862366001"
Jul 06 19:24:02.255637 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.255580    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85846b4fc5-8fwx7" podStartSLOduration=4.710248625 podStartE2EDuration="9.255562892s" totalImagesPullingTime="4.545314267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:02.254392294 +0000 UTC m=+64.891891022" watchObservedRunningTime="2026-07-06 19:24:02.255562892 +0000 UTC m=+64.893061614"
Jul 06 19:24:02.281234 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.281191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.527308 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.527204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.620988 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.620954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8lmt5"]
Jul 06 19:24:02.623167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.623148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.632891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.632855    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"]
Jul 06 19:24:02.635317 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.635286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:24:02.635700 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.635672    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4jjw4\""
Jul 06 19:24:02.635789 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.635739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:24:02.635789 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.635672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:24:02.636443 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.636424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.640396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.640379    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:24:02.640953 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.640937    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:24:02.641802 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.641787    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r4crw\""
Jul 06 19:24:02.641887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.641871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:24:02.660263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.660239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"]
Jul 06 19:24:02.679111 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-metrics-client-ca\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fmq\" (UniqueName: \"kubernetes.io/projected/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-kube-api-access-54fmq\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-tls\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-sys\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679453 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-wtmp\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679453 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679453 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-textfile\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.679542 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.679479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-root\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.691057 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.691023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.780311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-metrics-client-ca\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fmq\" (UniqueName: \"kubernetes.io/projected/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-kube-api-access-54fmq\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-tls\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-sys\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-wtmp\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780468    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-sys\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-textfile\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.780580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-root\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780643    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-wtmp\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcnzm\" (UniqueName: \"kubernetes.io/projected/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-api-access-pcnzm\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28a862a1-6e75-464d-b0ce-ce9d194e634d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780740    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-root\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780910    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-metrics-client-ca\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.780961    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-textfile\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.781082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.781040    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.782611 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.782592    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-tls\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.782806 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.782785    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.790509 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.790485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fmq\" (UniqueName: \"kubernetes.io/projected/8ddde874-6b06-4a9a-9ad8-a050a0286cb7-kube-api-access-54fmq\") pod \"node-exporter-8lmt5\" (UID: \"8ddde874-6b06-4a9a-9ad8-a050a0286cb7\") " pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.794039 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.794010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.882063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnzm\" (UniqueName: \"kubernetes.io/projected/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-api-access-pcnzm\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28a862a1-6e75-464d-b0ce-ce9d194e634d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28a862a1-6e75-464d-b0ce-ce9d194e634d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.882994 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882962    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.883083 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.882966    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.884523 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.884502    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.884884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.884860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.911980 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.911951    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcnzm\" (UniqueName: \"kubernetes.io/projected/28a862a1-6e75-464d-b0ce-ce9d194e634d-kube-api-access-pcnzm\") pod \"kube-state-metrics-7c9dbb8b7d-zk8j6\" (UID: \"28a862a1-6e75-464d-b0ce-ce9d194e634d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:02.931862 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.931833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lmt5"
Jul 06 19:24:02.939138 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.939076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.944002 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:02.943975    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddde874_6b06_4a9a_9ad8_a050a0286cb7.slice/crio-dfadac196bfdb418d8de0497f6907d1dfde2f4e84b578a64b2396d5b714ff3a8 WatchSource:0}: Error finding container dfadac196bfdb418d8de0497f6907d1dfde2f4e84b578a64b2396d5b714ff3a8: Status 404 returned error can't find the container with id dfadac196bfdb418d8de0497f6907d1dfde2f4e84b578a64b2396d5b714ff3a8
Jul 06 19:24:02.944529 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:02.944513    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"
Jul 06 19:24:03.076401 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.076312    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6"]
Jul 06 19:24:03.079308 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.079283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.079502 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:03.079482    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a862a1_6e75_464d_b0ce_ce9d194e634d.slice/crio-2ff9138d677ba5e3c2bf24923bd139ffad69863efa701b7b7944bb39c4045d03 WatchSource:0}: Error finding container 2ff9138d677ba5e3c2bf24923bd139ffad69863efa701b7b7944bb39c4045d03: Status 404 returned error can't find the container with id 2ff9138d677ba5e3c2bf24923bd139ffad69863efa701b7b7944bb39c4045d03
Jul 06 19:24:03.186920 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.186886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lmt5" event={"ID":"8ddde874-6b06-4a9a-9ad8-a050a0286cb7","Type":"ContainerStarted","Data":"dfadac196bfdb418d8de0497f6907d1dfde2f4e84b578a64b2396d5b714ff3a8"}
Jul 06 19:24:03.187991 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.187969    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6" event={"ID":"28a862a1-6e75-464d-b0ce-ce9d194e634d","Type":"ContainerStarted","Data":"2ff9138d677ba5e3c2bf24923bd139ffad69863efa701b7b7944bb39c4045d03"}
Jul 06 19:24:03.228109 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.228078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.484821 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.484789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.588063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.588009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:24:03.588264 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.588075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:24:03.590987 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.590964    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:24:03.591089 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.591032    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:24:03.600924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.600900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b15dc67-1605-44f7-9874-ff7b6cbb406d-metrics-certs\") pod \"network-metrics-daemon-vc9xk\" (UID: \"7b15dc67-1605-44f7-9874-ff7b6cbb406d\") " pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:24:03.600924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.600927    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d72de2bc-6164-472c-bd1c-f2811047f5c6-original-pull-secret\") pod \"global-pull-secret-syncer-2gj7k\" (UID: \"d72de2bc-6164-472c-bd1c-f2811047f5c6\") " pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:24:03.603790 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.603762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.625918 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.625887    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gj7k"
Jul 06 19:24:03.633779 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.633756    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d9llp\""
Jul 06 19:24:03.640452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.640430    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vc9xk"
Jul 06 19:24:03.689407 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.689375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:24:03.693538 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.693313    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:24:03.705171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.704947    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:24:03.715732 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.715702    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcvf\" (UniqueName: \"kubernetes.io/projected/edf961ad-2b9e-467b-be67-963763d73133-kube-api-access-txcvf\") pod \"network-check-target-dl8l5\" (UID: \"edf961ad-2b9e-467b-be67-963763d73133\") " pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:24:03.762563 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.761668    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:24:03.769337 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.766844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.772050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.772024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 19:24:03.772277 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.772259    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 19:24:03.772704 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.772670    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 19:24:03.772794 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.772729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 19:24:03.775108 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.775087    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4xqf8\""
Jul 06 19:24:03.775336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.775318    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 19:24:03.775420 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.775317    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 19:24:03.775869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.775850    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 19:24:03.776134 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.776118    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 19:24:03.776396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.776376    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 19:24:03.796670 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.796461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:24:03.821636 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.821586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.836376 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.836342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vc9xk"]
Jul 06 19:24:03.837422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.837280    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gj7k"]
Jul 06 19:24:03.842026 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:03.840015    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72de2bc_6164_472c_bd1c_f2811047f5c6.slice/crio-5762f482c32f09be188c1f67f01d84744a008178289efe10bdb90d674b728f5e WatchSource:0}: Error finding container 5762f482c32f09be188c1f67f01d84744a008178289efe10bdb90d674b728f5e: Status 404 returned error can't find the container with id 5762f482c32f09be188c1f67f01d84744a008178289efe10bdb90d674b728f5e
Jul 06 19:24:03.846409 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:03.846374    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b15dc67_1605_44f7_9874_ff7b6cbb406d.slice/crio-d570266e8d0cd118e693041a8cce250e54e355408fbf62e49abac34ff696ab6c WatchSource:0}: Error finding container d570266e8d0cd118e693041a8cce250e54e355408fbf62e49abac34ff696ab6c: Status 404 returned error can't find the container with id d570266e8d0cd118e693041a8cce250e54e355408fbf62e49abac34ff696ab6c
Jul 06 19:24:03.891920 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.891889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.891933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.891962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892204 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892204 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892312 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892312 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892407 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892455 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892455 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.892668 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.892550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.927647 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.927005    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tr4sh\""
Jul 06 19:24:03.935409 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.934367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:24:03.955167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.955134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.994154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.993994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.995379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.994579    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.995379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.995268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.995379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.995310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.995379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.995338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.997286 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.997191    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:03.999984 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:03.999904    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.000608 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.000563    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.003197 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.003171    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.004334 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.004307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.004905 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.004850    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.004905 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.004852    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.005024 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.005007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.006164 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.006104    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.007811 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.007760    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.009970 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.009667    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.009970 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.009928    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.082367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.082193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:24:04.105317 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.105288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dl8l5"]
Jul 06 19:24:04.134100 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.134071    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:24:04.134307 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.134132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:24:04.135887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.135851    2559 patch_prober.go:28] interesting pod/console-85846b4fc5-8fwx7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 06 19:24:04.136009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.135928    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85846b4fc5-8fwx7" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 06 19:24:04.194973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.194931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vc9xk" event={"ID":"7b15dc67-1605-44f7-9874-ff7b6cbb406d","Type":"ContainerStarted","Data":"d570266e8d0cd118e693041a8cce250e54e355408fbf62e49abac34ff696ab6c"}
Jul 06 19:24:04.196311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.196282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gj7k" event={"ID":"d72de2bc-6164-472c-bd1c-f2811047f5c6","Type":"ContainerStarted","Data":"5762f482c32f09be188c1f67f01d84744a008178289efe10bdb90d674b728f5e"}
Jul 06 19:24:04.251182 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.251155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:24:04.314176 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:04.314143    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721008ab_83e9_4522_8a6b_60e2bd8f54dd.slice/crio-40a71b33a5e4776c555ef5baecacad535a345b5b122ab768ba73bfd96aa60f21 WatchSource:0}: Error finding container 40a71b33a5e4776c555ef5baecacad535a345b5b122ab768ba73bfd96aa60f21: Status 404 returned error can't find the container with id 40a71b33a5e4776c555ef5baecacad535a345b5b122ab768ba73bfd96aa60f21
Jul 06 19:24:04.315432 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:04.315405    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf961ad_2b9e_467b_be67_963763d73133.slice/crio-8f974bfece47d181494c69b695676d131c8c09ab626b69c49232d764aa493a3f WatchSource:0}: Error finding container 8f974bfece47d181494c69b695676d131c8c09ab626b69c49232d764aa493a3f: Status 404 returned error can't find the container with id 8f974bfece47d181494c69b695676d131c8c09ab626b69c49232d764aa493a3f
Jul 06 19:24:04.636779 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.636670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:04.782804 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:04.782753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:05.201617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:05.201506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"40a71b33a5e4776c555ef5baecacad535a345b5b122ab768ba73bfd96aa60f21"}
Jul 06 19:24:05.203293 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:05.203130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dl8l5" event={"ID":"edf961ad-2b9e-467b-be67-963763d73133","Type":"ContainerStarted","Data":"8f974bfece47d181494c69b695676d131c8c09ab626b69c49232d764aa493a3f"}
Jul 06 19:24:05.706582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:05.706535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:05.833197 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:05.833161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:06.070559 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.070504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:06.210438 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.209798    2559 generic.go:356] "Generic (PLEG): container finished" podID="8ddde874-6b06-4a9a-9ad8-a050a0286cb7" containerID="94b84f0d9c16a403c742734fc044cd4d6d630a470e3664790ebf50300a334af0" exitCode=0
Jul 06 19:24:06.210438 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.209928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lmt5" event={"ID":"8ddde874-6b06-4a9a-9ad8-a050a0286cb7","Type":"ContainerDied","Data":"94b84f0d9c16a403c742734fc044cd4d6d630a470e3664790ebf50300a334af0"}
Jul 06 19:24:06.217790 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.217681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6" event={"ID":"28a862a1-6e75-464d-b0ce-ce9d194e634d","Type":"ContainerStarted","Data":"d1c0cc04043ef4955b42ca363c3b84e7590d41f1e3894c137704c2a563d7ac0e"}
Jul 06 19:24:06.217790 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.217745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6" event={"ID":"28a862a1-6e75-464d-b0ce-ce9d194e634d","Type":"ContainerStarted","Data":"5c59771e4f41ec79f588d7f1b7eb7e9ad4a3f8c5d0da671eec976d1f5258131f"}
Jul 06 19:24:06.248532 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.248486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:06.372737 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.372703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:06.677467 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.677427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:06.927892 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:06.927802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:07.224153 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.224061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lmt5" event={"ID":"8ddde874-6b06-4a9a-9ad8-a050a0286cb7","Type":"ContainerStarted","Data":"0eecc0af7070b6137d484b28d202c611e62a1b819a3a6f0b6b3154eb0ec14ecf"}
Jul 06 19:24:07.224328 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.224173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lmt5" event={"ID":"8ddde874-6b06-4a9a-9ad8-a050a0286cb7","Type":"ContainerStarted","Data":"25b0c5cb00cefbe2c7e08cfa95c1046c9fafa2f72069f7c355d7dcfae283b3cb"}
Jul 06 19:24:07.226452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.226424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6" event={"ID":"28a862a1-6e75-464d-b0ce-ce9d194e634d","Type":"ContainerStarted","Data":"28015b9fa29df23c7217d23f9538ea3e4f51337867c7bffc098e9040f7357bdc"}
Jul 06 19:24:07.228144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.228121    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0" exitCode=0
Jul 06 19:24:07.228250 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.228208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"}
Jul 06 19:24:07.230400 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.230379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vc9xk" event={"ID":"7b15dc67-1605-44f7-9874-ff7b6cbb406d","Type":"ContainerStarted","Data":"c76a88df7be524ee62e3384d398cef45a5fe85ecb5d0e79116f00d6a7ac17088"}
Jul 06 19:24:07.230480 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.230423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vc9xk" event={"ID":"7b15dc67-1605-44f7-9874-ff7b6cbb406d","Type":"ContainerStarted","Data":"3b67e70d39d723e4a93f4d237fe1564b7b0af6d30f1791e713f2cee19028658b"}
Jul 06 19:24:07.310262 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.310200    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8lmt5" podStartSLOduration=2.794826921 podStartE2EDuration="5.310182622s" totalImagesPullingTime="2.391418225s" totalInitContainerRuntime="123.937476ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:07.296366996 +0000 UTC m=+69.933865727" watchObservedRunningTime="2026-07-06 19:24:07.310182622 +0000 UTC m=+69.947681349"
Jul 06 19:24:07.359232 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.359175    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zk8j6" podStartSLOduration=3.103572753 podStartE2EDuration="5.359152514s" totalImagesPullingTime="2.255579761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:07.356777019 +0000 UTC m=+69.994275747" watchObservedRunningTime="2026-07-06 19:24:07.359152514 +0000 UTC m=+69.996651241"
Jul 06 19:24:07.433188 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.433155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:07.448648 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.448571    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vc9xk" podStartSLOduration=67.214485819 podStartE2EDuration="1m9.448555217s" totalImagesPullingTime="2.234069398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:07.446937557 +0000 UTC m=+70.084436286" watchObservedRunningTime="2026-07-06 19:24:07.448555217 +0000 UTC m=+70.086053948"
Jul 06 19:24:07.464173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.464126    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:24:07.507667 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.507578    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"]
Jul 06 19:24:07.510027 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.510003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.515571 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.515495    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:24:07.515702 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.515599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-44d44\""
Jul 06 19:24:07.538113 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.538052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"]
Jul 06 19:24:07.567661 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.567613    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:24:07.570143 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.570120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.584674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.584651    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:24:07.599243 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.599200    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:24:07.629315 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.629286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edb17436-fe86-48b0-b388-1dff0a7973ea-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.629491 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.629358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpm2\" (UniqueName: \"kubernetes.io/projected/edb17436-fe86-48b0-b388-1dff0a7973ea-kube-api-access-njpm2\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.635786 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.635741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:07.720840 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.720798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:07.730806 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.730935 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.730935 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.730935 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njpm2\" (UniqueName: \"kubernetes.io/projected/edb17436-fe86-48b0-b388-1dff0a7973ea-kube-api-access-njpm2\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.730935 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.731071 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.731071 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.730966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgww\" (UniqueName: \"kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.731071 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.731001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.731071 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.731026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edb17436-fe86-48b0-b388-1dff0a7973ea-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.733968 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.733943    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edb17436-fe86-48b0-b388-1dff0a7973ea-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.744884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.744835    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njpm2\" (UniqueName: \"kubernetes.io/projected/edb17436-fe86-48b0-b388-1dff0a7973ea-kube-api-access-njpm2\") pod \"monitoring-plugin-d5dcff7cf-dkf6m\" (UID: \"edb17436-fe86-48b0-b388-1dff0a7973ea\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.819840 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.819757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:07.831926 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.831898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.832064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.831955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.832064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.831983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.832064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.832023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.832064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.832043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.832064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.832062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgww\" (UniqueName: \"kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.833535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.832121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.833535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.833233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.833535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.833231    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.833535 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.833461    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.833805 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.833769    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.835562 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.835522    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.837520 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.836343    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.842836 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.842812    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgww\" (UniqueName: \"kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww\") pod \"console-858956bd9f-jxcbh\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") " pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:07.882167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:07.882135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:08.167168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:08.167139    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kgc4k"
Jul 06 19:24:08.974824 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:08.974771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:09.044414 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.043235    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:24:09.046700 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.046672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.050453 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050156    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 19:24:09.050601 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050456    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 19:24:09.050601 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2x8xh\""
Jul 06 19:24:09.050765 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 19:24:09.050820 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050777    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e075tqhea77c2\""
Jul 06 19:24:09.050820 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050794    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 19:24:09.050820 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.050802    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.051452    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.051444    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.051747    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.051783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.051934    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.052018    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.052139    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 19:24:09.052329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.052310    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 19:24:09.052770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.052353    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 19:24:09.053485 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.053465    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 19:24:09.066907 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.066881    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:24:09.072555 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.072516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:09.146110 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4c8\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.146770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.147059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.147059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.146821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.247925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.247974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4c8\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.248747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.249429 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248886    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.249429 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.248940    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.249429 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.249308    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.252869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.249893    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.252869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.251173    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.252869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.252734    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.253340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.253178    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.253791 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.253766    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.253884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.253793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.254099 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.254079    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.254876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.254826    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.255436 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.255163    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.255436 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.255392    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.256174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.255651    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.256174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.255889    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.256174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.255924    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.256174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.256076    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.256441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.256227    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.258001 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.257973    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.258946 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.258902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4c8\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8\") pod \"prometheus-k8s-0\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:09.360416 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:09.360380    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:10.096389 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.096359    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"]
Jul 06 19:24:10.100737 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:10.100700    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb17436_fe86_48b0_b388_1dff0a7973ea.slice/crio-f4d37ef56d68e2678353e07c5737a54fcff1f0a3323d5e753e4bd17d09c9463a WatchSource:0}: Error finding container f4d37ef56d68e2678353e07c5737a54fcff1f0a3323d5e753e4bd17d09c9463a: Status 404 returned error can't find the container with id f4d37ef56d68e2678353e07c5737a54fcff1f0a3323d5e753e4bd17d09c9463a
Jul 06 19:24:10.122749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.122716    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:24:10.127678 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:10.127611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b417da7_672e_4f61_92a7_4e08de95a696.slice/crio-34c5a7ab78cd6974f9c02fa71961c9661328a8676fabf40429757debbf0671e4 WatchSource:0}: Error finding container 34c5a7ab78cd6974f9c02fa71961c9661328a8676fabf40429757debbf0671e4: Status 404 returned error can't find the container with id 34c5a7ab78cd6974f9c02fa71961c9661328a8676fabf40429757debbf0671e4
Jul 06 19:24:10.254672 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.254538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"}
Jul 06 19:24:10.254672 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.254646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"}
Jul 06 19:24:10.255087 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.254692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"}
Jul 06 19:24:10.256887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.256787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858956bd9f-jxcbh" event={"ID":"2b417da7-672e-4f61-92a7-4e08de95a696","Type":"ContainerStarted","Data":"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"}
Jul 06 19:24:10.256887 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.256844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858956bd9f-jxcbh" event={"ID":"2b417da7-672e-4f61-92a7-4e08de95a696","Type":"ContainerStarted","Data":"34c5a7ab78cd6974f9c02fa71961c9661328a8676fabf40429757debbf0671e4"}
Jul 06 19:24:10.260162 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.259690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gj7k" event={"ID":"d72de2bc-6164-472c-bd1c-f2811047f5c6","Type":"ContainerStarted","Data":"b7b74a8f2f2fe2b584683e9eae767bd3124fb3f082d88b048394f6e46f6445e8"}
Jul 06 19:24:10.262030 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.262008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dl8l5" event={"ID":"edf961ad-2b9e-467b-be67-963763d73133","Type":"ContainerStarted","Data":"9c6521f2ad464a431c033c7378f394632dbc3aaf8ef953e7756ec15afb718879"}
Jul 06 19:24:10.262147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.262065    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:24:10.263351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.263324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m" event={"ID":"edb17436-fe86-48b0-b388-1dff0a7973ea","Type":"ContainerStarted","Data":"f4d37ef56d68e2678353e07c5737a54fcff1f0a3323d5e753e4bd17d09c9463a"}
Jul 06 19:24:10.283824 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.283714    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858956bd9f-jxcbh" podStartSLOduration=3.28369353 podStartE2EDuration="3.28369353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:10.282097982 +0000 UTC m=+72.919596712" watchObservedRunningTime="2026-07-06 19:24:10.28369353 +0000 UTC m=+72.921192256"
Jul 06 19:24:10.314501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.314445    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dl8l5" podStartSLOduration=66.684475471 podStartE2EDuration="1m12.314421816s" totalImagesPullingTime="5.629946345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:10.31293441 +0000 UTC m=+72.950433138" watchObservedRunningTime="2026-07-06 19:24:10.314421816 +0000 UTC m=+72.951920543"
Jul 06 19:24:10.341318 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.341272    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2gj7k" podStartSLOduration=66.263840839 podStartE2EDuration="1m12.341253928s" totalImagesPullingTime="6.077413089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:10.338649942 +0000 UTC m=+72.976148668" watchObservedRunningTime="2026-07-06 19:24:10.341253928 +0000 UTC m=+72.978752656"
Jul 06 19:24:10.343677 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:10.343652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:24:10.347083 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:24:10.347046    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06f367d_10db_44d5_b1f7_6cae046c57e2.slice/crio-e97eb7f7b79e7ab792c3f009c6f8b11d67fef1a4b13811ad9b1c25244e9a7bef WatchSource:0}: Error finding container e97eb7f7b79e7ab792c3f009c6f8b11d67fef1a4b13811ad9b1c25244e9a7bef: Status 404 returned error can't find the container with id e97eb7f7b79e7ab792c3f009c6f8b11d67fef1a4b13811ad9b1c25244e9a7bef
Jul 06 19:24:11.272273 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.272134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"}
Jul 06 19:24:11.272273 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.272219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"}
Jul 06 19:24:11.276037 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.275543    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43" exitCode=0
Jul 06 19:24:11.276186 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.276070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"}
Jul 06 19:24:11.276186 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.276153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"e97eb7f7b79e7ab792c3f009c6f8b11d67fef1a4b13811ad9b1c25244e9a7bef"}
Jul 06 19:24:11.674196 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.674160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:11.786439 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:11.786388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:12.007296 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.007000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:12.084176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.084139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:12.283604 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.283511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerStarted","Data":"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"}
Jul 06 19:24:12.285366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.285284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m" event={"ID":"edb17436-fe86-48b0-b388-1dff0a7973ea","Type":"ContainerStarted","Data":"214af90a837cabdd1a49ca9c401ee8ea2c061645ccc0a8a0506f878e67df0c9b"}
Jul 06 19:24:12.285556 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.285535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:12.292002 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.291976    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m"
Jul 06 19:24:12.318515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.318451    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.548056649 podStartE2EDuration="9.318429176s" totalImagesPullingTime="5.749126566s" totalInitContainerRuntime="21.245961ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:12.317737269 +0000 UTC m=+74.955235999" watchObservedRunningTime="2026-07-06 19:24:12.318429176 +0000 UTC m=+74.955927905"
Jul 06 19:24:12.340193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:12.340056    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dkf6m" podStartSLOduration=3.329638992 podStartE2EDuration="5.340034328s" totalImagesPullingTime="2.010395336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:12.337494709 +0000 UTC m=+74.974993438" watchObservedRunningTime="2026-07-06 19:24:12.340034328 +0000 UTC m=+74.977533059"
Jul 06 19:24:13.851283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:13.851248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:13.937537 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:13.937491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:15.299425 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:15.299347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"}
Jul 06 19:24:15.299425 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:15.299409    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"}
Jul 06 19:24:16.279662 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:16.279604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:16.380509 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:16.380472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:17.311111 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.311076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"}
Jul 06 19:24:17.311281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.311167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"}
Jul 06 19:24:17.311281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.311196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"}
Jul 06 19:24:17.311281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.311219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerStarted","Data":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"}
Jul 06 19:24:17.883180 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.883134    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:17.883698 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.883213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:17.887753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.887735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:17.909131 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:17.909084    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.3146361730000002 podStartE2EDuration="8.909067953s" totalImagesPullingTime="5.574432821s" totalInitContainerRuntime="19.998959ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:24:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:17.363487642 +0000 UTC m=+80.000986381" watchObservedRunningTime="2026-07-06 19:24:17.909067953 +0000 UTC m=+80.546566692"
Jul 06 19:24:18.319079 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:18.318999    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:24:18.594539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:18.594457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:18.695577 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:18.695541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:18.759501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:18.759468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:19.361315 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:19.361198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:24:20.559193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:20.559157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:21.389777 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:21.389744    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:21.508672 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:21.508619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:25.279774 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:25.279730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:25.447214 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:25.447180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:30.460176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:30.460138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:30.564433 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:30.564398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:32.487905 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:32.487868    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85846b4fc5-8fwx7" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerName="console" containerID="cri-o://88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891" gracePeriod=15
Jul 06 19:24:33.264012 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.263979    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:24:33.367387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367356    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367446    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592zp\" (UniqueName: \"kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367489    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367515    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config\") pod \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\" (UID: \"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0\") "
Jul 06 19:24:33.367972 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367943    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:24:33.368100 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.367963    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:24:33.368100 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.368030    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config" (OuterVolumeSpecName: "console-config") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:24:33.370132 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.370068    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp" (OuterVolumeSpecName: "kube-api-access-592zp") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "kube-api-access-592zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:24:33.370132 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.370087    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:24:33.370316 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.370130    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" (UID: "4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:24:33.372073 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.372049    2559 generic.go:356] "Generic (PLEG): container finished" podID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerID="88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891" exitCode=0
Jul 06 19:24:33.372176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.372095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85846b4fc5-8fwx7"
Jul 06 19:24:33.372176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.372135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85846b4fc5-8fwx7" event={"ID":"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0","Type":"ContainerDied","Data":"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"}
Jul 06 19:24:33.372289 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.372222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85846b4fc5-8fwx7" event={"ID":"4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0","Type":"ContainerDied","Data":"7efa153ef4d9cda53cefbd7959c7e659224c15e92e13719d1983e24e5d9236a2"}
Jul 06 19:24:33.372289 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.372253    2559 scope.go:117] "RemoveContainer" containerID="88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"
Jul 06 19:24:33.384726 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.384619    2559 scope.go:117] "RemoveContainer" containerID="88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"
Jul 06 19:24:33.384993 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:24:33.384974    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891\": container with ID starting with 88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891 not found: ID does not exist" containerID="88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"
Jul 06 19:24:33.385063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.385000    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891"} err="failed to get container status \"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891\": rpc error: code = NotFound desc = could not find container \"88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891\": container with ID starting with 88988edc33dd218b60316001acf82b2c1962b043d6e4ca2837c2ff6de85ba891 not found: ID does not exist"
Jul 06 19:24:33.395662 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.395618    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:24:33.400911 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.400880    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85846b4fc5-8fwx7"]
Jul 06 19:24:33.468850 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468819    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-oauth-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.468850 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468849    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592zp\" (UniqueName: \"kubernetes.io/projected/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-kube-api-access-592zp\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.469048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468863    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.469048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468876    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.469048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468888    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-console-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.469048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.468898    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0-oauth-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:24:33.913796 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:33.913764    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" path="/var/lib/kubelet/pods/4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0/volumes"
Jul 06 19:24:39.155619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:39.155581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:39.218666 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:39.218622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:40.244550 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:40.244511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:40.314843 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:40.314806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:41.279750 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:41.279721    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dl8l5"
Jul 06 19:24:54.261422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:54.261384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:54.386621 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:54.386589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:55.258393 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:55.258345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:55.367353 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:24:55.367319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:09.360876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:09.360834    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:09.380239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:09.380207    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:09.522492 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:09.522466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:22.095189 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:22.095153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:23.162810 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.162772    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:23.163279 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163157    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="alertmanager" containerID="cri-o://4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa" gracePeriod=120
Jul 06 19:25:23.163279 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163196    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-metric" containerID="cri-o://5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b" gracePeriod=120
Jul 06 19:25:23.163279 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163228    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="prom-label-proxy" containerID="cri-o://1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3" gracePeriod=120
Jul 06 19:25:23.163442 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163256    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-web" containerID="cri-o://dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538" gracePeriod=120
Jul 06 19:25:23.163442 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163270    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="config-reloader" containerID="cri-o://1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394" gracePeriod=120
Jul 06 19:25:23.163442 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.163292    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy" containerID="cri-o://03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536" gracePeriod=120
Jul 06 19:25:23.460205 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.460112    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:23.561582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561552    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3" exitCode=0
Jul 06 19:25:23.561582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561577    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536" exitCode=0
Jul 06 19:25:23.561582 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561586    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394" exitCode=0
Jul 06 19:25:23.561839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561594    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa" exitCode=0
Jul 06 19:25:23.561839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"}
Jul 06 19:25:23.561839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"}
Jul 06 19:25:23.561839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"}
Jul 06 19:25:23.561839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:23.561756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"}
Jul 06 19:25:24.410884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.410861    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.487251 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487251 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487211    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487251 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487335    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487389    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487576    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487569    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:24.487812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.487812 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487650    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\" (UID: \"721008ab-83e9-4522-8a6b-60e2bd8f54dd\") "
Jul 06 19:25:24.488058 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.487892    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.488058 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.488033    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:24.489320 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.489236    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:25:24.490958 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.490906    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out" (OuterVolumeSpecName: "config-out") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:25:24.490958 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.490908    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.491120 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.491072    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.491583 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.491554    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.492016 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.491923    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:25:24.492016 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.491980    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume" (OuterVolumeSpecName: "config-volume") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.492356 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.492324    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6" (OuterVolumeSpecName: "kube-api-access-kxnw6") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "kube-api-access-kxnw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:25:24.492518 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.492496    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.496095 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.496068    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.502821 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.502792    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config" (OuterVolumeSpecName: "web-config") pod "721008ab-83e9-4522-8a6b-60e2bd8f54dd" (UID: "721008ab-83e9-4522-8a6b-60e2bd8f54dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:24.568487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568451    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b" exitCode=0
Jul 06 19:25:24.568487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568475    2559 generic.go:356] "Generic (PLEG): container finished" podID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerID="dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538" exitCode=0
Jul 06 19:25:24.568699 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568529    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.568699 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"}
Jul 06 19:25:24.568699 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"}
Jul 06 19:25:24.568699 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721008ab-83e9-4522-8a6b-60e2bd8f54dd","Type":"ContainerDied","Data":"40a71b33a5e4776c555ef5baecacad535a345b5b122ab768ba73bfd96aa60f21"}
Jul 06 19:25:24.568820 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.568715    2559 scope.go:117] "RemoveContainer" containerID="1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"
Jul 06 19:25:24.576983 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.576968    2559 scope.go:117] "RemoveContainer" containerID="5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"
Jul 06 19:25:24.584695 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.584677    2559 scope.go:117] "RemoveContainer" containerID="03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"
Jul 06 19:25:24.588946 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.588925    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.588952    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-kube-api-access-kxnw6\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.588969    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.588981    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-alertmanager-main-db\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.588995    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589008    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-secret-alertmanager-main-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589021    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-cluster-tls-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589033    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-web-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589045    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-out\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589303 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589057    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721008ab-83e9-4522-8a6b-60e2bd8f54dd-config-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589303 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589069    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721008ab-83e9-4522-8a6b-60e2bd8f54dd-tls-assets\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.589303 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.589082    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721008ab-83e9-4522-8a6b-60e2bd8f54dd-metrics-client-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:24.591425 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.591411    2559 scope.go:117] "RemoveContainer" containerID="dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"
Jul 06 19:25:24.596507 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.596484    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:24.598771 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.598757    2559 scope.go:117] "RemoveContainer" containerID="1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"
Jul 06 19:25:24.604350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.604329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:24.606642 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.606612    2559 scope.go:117] "RemoveContainer" containerID="4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"
Jul 06 19:25:24.613459 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.613435    2559 scope.go:117] "RemoveContainer" containerID="77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"
Jul 06 19:25:24.620301 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.620285    2559 scope.go:117] "RemoveContainer" containerID="1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"
Jul 06 19:25:24.620553 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.620534    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3\": container with ID starting with 1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3 not found: ID does not exist" containerID="1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"
Jul 06 19:25:24.620602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.620563    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"} err="failed to get container status \"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3\": rpc error: code = NotFound desc = could not find container \"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3\": container with ID starting with 1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3 not found: ID does not exist"
Jul 06 19:25:24.620602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.620582    2559 scope.go:117] "RemoveContainer" containerID="5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"
Jul 06 19:25:24.620854 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.620822    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b\": container with ID starting with 5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b not found: ID does not exist" containerID="5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"
Jul 06 19:25:24.620854 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.620842    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"} err="failed to get container status \"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b\": rpc error: code = NotFound desc = could not find container \"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b\": container with ID starting with 5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b not found: ID does not exist"
Jul 06 19:25:24.620932 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.620858    2559 scope.go:117] "RemoveContainer" containerID="03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"
Jul 06 19:25:24.621104 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.621087    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536\": container with ID starting with 03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536 not found: ID does not exist" containerID="03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"
Jul 06 19:25:24.621146 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621112    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"} err="failed to get container status \"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536\": rpc error: code = NotFound desc = could not find container \"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536\": container with ID starting with 03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536 not found: ID does not exist"
Jul 06 19:25:24.621146 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621129    2559 scope.go:117] "RemoveContainer" containerID="dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"
Jul 06 19:25:24.621328 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.621313    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538\": container with ID starting with dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538 not found: ID does not exist" containerID="dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"
Jul 06 19:25:24.621369 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621331    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"} err="failed to get container status \"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538\": rpc error: code = NotFound desc = could not find container \"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538\": container with ID starting with dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538 not found: ID does not exist"
Jul 06 19:25:24.621369 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621343    2559 scope.go:117] "RemoveContainer" containerID="1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"
Jul 06 19:25:24.621542 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.621525    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394\": container with ID starting with 1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394 not found: ID does not exist" containerID="1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"
Jul 06 19:25:24.621635 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621551    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"} err="failed to get container status \"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394\": rpc error: code = NotFound desc = could not find container \"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394\": container with ID starting with 1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394 not found: ID does not exist"
Jul 06 19:25:24.621635 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621573    2559 scope.go:117] "RemoveContainer" containerID="4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"
Jul 06 19:25:24.621878 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.621859    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa\": container with ID starting with 4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa not found: ID does not exist" containerID="4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"
Jul 06 19:25:24.621926 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621880    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"} err="failed to get container status \"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa\": rpc error: code = NotFound desc = could not find container \"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa\": container with ID starting with 4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa not found: ID does not exist"
Jul 06 19:25:24.621926 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.621893    2559 scope.go:117] "RemoveContainer" containerID="77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"
Jul 06 19:25:24.622129 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:24.622115    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0\": container with ID starting with 77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0 not found: ID does not exist" containerID="77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"
Jul 06 19:25:24.622174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622132    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"} err="failed to get container status \"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0\": rpc error: code = NotFound desc = could not find container \"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0\": container with ID starting with 77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0 not found: ID does not exist"
Jul 06 19:25:24.622174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622146    2559 scope.go:117] "RemoveContainer" containerID="1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"
Jul 06 19:25:24.622354 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622339    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3"} err="failed to get container status \"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3\": rpc error: code = NotFound desc = could not find container \"1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3\": container with ID starting with 1695b57ebe21a1893ac2f30ab213cdca69fa084228458f69df595fcdaadbd5f3 not found: ID does not exist"
Jul 06 19:25:24.622394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622354    2559 scope.go:117] "RemoveContainer" containerID="5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"
Jul 06 19:25:24.622559 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622539    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b"} err="failed to get container status \"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b\": rpc error: code = NotFound desc = could not find container \"5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b\": container with ID starting with 5950dd396962bcd54fae619c6c1c015fbe59f45d5458303ded518e9f201a393b not found: ID does not exist"
Jul 06 19:25:24.622559 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622558    2559 scope.go:117] "RemoveContainer" containerID="03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"
Jul 06 19:25:24.622781 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622766    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536"} err="failed to get container status \"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536\": rpc error: code = NotFound desc = could not find container \"03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536\": container with ID starting with 03534021db59bd512dbb0161815e181d6cc0310f2275530fc81815a6abeea536 not found: ID does not exist"
Jul 06 19:25:24.622848 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622781    2559 scope.go:117] "RemoveContainer" containerID="dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"
Jul 06 19:25:24.623007 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.622988    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538"} err="failed to get container status \"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538\": rpc error: code = NotFound desc = could not find container \"dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538\": container with ID starting with dee3451d0ca56516a472987c7c08e1e5d9a6aaac7f730d0eb7f8bccf76639538 not found: ID does not exist"
Jul 06 19:25:24.623056 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623007    2559 scope.go:117] "RemoveContainer" containerID="1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"
Jul 06 19:25:24.623212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623196    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394"} err="failed to get container status \"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394\": rpc error: code = NotFound desc = could not find container \"1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394\": container with ID starting with 1a514e32b3ee0a314ec8cdbdf02f2491c7a598ff7e970ee09d7ffcb552a78394 not found: ID does not exist"
Jul 06 19:25:24.623257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623211    2559 scope.go:117] "RemoveContainer" containerID="4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"
Jul 06 19:25:24.623444 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623428    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa"} err="failed to get container status \"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa\": rpc error: code = NotFound desc = could not find container \"4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa\": container with ID starting with 4c4941bbdc671fd41393d480a599b78f99e9b5ffdb39018205d21703b11722aa not found: ID does not exist"
Jul 06 19:25:24.623483 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623443    2559 scope.go:117] "RemoveContainer" containerID="77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"
Jul 06 19:25:24.623617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.623598    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0"} err="failed to get container status \"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0\": rpc error: code = NotFound desc = could not find container \"77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0\": container with ID starting with 77098b2cf05e9aabadc3bb73575e8367891a2df535db0f985d66e41cd9fe91d0 not found: ID does not exist"
Jul 06 19:25:24.656257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:24.656500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656487    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerName="console"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656503    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerName="console"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656515    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656521    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656529    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-web"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656537    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-web"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656544    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="init-config-reloader"
Jul 06 19:25:24.656552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656549    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="init-config-reloader"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656557    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-metric"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656564    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-metric"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656577    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="alertmanager"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656582    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="alertmanager"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656588    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="config-reloader"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656593    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="config-reloader"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656599    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="prom-label-proxy"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656604    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="prom-label-proxy"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656657    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-metric"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656665    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="prom-label-proxy"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656671    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c43a2f7-68b8-4a81-90ad-742e7bf5c4f0" containerName="console"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656677    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy-web"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656683    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="kube-rbac-proxy"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656689    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="alertmanager"
Jul 06 19:25:24.656770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.656693    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" containerName="config-reloader"
Jul 06 19:25:24.663495 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.663470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.667096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.667076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 19:25:24.668236 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 19:25:24.668353 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668323    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 19:25:24.668427 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 19:25:24.668948 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668680    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 19:25:24.668948 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668710    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 19:25:24.668948 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.668760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4xqf8\""
Jul 06 19:25:24.670891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.669336    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 19:25:24.670891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.669526    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 19:25:24.674877 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.674858    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 19:25:24.689942 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.689921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxsl\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-kube-api-access-rwxsl\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.689950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.689971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690190 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690190 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-web-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690190 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690190 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690190 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-out\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.690352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.690270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.693749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.693702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:24.791340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxsl\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-kube-api-access-rwxsl\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-web-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-out\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.791725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.792116 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.791760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.792116 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.792083    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.792265 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.792243    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.792557 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.792532    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794557 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794529    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794709 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794564    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794709 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794619    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794771    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794948 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794930    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.794998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.794989    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-web-config\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.795263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.795248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-out\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.795370 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.795347    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.796116 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.796102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.803419 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.803398    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxsl\" (UniqueName: \"kubernetes.io/projected/1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5-kube-api-access-rwxsl\") pod \"alertmanager-main-0\" (UID: \"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:24.974544 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:24.974500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:25:25.138936 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:25.138903    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:25:25.139412 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:25:25.139384    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6e3527_ea36_4f26_a6ee_f5b5e50f14e5.slice/crio-f6951ee190ee7b7408934fb019ee53ce430b6421abdc9a8fcd8b7896cf60e69e WatchSource:0}: Error finding container f6951ee190ee7b7408934fb019ee53ce430b6421abdc9a8fcd8b7896cf60e69e: Status 404 returned error can't find the container with id f6951ee190ee7b7408934fb019ee53ce430b6421abdc9a8fcd8b7896cf60e69e
Jul 06 19:25:25.573413 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:25.573380    2559 generic.go:356] "Generic (PLEG): container finished" podID="1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5" containerID="b1831f0cb33c18403021ab3cdc8a26f935e38d30096093e17bece49c02302bbb" exitCode=0
Jul 06 19:25:25.573869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:25.573463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerDied","Data":"b1831f0cb33c18403021ab3cdc8a26f935e38d30096093e17bece49c02302bbb"}
Jul 06 19:25:25.573869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:25.573534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"f6951ee190ee7b7408934fb019ee53ce430b6421abdc9a8fcd8b7896cf60e69e"}
Jul 06 19:25:25.914019 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:25.913978    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="721008ab-83e9-4522-8a6b-60e2bd8f54dd" path="/var/lib/kubelet/pods/721008ab-83e9-4522-8a6b-60e2bd8f54dd/volumes"
Jul 06 19:25:26.581825 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.581786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"a2d038dcaf29111b45f8f48fadd3c3ecc0eb9a42b48242e56febde7474de9c2b"}
Jul 06 19:25:26.582217 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.581914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"6b905ef0af29b3f4ea4405abf053bce0b06b18a2bd171f389ac06ae57fee7ff4"}
Jul 06 19:25:26.582217 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.581953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"c9213edbc5c233b71b8fc622a0d7a1b23a5bf0969518c2ee0e548d8f8344250e"}
Jul 06 19:25:26.582217 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.582003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"ff12a381daf1920e835d04057942fef7559e2a2f926f1e4402fc3cdb98f32a60"}
Jul 06 19:25:26.582217 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.582040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"ab006980ec81804dce124e5d025156bb25e86dc9f763cfaed4eff4138d239db9"}
Jul 06 19:25:26.582217 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:26.582076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5","Type":"ContainerStarted","Data":"99b893fa766c2d4eb0282b0c826e5bc11c6e73a2a26a079bff5d549c199fecbf"}
Jul 06 19:25:27.556427 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.556365    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5392459670000003 podStartE2EDuration="3.556340981s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.095014ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:26.649111707 +0000 UTC m=+149.286610437" watchObservedRunningTime="2026-07-06 19:25:27.556340981 +0000 UTC m=+150.193839712"
Jul 06 19:25:27.557122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557102    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557452    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="prometheus" containerID="cri-o://2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40" gracePeriod=600
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557485    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy" containerID="cri-o://8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2" gracePeriod=600
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557502    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19" gracePeriod=600
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557523    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-web" containerID="cri-o://c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3" gracePeriod=600
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557496    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="thanos-sidecar" containerID="cri-o://930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa" gracePeriod=600
Jul 06 19:25:27.557619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.557502    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="config-reloader" containerID="cri-o://e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce" gracePeriod=600
Jul 06 19:25:27.811892 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.811830    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.915954    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916004    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916087    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916141    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916170    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916297    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916324    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp4c8\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916357    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916409    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.916472 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916452    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.917339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.917339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.916596    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.917339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917006    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.917339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917145    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.917339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.917743 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917678    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.917837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917741    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.917837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.917795    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2\") pod \"f06f367d-10db-44d5-b1f7-6cae046c57e2\" (UID: \"f06f367d-10db-44d5-b1f7-6cae046c57e2\") "
Jul 06 19:25:27.918279 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.918187    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.918345 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.918303    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.919467 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.918750    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920228    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920257    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920274    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-metrics-client-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920290    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920306    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.920422 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920321    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:27.921137 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.920769    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:25:27.921326 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.921247    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out" (OuterVolumeSpecName: "config-out") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:25:27.922053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.921674    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.921696    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8" (OuterVolumeSpecName: "kube-api-access-zp4c8") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "kube-api-access-zp4c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:25:27.922053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.921741    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.921877    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922402 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922087    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922402 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922275    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922646 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922593    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:25:27.922732 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922709    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config" (OuterVolumeSpecName: "config") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922732 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922719    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:25:27.922838 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922816    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.922955 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.922934    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:27.931130 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:27.931103    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config" (OuterVolumeSpecName: "web-config") pod "f06f367d-10db-44d5-b1f7-6cae046c57e2" (UID: "f06f367d-10db-44d5-b1f7-6cae046c57e2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:25:28.021332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021296    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-db\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021331    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-grpc-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021344    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp4c8\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-kube-api-access-zp4c8\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021356    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f06f367d-10db-44d5-b1f7-6cae046c57e2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021371    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021384    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021396    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-web-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021407    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-metrics-client-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021418    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-kube-rbac-proxy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021429    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021442    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f06f367d-10db-44d5-b1f7-6cae046c57e2-config-out\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021453    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f06f367d-10db-44d5-b1f7-6cae046c57e2-tls-assets\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021465    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.021539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.021476    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f06f367d-10db-44d5-b1f7-6cae046c57e2-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:25:28.597140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597110    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19" exitCode=0
Jul 06 19:25:28.597140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597133    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2" exitCode=0
Jul 06 19:25:28.597140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597140    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3" exitCode=0
Jul 06 19:25:28.597140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597146    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa" exitCode=0
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597151    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce" exitCode=0
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597159    2559 generic.go:356] "Generic (PLEG): container finished" podID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40" exitCode=0
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"}
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597218    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"}
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"}
Jul 06 19:25:28.597378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597356    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.597589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"}
Jul 06 19:25:28.597589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"}
Jul 06 19:25:28.597589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"}
Jul 06 19:25:28.597589 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.597506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f06f367d-10db-44d5-b1f7-6cae046c57e2","Type":"ContainerDied","Data":"e97eb7f7b79e7ab792c3f009c6f8b11d67fef1a4b13811ad9b1c25244e9a7bef"}
Jul 06 19:25:28.605292 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.605272    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.612152 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.612137    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.618375 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.618358    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.623304 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.623281    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:28.625174 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.625160    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.628459 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.628438    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:28.632206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.632186    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.638916 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.638902    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.645009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.644986    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.645288 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.645268    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.645352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645301    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.645352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645328    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.645575 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.645555    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.645620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645583    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.645620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645599    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.645882 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.645862    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.645956 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645888    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.645956 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.645907    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.646125 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.646109    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.646167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646131    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.646167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646145    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.646329 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.646313    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.646366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646334    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.646366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646348    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.646549 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.646533    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.646590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646552    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.646590 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646564    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.646791 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:25:28.646775    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.646847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646795    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.646847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.646808    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.647033 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647018    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.647068 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647033    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.647273 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647254    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.647318 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647275    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.647484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647463    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.647526 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647485    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.647749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647717    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.647749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647743    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.647966 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647949    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.647966 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.647966    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.648180 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648161    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.648180 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648177    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.648541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648471    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.648541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648487    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.648764 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648746    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.648764 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648764    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.648997 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648976    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.649045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.648998    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.649216 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649197    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.649258 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649217    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.649442 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649427    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.649485 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649442    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.649670 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649649    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.649751 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649670    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.649890 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649870    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.649943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.649891    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.650105 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650087    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.650167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650107    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.650318 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650299    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.650361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650320    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.650507 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650491    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.650574 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650509    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.650803 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650787    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.650803 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650802    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.650999 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.650981    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.651059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651000    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.651234 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651214    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.651276 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651235    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.651451 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651430    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.651492 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651452    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.651662 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651646    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.651710 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651661    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.651851 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651834    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.651895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.651851    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.652044 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652028    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.652085 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652044    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.652241 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652224    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.652278 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652241    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.652426 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652406    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.652469 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652426    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.652605 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652587    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.652659 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652605    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.652806 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652791    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.652844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652807    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.653012 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.652997    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.653049 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653012    2559 scope.go:117] "RemoveContainer" containerID="b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"
Jul 06 19:25:28.653229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653212    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19"} err="failed to get container status \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": rpc error: code = NotFound desc = could not find container \"b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19\": container with ID starting with b1d7d85cfdf04c2c35fb01f8dbc110cd586e8a49b4062cceae0d018fa90ced19 not found: ID does not exist"
Jul 06 19:25:28.653296 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653230    2559 scope.go:117] "RemoveContainer" containerID="8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"
Jul 06 19:25:28.653461 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653445    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2"} err="failed to get container status \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": rpc error: code = NotFound desc = could not find container \"8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2\": container with ID starting with 8fa8b60c97ad007c7088d865cacb109cbeeddade8b42d20907056edd222415e2 not found: ID does not exist"
Jul 06 19:25:28.653504 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653461    2559 scope.go:117] "RemoveContainer" containerID="c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"
Jul 06 19:25:28.653663 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653645    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3"} err="failed to get container status \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": rpc error: code = NotFound desc = could not find container \"c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3\": container with ID starting with c02a7cb13df3bebcbac069634aef8995ef4ffa105394af3af6e8950e2b7705e3 not found: ID does not exist"
Jul 06 19:25:28.653709 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653663    2559 scope.go:117] "RemoveContainer" containerID="930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"
Jul 06 19:25:28.653835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653819    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa"} err="failed to get container status \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": rpc error: code = NotFound desc = could not find container \"930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa\": container with ID starting with 930139032fd052676b71b19ac8f6bcfdfa0a526ac542ebf927cacdefb559d9fa not found: ID does not exist"
Jul 06 19:25:28.653879 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.653836    2559 scope.go:117] "RemoveContainer" containerID="e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"
Jul 06 19:25:28.654034 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.654019    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce"} err="failed to get container status \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": rpc error: code = NotFound desc = could not find container \"e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce\": container with ID starting with e3ec049c31aec5b6534473b4fb982530269a5926fa95343a61b11a3e21e183ce not found: ID does not exist"
Jul 06 19:25:28.654080 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.654034    2559 scope.go:117] "RemoveContainer" containerID="2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"
Jul 06 19:25:28.654238 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.654219    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40"} err="failed to get container status \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": rpc error: code = NotFound desc = could not find container \"2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40\": container with ID starting with 2a948c931ae22f3da252f1467abb2576a553327c9b6d1462439d7655e52dce40 not found: ID does not exist"
Jul 06 19:25:28.654280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.654239    2559 scope.go:117] "RemoveContainer" containerID="c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"
Jul 06 19:25:28.654415 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.654400    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43"} err="failed to get container status \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": rpc error: code = NotFound desc = could not find container \"c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43\": container with ID starting with c5d06aef0f9603b58ccfe7c7daf76da1cdb46d9de1c603e95378234f6d908f43 not found: ID does not exist"
Jul 06 19:25:28.660425 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660405    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:28.660708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660693    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-web"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660710    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-web"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660720    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="init-config-reloader"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660726    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="init-config-reloader"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660735    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="config-reloader"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660740    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="config-reloader"
Jul 06 19:25:28.660753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660751    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="prometheus"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660756    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="prometheus"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660764    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="thanos-sidecar"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660769    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="thanos-sidecar"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-thanos"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660781    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-thanos"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660787    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660792    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660833    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="config-reloader"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-web"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660846    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660854    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="kube-rbac-proxy-thanos"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660860    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="thanos-sidecar"
Jul 06 19:25:28.660924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.660866    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" containerName="prometheus"
Jul 06 19:25:28.664466 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.664451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.667011 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.666991    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 19:25:28.667011 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.666995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e075tqhea77c2\""
Jul 06 19:25:28.667165 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 19:25:28.667165 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667122    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 19:25:28.667165 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667141    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 19:25:28.667374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667360    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 19:25:28.667442 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2x8xh\""
Jul 06 19:25:28.667811 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667795    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:25:28.667895 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.667823    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 19:25:28.668056 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668040    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 19:25:28.668056 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668052    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 19:25:28.668173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668045    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 19:25:28.668173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668074    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 19:25:28.668518 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668500    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 19:25:28.668592 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.668518    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 19:25:28.670433 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.670415    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 19:25:28.674919 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.674900    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 19:25:28.683700 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.683675    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:28.727142 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-web-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727142 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-config-out\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727599 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbjsj\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-kube-api-access-zbjsj\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.727897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.727705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.828844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.828755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.828844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.828793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbjsj\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-kube-api-access-zbjsj\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.828844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.828817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.828844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.828838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-web-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-config-out\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829320    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.829473 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829679    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830173 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.829691    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.830521 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.830187    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.831156 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.831128    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.831931    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.831936    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832101    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832109    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-config-out\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832147    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832550    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.832914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.832842    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.833865 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.833584    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-web-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.833865 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.833821    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.834276 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.834252    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.834715 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.834687    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-config\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.834794 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.834750    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.834833 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.834798    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/024eb530-7553-4324-8887-d091a2539561-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.835692 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.835671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/024eb530-7553-4324-8887-d091a2539561-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.837188 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.837169    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbjsj\" (UniqueName: \"kubernetes.io/projected/024eb530-7553-4324-8887-d091a2539561-kube-api-access-zbjsj\") pod \"prometheus-k8s-0\" (UID: \"024eb530-7553-4324-8887-d091a2539561\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:28.975922 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:28.975888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:29.109489 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:29.109463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:25:29.111774 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:25:29.111752    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024eb530_7553_4324_8887_d091a2539561.slice/crio-68f018afe41256855723e8b915068c27de459ad4009dc10d0129e0add32b4d90 WatchSource:0}: Error finding container 68f018afe41256855723e8b915068c27de459ad4009dc10d0129e0add32b4d90: Status 404 returned error can't find the container with id 68f018afe41256855723e8b915068c27de459ad4009dc10d0129e0add32b4d90
Jul 06 19:25:29.603004 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:29.602973    2559 generic.go:356] "Generic (PLEG): container finished" podID="024eb530-7553-4324-8887-d091a2539561" containerID="5fa960d30825e8ab6e851fe0b81704beea11178db457f1b5ea9a12f1f6f4de3b" exitCode=0
Jul 06 19:25:29.603170 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:29.603023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerDied","Data":"5fa960d30825e8ab6e851fe0b81704beea11178db457f1b5ea9a12f1f6f4de3b"}
Jul 06 19:25:29.603170 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:29.603086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"68f018afe41256855723e8b915068c27de459ad4009dc10d0129e0add32b4d90"}
Jul 06 19:25:29.915239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:29.915213    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f06f367d-10db-44d5-b1f7-6cae046c57e2" path="/var/lib/kubelet/pods/f06f367d-10db-44d5-b1f7-6cae046c57e2/volumes"
Jul 06 19:25:30.611048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"af1567bdd233254177493b85a9ad0fed3a3d56104b4342401e50c3370976f6ba"}
Jul 06 19:25:30.611212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"379cfebd620300f7db6947540802982ec1a7dcff5f458900a9917ac514c91b7b"}
Jul 06 19:25:30.611212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"ba38a335526116f9f722e3632d59a422ccd0f138f8a1a9dc40ab56c1e7dae727"}
Jul 06 19:25:30.611212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"433186add298175698b756394bfdbe10f5f11c60543872861bf2c1ff0a0fcb25"}
Jul 06 19:25:30.611212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"8466a2d3006d85ed42f5cc347e8cbd401cb5f45c32832ede54ad553c554cd24d"}
Jul 06 19:25:30.611212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.611173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"024eb530-7553-4324-8887-d091a2539561","Type":"ContainerStarted","Data":"a7246b1422a25effdb8892364ca6bcba1315f67b6af466feea4722b00ff56242"}
Jul 06 19:25:30.643595 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:30.643527    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.624450974 podStartE2EDuration="2.643507261s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.056287ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:30.64215216 +0000 UTC m=+153.279650888" watchObservedRunningTime="2026-07-06 19:25:30.643507261 +0000 UTC m=+153.281005989"
Jul 06 19:25:31.986419 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:31.986379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:32.067815 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:32.067784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.976541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:33.976505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:25:43.149016 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:43.148982    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:25:43.267780 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:43.267742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:43.367915 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:43.367880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:43.439304 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:43.439223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:45.041964 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:25:45.041930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:08.169258 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.169200    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-858956bd9f-jxcbh" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" containerName="console" containerID="cri-o://540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07" gracePeriod=15
Jul 06 19:26:08.316155 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.316115    2559 patch_prober.go:28] interesting pod/console-858956bd9f-jxcbh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body=
Jul 06 19:26:08.316318 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.316184    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-858956bd9f-jxcbh" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused"
Jul 06 19:26:08.416531 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.416509    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:26:08.578126 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578045    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcgww\" (UniqueName: \"kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578126 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578126 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578113    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578143    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578379 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578232    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config\") pod \"2b417da7-672e-4f61-92a7-4e08de95a696\" (UID: \"2b417da7-672e-4f61-92a7-4e08de95a696\") "
Jul 06 19:26:08.578573 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578513    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:26:08.578723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578691    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config" (OuterVolumeSpecName: "console-config") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:26:08.578784 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578702    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:26:08.578898 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.578875    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:26:08.580390 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.580358    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:26:08.580526 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.580503    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww" (OuterVolumeSpecName: "kube-api-access-wcgww") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "kube-api-access-wcgww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:26:08.580660 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.580617    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b417da7-672e-4f61-92a7-4e08de95a696" (UID: "2b417da7-672e-4f61-92a7-4e08de95a696"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:26:08.679720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679683    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcgww\" (UniqueName: \"kubernetes.io/projected/2b417da7-672e-4f61-92a7-4e08de95a696-kube-api-access-wcgww\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679713    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679722    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679730    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-trusted-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679971 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679740    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-console-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679971 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679748    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b417da7-672e-4f61-92a7-4e08de95a696-oauth-serving-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.679971 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.679756    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b417da7-672e-4f61-92a7-4e08de95a696-console-oauth-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:26:08.759288 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.759251    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b417da7-672e-4f61-92a7-4e08de95a696" containerID="540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07" exitCode=0
Jul 06 19:26:08.759441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.759301    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858956bd9f-jxcbh"
Jul 06 19:26:08.759441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.759309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858956bd9f-jxcbh" event={"ID":"2b417da7-672e-4f61-92a7-4e08de95a696","Type":"ContainerDied","Data":"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"}
Jul 06 19:26:08.759441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.759356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858956bd9f-jxcbh" event={"ID":"2b417da7-672e-4f61-92a7-4e08de95a696","Type":"ContainerDied","Data":"34c5a7ab78cd6974f9c02fa71961c9661328a8676fabf40429757debbf0671e4"}
Jul 06 19:26:08.759441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.759384    2559 scope.go:117] "RemoveContainer" containerID="540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"
Jul 06 19:26:08.767587 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.767568    2559 scope.go:117] "RemoveContainer" containerID="540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"
Jul 06 19:26:08.767873 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:26:08.767853    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07\": container with ID starting with 540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07 not found: ID does not exist" containerID="540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"
Jul 06 19:26:08.767944 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.767882    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07"} err="failed to get container status \"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07\": rpc error: code = NotFound desc = could not find container \"540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07\": container with ID starting with 540553ed5a928f3a77b5616609bb5502f52e0d88179c9440780feb4cbbf45d07 not found: ID does not exist"
Jul 06 19:26:08.779361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.779337    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:26:08.783454 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:08.783435    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858956bd9f-jxcbh"]
Jul 06 19:26:09.914467 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:09.914438    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" path="/var/lib/kubelet/pods/2b417da7-672e-4f61-92a7-4e08de95a696/volumes"
Jul 06 19:26:14.272542 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:14.272501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:14.359115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:14.359082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.524824 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:27.524793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.597136 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:27.597106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:28.976404 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:28.976367    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:26:28.991727 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:28.991699    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:26:29.851054 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:29.851029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:26:37.447209 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:37.447175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:37.526486 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:37.526440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:43.234182 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:43.234137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:43.303076 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:43.303014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:49.294646 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:49.294593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:49.361563 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:49.361525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:54.578069 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:54.578034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:54.678750 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:54.678704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:55.279272 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:55.279239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:55.382064 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:26:55.382030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:13.188381 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:13.188335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:13.286830 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:13.286796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:40.452692 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:40.452658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:40.550337 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:40.550303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.307816 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:44.307778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.408876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:44.408840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.893753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:44.893708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.998572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:44.998531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:46.000336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:46.000295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:46.091366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:46.091325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:48.026329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:48.026286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:48.395679 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:48.395649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.259829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:51.259782    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.354001 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:51.353964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.647140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:53.647105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.753120 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:53.753094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.099133 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:54.099041    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.200963 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:54.200934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:55.786325 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.786290    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"]
Jul 06 19:27:55.786720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.786597    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" containerName="console"
Jul 06 19:27:55.786720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.786612    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" containerName="console"
Jul 06 19:27:55.786720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.786692    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b417da7-672e-4f61-92a7-4e08de95a696" containerName="console"
Jul 06 19:27:55.789291 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.789276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.792220 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.792196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-chlb7\""
Jul 06 19:27:55.792332 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.792250    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:55.792602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.792590    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:55.799533 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.799511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"]
Jul 06 19:27:55.882678 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.882615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.882863 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.882691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4fr\" (UniqueName: \"kubernetes.io/projected/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-kube-api-access-2m4fr\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.984027 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.983988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.984196 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.984034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4fr\" (UniqueName: \"kubernetes.io/projected/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-kube-api-access-2m4fr\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.984378 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.984358    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:55.993248 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:55.993213    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4fr\" (UniqueName: \"kubernetes.io/projected/5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d-kube-api-access-2m4fr\") pod \"openshift-lws-operator-fd8ccff4c-vps2p\" (UID: \"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:56.113476 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:56.113383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"
Jul 06 19:27:56.240418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:56.240388    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p"]
Jul 06 19:27:56.243738 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:27:56.243710    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ffbaa8c_dbcc_4a74_9d02_b99eac0bd78d.slice/crio-f562244842254cca61a35710e6cae792b0b61d2f69706299107dfe881e610f7c WatchSource:0}: Error finding container f562244842254cca61a35710e6cae792b0b61d2f69706299107dfe881e610f7c: Status 404 returned error can't find the container with id f562244842254cca61a35710e6cae792b0b61d2f69706299107dfe881e610f7c
Jul 06 19:27:56.677245 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:56.677196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.135027 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:57.134989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p" event={"ID":"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d","Type":"ContainerStarted","Data":"f562244842254cca61a35710e6cae792b0b61d2f69706299107dfe881e610f7c"}
Jul 06 19:27:57.779489 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:57.779458    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:27:59.145421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:59.145387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p" event={"ID":"5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d","Type":"ContainerStarted","Data":"ff080bebfe6a72aa1597805a090f3acc22d49c8302e8cf04fd0ebcee017138a2"}
Jul 06 19:27:59.165612 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:59.165506    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vps2p" podStartSLOduration=1.376872838 podStartE2EDuration="4.165481785s" totalImagesPullingTime="2.788608947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:59.163539968 +0000 UTC m=+301.801038699" watchObservedRunningTime="2026-07-06 19:27:59.165481785 +0000 UTC m=+301.802980513"
Jul 06 19:27:59.966687 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:27:59.966615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:00.074746 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:00.074711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:01.919763 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:01.919733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:17.640261 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:17.640224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:17.851257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:17.851222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:18.150044 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.150000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:18.632331 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.632300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:18.743658 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.743598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:18.797159 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.797126    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"]
Jul 06 19:28:18.804694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.804662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.811981 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.811959    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:28:18.812105 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.811988    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zpx5b\""
Jul 06 19:28:18.812397 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.812379    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:28:18.812737 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.812723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:28:18.815046 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.815031    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:28:18.829834 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.829807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"]
Jul 06 19:28:18.864449 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.864420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnld8\" (UniqueName: \"kubernetes.io/projected/7a1b3544-58a9-48ea-9de1-af3217c0b023-kube-api-access-vnld8\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.864617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.864464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.864617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.864509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-manifests\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.864617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.864545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-webhook-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.864617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.864567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-tmp\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.965876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.965786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.965876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.965854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-manifests\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.966122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.965884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-webhook-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.966122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.965909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-tmp\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.966122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.966031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnld8\" (UniqueName: \"kubernetes.io/projected/7a1b3544-58a9-48ea-9de1-af3217c0b023-kube-api-access-vnld8\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.966444 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.966414    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-manifests\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.968119 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.968096    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1b3544-58a9-48ea-9de1-af3217c0b023-tmp\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.968344 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.968326    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.968403 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.968380    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1b3544-58a9-48ea-9de1-af3217c0b023-webhook-cert\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:18.975980 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:18.975956    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnld8\" (UniqueName: \"kubernetes.io/projected/7a1b3544-58a9-48ea-9de1-af3217c0b023-kube-api-access-vnld8\") pod \"opendatahub-operator-controller-manager-7865995f8c-wpt2s\" (UID: \"7a1b3544-58a9-48ea-9de1-af3217c0b023\") " pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:19.043642 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.043589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.115263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.115231    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:19.145792 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.145755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.310794 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.310722    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"]
Jul 06 19:28:19.318587 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:28:19.318554    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1b3544_58a9_48ea_9de1_af3217c0b023.slice/crio-e568d055dde5ea96c0139541d6c1541e536f75104d73e90158bbb7b950b99c00 WatchSource:0}: Error finding container e568d055dde5ea96c0139541d6c1541e536f75104d73e90158bbb7b950b99c00: Status 404 returned error can't find the container with id e568d055dde5ea96c0139541d6c1541e536f75104d73e90158bbb7b950b99c00
Jul 06 19:28:19.320438 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.320423    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:28:19.324139 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.324113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.411730 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.411683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.541098 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.541067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.640488 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:19.640461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:20.225447 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:20.225398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerStarted","Data":"e568d055dde5ea96c0139541d6c1541e536f75104d73e90158bbb7b950b99c00"}
Jul 06 19:28:22.233574 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:22.233542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerStarted","Data":"ce2b1e6098fe81b4e02571398fbcb7f24baa05d34504ce4d2afc45bdc7a7258b"}
Jul 06 19:28:24.242255 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:24.242223    2559 generic.go:356] "Generic (PLEG): container finished" podID="7a1b3544-58a9-48ea-9de1-af3217c0b023" containerID="ce2b1e6098fe81b4e02571398fbcb7f24baa05d34504ce4d2afc45bdc7a7258b" exitCode=0
Jul 06 19:28:24.242255 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:24.242263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerDied","Data":"ce2b1e6098fe81b4e02571398fbcb7f24baa05d34504ce4d2afc45bdc7a7258b"}
Jul 06 19:28:25.248252 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:25.248219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerStarted","Data":"5febb61ef9df512270a8297d80a5d8d7db11658fb468e7483ab74a14d4f7f014"}
Jul 06 19:28:25.248648 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:25.248433    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:25.279882 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:25.279832    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" podStartSLOduration=2.9892327290000003 podStartE2EDuration="7.279812782s" totalImagesPullingTime="3.275418924s" totalInitContainerRuntime="1.015161129s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:25.277796741 +0000 UTC m=+327.915295472" watchObservedRunningTime="2026-07-06 19:28:25.279812782 +0000 UTC m=+327.917311510"
Jul 06 19:28:36.253937 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:36.253901    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:28:38.352933 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:38.352902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:38.510133 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:38.510092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:38.713951 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:38.713917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:38.880785 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:38.880747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:39.154168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.152028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"]
Jul 06 19:28:39.161339 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.161310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.178668 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:39.178607    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"lws-manager-config\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap"
Jul 06 19:28:39.178668 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:39.178607    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret"
Jul 06 19:28:39.178668 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:39.178607    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-z5dz6\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5dz6\"" type="*v1.Secret"
Jul 06 19:28:39.178668 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:39.178607    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret"
Jul 06 19:28:39.178967 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:39.178619    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"lws-controller-manager-54d6cd8878-bnkn5\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="0e768003-c4e1-4f3f-bc6f-67cd06404e2a" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.248110 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.248079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.248269 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.248130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-manager-config\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.248269 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.248164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmt6l\" (UniqueName: \"kubernetes.io/projected/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-kube-api-access-lmt6l\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.248269 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.248196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.271947 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.271914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"]
Jul 06 19:28:39.349184 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.349146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-manager-config\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.349184 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.349187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmt6l\" (UniqueName: \"kubernetes.io/projected/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-kube-api-access-lmt6l\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.349418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.349212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.349418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.349266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:39.431946 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:39.431860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmt6l\" (UniqueName: \"kubernetes.io/projected/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-kube-api-access-lmt6l\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.191317 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.191277    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:28:40.200120 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.200098    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-manager-config\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.213204 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.213161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:40.350125 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:40.350091    2559 secret.go:189] Couldn't get secret openshift-lws-operator/metrics-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:40.350305 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:40.350183    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert podName:0e768003-c4e1-4f3f-bc6f-67cd06404e2a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:40.850166512 +0000 UTC m=+343.487665222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert") pod "lws-controller-manager-54d6cd8878-bnkn5" (UID: "0e768003-c4e1-4f3f-bc6f-67cd06404e2a") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:40.350305 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:40.350100    2559 secret.go:189] Couldn't get secret openshift-lws-operator/webhook-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:40.350305 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:40.350210    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert podName:0e768003-c4e1-4f3f-bc6f-67cd06404e2a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:40.850204247 +0000 UTC m=+343.487702956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert") pod "lws-controller-manager-54d6cd8878-bnkn5" (UID: "0e768003-c4e1-4f3f-bc6f-67cd06404e2a") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:40.416618 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.416582    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5dz6\""
Jul 06 19:28:40.508570 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.508485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:40.544952 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.544921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:28:40.680712 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.680686    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:28:40.752456 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.752414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:40.863459 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.863375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.863459 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.863446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.865867 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.865841    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.865980 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.865921    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e768003-c4e1-4f3f-bc6f-67cd06404e2a-metrics-cert\") pod \"lws-controller-manager-54d6cd8878-bnkn5\" (UID: \"0e768003-c4e1-4f3f-bc6f-67cd06404e2a\") " pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:40.969711 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:40.969678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:41.114425 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.114401    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"]
Jul 06 19:28:41.116245 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:28:41.116214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e768003_c4e1_4f3f_bc6f_67cd06404e2a.slice/crio-6e15d656fbe69757fbdbdc51445535999343052be794879e1630ea827eae860e WatchSource:0}: Error finding container 6e15d656fbe69757fbdbdc51445535999343052be794879e1630ea827eae860e: Status 404 returned error can't find the container with id 6e15d656fbe69757fbdbdc51445535999343052be794879e1630ea827eae860e
Jul 06 19:28:41.311096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.311054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5" event={"ID":"0e768003-c4e1-4f3f-bc6f-67cd06404e2a","Type":"ContainerStarted","Data":"6e15d656fbe69757fbdbdc51445535999343052be794879e1630ea827eae860e"}
Jul 06 19:28:41.613306 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.613267    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxk4h"]
Jul 06 19:28:41.616974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.616947    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.619907 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:41.619872    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-bxk4h\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="d0170e3d-338b-4d76-8442-3e3e39a4706f" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.631145 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:41.631109    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-tls\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret"
Jul 06 19:28:41.663367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.663334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxk4h"]
Jul 06 19:28:41.771154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.771098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:41.771367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.771299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.771456 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.771419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f87r\" (UniqueName: \"kubernetes.io/projected/d0170e3d-338b-4d76-8442-3e3e39a4706f-kube-api-access-2f87r\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.872904 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.872869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.873066 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.872915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f87r\" (UniqueName: \"kubernetes.io/projected/d0170e3d-338b-4d76-8442-3e3e39a4706f-kube-api-access-2f87r\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.898808 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.898774    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f87r\" (UniqueName: \"kubernetes.io/projected/d0170e3d-338b-4d76-8442-3e3e39a4706f-kube-api-access-2f87r\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:41.938720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:41.938678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:42.873693 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:42.873669    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:42.874082 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:28:42.873752    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs podName:d0170e3d-338b-4d76-8442-3e3e39a4706f nodeName:}" failed. No retries permitted until 2026-07-06 19:28:43.373731113 +0000 UTC m=+346.011229836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs") pod "model-serving-api-54d89bd5fc-bxk4h" (UID: "d0170e3d-338b-4d76-8442-3e3e39a4706f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:43.026047 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.026016    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:28:43.319798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.319716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5" event={"ID":"0e768003-c4e1-4f3f-bc6f-67cd06404e2a","Type":"ContainerStarted","Data":"eba412f911b222775faadc75bf80b39eb6304c0e7869bfde97d1feccaf0bd491"}
Jul 06 19:28:43.319798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.319774    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:43.354323 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.354264    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5" podStartSLOduration=2.975663673 podStartE2EDuration="4.35424936s" totalImagesPullingTime="1.378585687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:43.352743668 +0000 UTC m=+345.990242397" watchObservedRunningTime="2026-07-06 19:28:43.35424936 +0000 UTC m=+345.991748088"
Jul 06 19:28:43.387515 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.387475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:43.389924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.389902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0170e3d-338b-4d76-8442-3e3e39a4706f-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxk4h\" (UID: \"d0170e3d-338b-4d76-8442-3e3e39a4706f\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:43.431673 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.431615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:43.565047 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:43.559334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxk4h"]
Jul 06 19:28:43.565047 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:28:43.562103    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0170e3d_338b_4d76_8442_3e3e39a4706f.slice/crio-2e3e76bf3c1d408e43c2f313d2e08f2c63922362b42cd20b91f6f110fd4cc59c WatchSource:0}: Error finding container 2e3e76bf3c1d408e43c2f313d2e08f2c63922362b42cd20b91f6f110fd4cc59c: Status 404 returned error can't find the container with id 2e3e76bf3c1d408e43c2f313d2e08f2c63922362b42cd20b91f6f110fd4cc59c
Jul 06 19:28:44.324326 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:44.324289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h" event={"ID":"d0170e3d-338b-4d76-8442-3e3e39a4706f","Type":"ContainerStarted","Data":"2e3e76bf3c1d408e43c2f313d2e08f2c63922362b42cd20b91f6f110fd4cc59c"}
Jul 06 19:28:44.976609 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:44.976580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:46.333273 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:46.333234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h" event={"ID":"d0170e3d-338b-4d76-8442-3e3e39a4706f","Type":"ContainerStarted","Data":"7714763c64c85bc2872288fae8c9ea833e7b889da7bd5e5c47736c801560e313"}
Jul 06 19:28:46.333661 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:46.333362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:50.342617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.342534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:50.375387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.375309    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h" podStartSLOduration=7.17834982 podStartE2EDuration="9.375291087s" totalImagesPullingTime="2.196941267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:46.401933767 +0000 UTC m=+349.039432495" watchObservedRunningTime="2026-07-06 19:28:50.375291087 +0000 UTC m=+353.012789842"
Jul 06 19:28:50.376675 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.376656    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67db589d55-v92tc"]
Jul 06 19:28:50.380020 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.380002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.383341 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.383321    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:28:50.383457 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.383321    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:28:50.383851 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.383833    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:28:50.384003 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.383986    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:28:50.385440 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.385425    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xd7bt\""
Jul 06 19:28:50.401757 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.401732    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67db589d55-v92tc"]
Jul 06 19:28:50.442538 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.442504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:50.442946 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.442929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tls-certs\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.442997 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.442955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gng2\" (UniqueName: \"kubernetes.io/projected/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-kube-api-access-4gng2\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.442997 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.442971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tmp\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.543659 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.543601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tls-certs\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.543659 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.543659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gng2\" (UniqueName: \"kubernetes.io/projected/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-kube-api-access-4gng2\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.543873 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.543678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tmp\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.545826 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.545797    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tmp\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.546016 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.545999    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-tls-certs\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.555579 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.555553    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gng2\" (UniqueName: \"kubernetes.io/projected/7477bf6d-5dbb-44de-b0c7-cfda0be32c40-kube-api-access-4gng2\") pod \"kube-auth-proxy-67db589d55-v92tc\" (UID: \"7477bf6d-5dbb-44de-b0c7-cfda0be32c40\") " pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.690354 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.690318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc"
Jul 06 19:28:50.863936 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:50.863900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67db589d55-v92tc"]
Jul 06 19:28:50.869656 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:28:50.869572    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7477bf6d_5dbb_44de_b0c7_cfda0be32c40.slice/crio-5b67d2c7f0b5363761d6267fafff9e6a087e25c995b37518a517d0bedd8068e8 WatchSource:0}: Error finding container 5b67d2c7f0b5363761d6267fafff9e6a087e25c995b37518a517d0bedd8068e8: Status 404 returned error can't find the container with id 5b67d2c7f0b5363761d6267fafff9e6a087e25c995b37518a517d0bedd8068e8
Jul 06 19:28:51.358458 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:51.358422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc" event={"ID":"7477bf6d-5dbb-44de-b0c7-cfda0be32c40","Type":"ContainerStarted","Data":"5b67d2c7f0b5363761d6267fafff9e6a087e25c995b37518a517d0bedd8068e8"}
Jul 06 19:28:52.425884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:52.425839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:52.678510 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:52.678422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:52.865675 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:52.865616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:53.006827 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:53.006710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:53.295650 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:53.295512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:53.667131 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:53.667092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:54.039683 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.039582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:54.214391 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.214355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:54.327212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.327122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:28:54.371943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.371908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc" event={"ID":"7477bf6d-5dbb-44de-b0c7-cfda0be32c40","Type":"ContainerStarted","Data":"0eaf12b061c96b49f35b9acfdb296a9dfd072956c27e985054a01de634ec3d23"}
Jul 06 19:28:54.495341 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.495311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:54.535539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:54.535486    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67db589d55-v92tc" podStartSLOduration=1.608505753 podStartE2EDuration="4.535467946s" totalImagesPullingTime="2.926962193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:54.534819629 +0000 UTC m=+357.172318360" watchObservedRunningTime="2026-07-06 19:28:54.535467946 +0000 UTC m=+357.172966674"
Jul 06 19:28:55.193938 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:55.193900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:57.340846 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:57.340822    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bxk4h"
Jul 06 19:28:57.716421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:57.716388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:58.183050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:58.183013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:59.717831 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:59.717794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:59.913658 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:28:59.913590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:00.766597 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:00.766563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:17.316875 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:17.316835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:27.825723 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:27.825687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:29.871863 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:29.871809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:29.980055 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:29.980021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:39.668030 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:39.667997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:39.837314 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:39.837277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:40.098598 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:40.098488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:50.988373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:29:50.988334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:02.724165 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:02.724133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:08.958328 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:08.958294    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:25.090967 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:25.090878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:26.179413 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:26.179374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:29.882748 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:29.882699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:31.889577 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:31.889535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:32.452651 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:32.452594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:33.791805 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:33.791773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:35.306468 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.306437    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"]
Jul 06 19:30:35.309797 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.309781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.313283 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.313261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:30:35.313681 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.313659    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:30:35.313776 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.313702    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tdzvj\""
Jul 06 19:30:35.325080 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.325056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"]
Jul 06 19:30:35.351447 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.351411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sml5q\" (UniqueName: \"kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.351447 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.351462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.452884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.452848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.453062 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.452941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sml5q\" (UniqueName: \"kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.453326 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.453306    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.466199 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.466173    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sml5q\" (UniqueName: \"kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.619443 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.619414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:35.751872 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.751841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:35.778053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.778032    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"]
Jul 06 19:30:35.780854 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:30:35.780816    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb05ad96_90d2_4308_81a9_addc203ac479.slice/crio-6c50e7e99694076117145f4e0a1a523ec73d2fe909e01f92290ecbdd601d5fca WatchSource:0}: Error finding container 6c50e7e99694076117145f4e0a1a523ec73d2fe909e01f92290ecbdd601d5fca: Status 404 returned error can't find the container with id 6c50e7e99694076117145f4e0a1a523ec73d2fe909e01f92290ecbdd601d5fca
Jul 06 19:30:35.945175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:35.945095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:36.789286 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:36.789247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s" event={"ID":"cb05ad96-90d2-4308-81a9-addc203ac479","Type":"ContainerStarted","Data":"6c50e7e99694076117145f4e0a1a523ec73d2fe909e01f92290ecbdd601d5fca"}
Jul 06 19:30:36.907254 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:36.907210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:37.008262 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:37.008230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:38.730747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:38.730701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:38.846125 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:38.846074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:39.112660 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:39.112550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:39.212270 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:39.212226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:42.819868 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:42.819831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s" event={"ID":"cb05ad96-90d2-4308-81a9-addc203ac479","Type":"ContainerStarted","Data":"3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875"}
Jul 06 19:30:42.820354 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:42.819970    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:42.863838 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:42.863781    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s" podStartSLOduration=1.650475726 podStartE2EDuration="7.86376506s" totalImagesPullingTime="6.213289334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:42.862313795 +0000 UTC m=+465.499812523" watchObservedRunningTime="2026-07-06 19:30:42.86376506 +0000 UTC m=+465.501263787"
Jul 06 19:30:43.127402 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:43.127371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:43.267640 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:43.267592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:45.040268 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:45.040234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:45.327787 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:45.327699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.151375 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:46.151337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.334802 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:46.334759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.726552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:46.726520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.933094 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:46.933061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:47.871103 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:47.871066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:48.049994 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:48.049962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:49.262329 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:49.262299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.197436 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:53.197406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.338161 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:53.338123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.826995 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:53.826961    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.471664 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.471611    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"]
Jul 06 19:30:56.472140 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.471878    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" containerName="manager" containerID="cri-o://3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875" gracePeriod=2
Jul 06 19:30:56.484059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.484031    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"]
Jul 06 19:30:56.544968 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.544939    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:30:56.545275 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.545262    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" containerName="manager"
Jul 06 19:30:56.545321 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.545279    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" containerName="manager"
Jul 06 19:30:56.545355 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.545333    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" containerName="manager"
Jul 06 19:30:56.548320 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.548305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.572579 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.572548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:30:56.616219 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:56.616172    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.645142 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.645115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44qf9\" (UniqueName: \"kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.645260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.645175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.716171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.716148    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.719671 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:56.719646    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.746305 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.746235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.746424 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.746402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44qf9\" (UniqueName: \"kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.746692 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.746674    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.785148 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.785113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44qf9\" (UniqueName: \"kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jnh4f\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.847770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.847732    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sml5q\" (UniqueName: \"kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q\") pod \"cb05ad96-90d2-4308-81a9-addc203ac479\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") "
Jul 06 19:30:56.847943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.847832    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume\") pod \"cb05ad96-90d2-4308-81a9-addc203ac479\" (UID: \"cb05ad96-90d2-4308-81a9-addc203ac479\") "
Jul 06 19:30:56.848277 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.848251    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb05ad96-90d2-4308-81a9-addc203ac479" (UID: "cb05ad96-90d2-4308-81a9-addc203ac479"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:56.849982 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.849961    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q" (OuterVolumeSpecName: "kube-api-access-sml5q") pod "cb05ad96-90d2-4308-81a9-addc203ac479" (UID: "cb05ad96-90d2-4308-81a9-addc203ac479"). InnerVolumeSpecName "kube-api-access-sml5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:56.859161 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.859140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:56.879730 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.879704    2559 generic.go:356] "Generic (PLEG): container finished" podID="cb05ad96-90d2-4308-81a9-addc203ac479" containerID="3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875" exitCode=0
Jul 06 19:30:56.879866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.879747    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.879866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.879800    2559 scope.go:117] "RemoveContainer" containerID="3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875"
Jul 06 19:30:56.889364 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.889344    2559 scope.go:117] "RemoveContainer" containerID="3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875"
Jul 06 19:30:56.889749 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:56.889729    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875\": container with ID starting with 3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875 not found: ID does not exist" containerID="3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875"
Jul 06 19:30:56.889810 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.889760    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875"} err="failed to get container status \"3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875\": rpc error: code = NotFound desc = could not find container \"3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875\": container with ID starting with 3c8420485673e5c3f26dfda4e670e19be55a59821f58b435451aca0e871f8875 not found: ID does not exist"
Jul 06 19:30:56.891054 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:56.891024    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.893378 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:56.893354    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:56.949161 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.949129    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb05ad96-90d2-4308-81a9-addc203ac479-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:30:56.949161 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:56.949156    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sml5q\" (UniqueName: \"kubernetes.io/projected/cb05ad96-90d2-4308-81a9-addc203ac479-kube-api-access-sml5q\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:30:57.003893 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.003810    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:30:57.007319 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:30:57.007293    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d62fbc_29cf_4107_bc23_cbbf6de7749b.slice/crio-d305eb610037f45822055a6951efe0bc1d775645e4692a6d5b97ee5ac2f35ed0 WatchSource:0}: Error finding container d305eb610037f45822055a6951efe0bc1d775645e4692a6d5b97ee5ac2f35ed0: Status 404 returned error can't find the container with id d305eb610037f45822055a6951efe0bc1d775645e4692a6d5b97ee5ac2f35ed0
Jul 06 19:30:57.885525 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.885494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" event={"ID":"76d62fbc-29cf-4107-bc23-cbbf6de7749b","Type":"ContainerStarted","Data":"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"}
Jul 06 19:30:57.885903 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.885544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" event={"ID":"76d62fbc-29cf-4107-bc23-cbbf6de7749b","Type":"ContainerStarted","Data":"d305eb610037f45822055a6951efe0bc1d775645e4692a6d5b97ee5ac2f35ed0"}
Jul 06 19:30:57.885903 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.885616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:30:57.908001 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.907971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:57.915818 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.915795    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" path="/var/lib/kubelet/pods/cb05ad96-90d2-4308-81a9-addc203ac479/volumes"
Jul 06 19:30:57.926083 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:57.926042    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" podStartSLOduration=1.92602771 podStartE2EDuration="1.92602771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:57.925689366 +0000 UTC m=+480.563188088" watchObservedRunningTime="2026-07-06 19:30:57.92602771 +0000 UTC m=+480.563526435"
Jul 06 19:30:57.928362 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:30:57.928332    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mcm7s\" is forbidden: User \"system:node:ip-10-0-135-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-41.ec2.internal' and this object" podUID="cb05ad96-90d2-4308-81a9-addc203ac479" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mcm7s"
Jul 06 19:30:58.015366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:58.015335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:58.285476 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:58.285447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:58.388881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:30:58.388853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.718110 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:01.718071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.848106 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:01.848078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:05.491613 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:05.491570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:05.620878 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:05.620839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:08.897357 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:08.897325    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:31:11.982770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:11.982719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:12.109032 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:12.108996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:14.618044 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.618007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:31:14.618487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.618234    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" podUID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" containerName="manager" containerID="cri-o://75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e" gracePeriod=10
Jul 06 19:31:14.859821 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.859792    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:31:14.896262 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.896176    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44qf9\" (UniqueName: \"kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9\") pod \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") "
Jul 06 19:31:14.896404 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.896263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume\") pod \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\" (UID: \"76d62fbc-29cf-4107-bc23-cbbf6de7749b\") "
Jul 06 19:31:14.896683 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.896661    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76d62fbc-29cf-4107-bc23-cbbf6de7749b" (UID: "76d62fbc-29cf-4107-bc23-cbbf6de7749b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:14.898293 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.898273    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9" (OuterVolumeSpecName: "kube-api-access-44qf9") pod "76d62fbc-29cf-4107-bc23-cbbf6de7749b" (UID: "76d62fbc-29cf-4107-bc23-cbbf6de7749b"). InnerVolumeSpecName "kube-api-access-44qf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:14.959954 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.959920    2559 generic.go:356] "Generic (PLEG): container finished" podID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" containerID="75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e" exitCode=0
Jul 06 19:31:14.960136 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.959966    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"
Jul 06 19:31:14.960136 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.960011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" event={"ID":"76d62fbc-29cf-4107-bc23-cbbf6de7749b","Type":"ContainerDied","Data":"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"}
Jul 06 19:31:14.960136 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.960063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f" event={"ID":"76d62fbc-29cf-4107-bc23-cbbf6de7749b","Type":"ContainerDied","Data":"d305eb610037f45822055a6951efe0bc1d775645e4692a6d5b97ee5ac2f35ed0"}
Jul 06 19:31:14.960136 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.960084    2559 scope.go:117] "RemoveContainer" containerID="75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"
Jul 06 19:31:14.969022 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.969005    2559 scope.go:117] "RemoveContainer" containerID="75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"
Jul 06 19:31:14.969307 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:31:14.969286    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e\": container with ID starting with 75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e not found: ID does not exist" containerID="75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"
Jul 06 19:31:14.969375 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.969312    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e"} err="failed to get container status \"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e\": rpc error: code = NotFound desc = could not find container \"75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e\": container with ID starting with 75386c7b80f2ad1845bf7e1be4c7ff0cf3cb1aafef39db864534edf2a85ab24e not found: ID does not exist"
Jul 06 19:31:14.997099 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.997072    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76d62fbc-29cf-4107-bc23-cbbf6de7749b-extensions-socket-volume\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:31:14.997099 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:14.997096    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44qf9\" (UniqueName: \"kubernetes.io/projected/76d62fbc-29cf-4107-bc23-cbbf6de7749b-kube-api-access-44qf9\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:31:15.014058 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:15.014029    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:31:15.023520 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:15.023493    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jnh4f"]
Jul 06 19:31:15.915281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:15.915246    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" path="/var/lib/kubelet/pods/76d62fbc-29cf-4107-bc23-cbbf6de7749b/volumes"
Jul 06 19:31:31.372357 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:31.372326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:31.673986 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:31.673896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:33.533793 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.533760    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:33.534206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.534062    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" containerName="manager"
Jul 06 19:31:33.534206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.534073    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" containerName="manager"
Jul 06 19:31:33.534206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.534133    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="76d62fbc-29cf-4107-bc23-cbbf6de7749b" containerName="manager"
Jul 06 19:31:33.536167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.536137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.542881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.539680    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:31:33.542881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.539746    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mg4xx\""
Jul 06 19:31:33.542881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.540382    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:31:33.542881 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.540616    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:31:33.544522 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.544498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:33.551963 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.551942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:33.623428 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.623395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:33.623844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.623822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:33.648959 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.648926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.649091 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.648982    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh7fb\" (UniqueName: \"kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.722114 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.722085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:33.750391 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.750353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.750552 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.750413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh7fb\" (UniqueName: \"kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.751091 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.751072    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.759856 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.759828    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh7fb\" (UniqueName: \"kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb\") pod \"limitador-limitador-64c94fd64f-k2bkc\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.848603 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.848512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:33.990020 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:33.989994    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:33.991877 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:31:33.991843    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2f6792_1a39_44bb_bce1_920e671a1bf5.slice/crio-5fa9229151ff9ec80be744007ce14d547087a78705275519474622ec1e4cc627 WatchSource:0}: Error finding container 5fa9229151ff9ec80be744007ce14d547087a78705275519474622ec1e4cc627: Status 404 returned error can't find the container with id 5fa9229151ff9ec80be744007ce14d547087a78705275519474622ec1e4cc627
Jul 06 19:31:34.040877 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.040841    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:31:34.044107 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.044083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" event={"ID":"0f2f6792-1a39-44bb-bce1-920e671a1bf5","Type":"ContainerStarted","Data":"5fa9229151ff9ec80be744007ce14d547087a78705275519474622ec1e4cc627"}
Jul 06 19:31:34.044220 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.044169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.062193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.062167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:31:34.123660 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.123614    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:31:34.153916 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.153877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-config-file\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.154201 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.153951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtgfh\" (UniqueName: \"kubernetes.io/projected/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-kube-api-access-rtgfh\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.254585 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.254535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-config-file\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.254797 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.254613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtgfh\" (UniqueName: \"kubernetes.io/projected/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-kube-api-access-rtgfh\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.255185 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.255164    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-config-file\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.264495 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.264473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtgfh\" (UniqueName: \"kubernetes.io/projected/9bc436d7-e715-4a71-84c5-9ff7bc2552cf-kube-api-access-rtgfh\") pod \"limitador-limitador-54d6d988d5-cjtg8\" (UID: \"9bc436d7-e715-4a71-84c5-9ff7bc2552cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.354212 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.354160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:34.436373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.436343    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:34.439348 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.439329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:34.441869 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.441848    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j85kz\""
Jul 06 19:31:34.449738 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.449687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:34.482000 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.481971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:34.486280 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.486257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:31:34.488278 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:31:34.488254    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc436d7_e715_4a71_84c5_9ff7bc2552cf.slice/crio-2945176aaf85d03a9be06087b472156df31500d4942dd89277a6a793c0b8b949 WatchSource:0}: Error finding container 2945176aaf85d03a9be06087b472156df31500d4942dd89277a6a793c0b8b949: Status 404 returned error can't find the container with id 2945176aaf85d03a9be06087b472156df31500d4942dd89277a6a793c0b8b949
Jul 06 19:31:34.556891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.556858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nktvl\" (UniqueName: \"kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl\") pod \"authorino-58cd955675-lcvvm\" (UID: \"a44d935d-9386-4921-84b0-006f9cdc99ca\") " pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:34.586357 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.586329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:34.657323 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.657253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nktvl\" (UniqueName: \"kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl\") pod \"authorino-58cd955675-lcvvm\" (UID: \"a44d935d-9386-4921-84b0-006f9cdc99ca\") " pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:34.666369 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.666345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nktvl\" (UniqueName: \"kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl\") pod \"authorino-58cd955675-lcvvm\" (UID: \"a44d935d-9386-4921-84b0-006f9cdc99ca\") " pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:34.750645 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.750587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:34.810139 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.809547    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:31:34.814816 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.814745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:31:34.861351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.859278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7mb\" (UniqueName: \"kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb\") pod \"authorino-75d556bd77-9wm7w\" (UID: \"a6276a5b-5f5d-4986-be51-f3510464d913\") " pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:31:34.889646 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.889289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:31:34.921304 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.920993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:34.928110 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:31:34.928061    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda44d935d_9386_4921_84b0_006f9cdc99ca.slice/crio-e5575f595c3f777a7afd586adb5cbe92318a14a0a772053f7ed816ef5f4811f8 WatchSource:0}: Error finding container e5575f595c3f777a7afd586adb5cbe92318a14a0a772053f7ed816ef5f4811f8: Status 404 returned error can't find the container with id e5575f595c3f777a7afd586adb5cbe92318a14a0a772053f7ed816ef5f4811f8
Jul 06 19:31:34.963764 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.962312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7mb\" (UniqueName: \"kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb\") pod \"authorino-75d556bd77-9wm7w\" (UID: \"a6276a5b-5f5d-4986-be51-f3510464d913\") " pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:31:34.974429 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:34.974394    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7mb\" (UniqueName: \"kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb\") pod \"authorino-75d556bd77-9wm7w\" (UID: \"a6276a5b-5f5d-4986-be51-f3510464d913\") " pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:31:35.051370 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:35.051243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcvvm" event={"ID":"a44d935d-9386-4921-84b0-006f9cdc99ca","Type":"ContainerStarted","Data":"e5575f595c3f777a7afd586adb5cbe92318a14a0a772053f7ed816ef5f4811f8"}
Jul 06 19:31:35.053862 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:35.053796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8" event={"ID":"9bc436d7-e715-4a71-84c5-9ff7bc2552cf","Type":"ContainerStarted","Data":"2945176aaf85d03a9be06087b472156df31500d4942dd89277a6a793c0b8b949"}
Jul 06 19:31:35.131315 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:35.131278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:31:35.402090 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:35.400379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:31:35.405121 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:31:35.404527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6276a5b_5f5d_4986_be51_f3510464d913.slice/crio-4e1fc893ca575afbfcb0e018144b0db116411bc24243ee93529b8c5bca198a61 WatchSource:0}: Error finding container 4e1fc893ca575afbfcb0e018144b0db116411bc24243ee93529b8c5bca198a61: Status 404 returned error can't find the container with id 4e1fc893ca575afbfcb0e018144b0db116411bc24243ee93529b8c5bca198a61
Jul 06 19:31:36.062188 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:36.062124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9wm7w" event={"ID":"a6276a5b-5f5d-4986-be51-f3510464d913","Type":"ContainerStarted","Data":"4e1fc893ca575afbfcb0e018144b0db116411bc24243ee93529b8c5bca198a61"}
Jul 06 19:31:40.086639 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.086600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" event={"ID":"0f2f6792-1a39-44bb-bce1-920e671a1bf5","Type":"ContainerStarted","Data":"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"}
Jul 06 19:31:40.087163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.086772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:40.088223 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.088203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8" event={"ID":"9bc436d7-e715-4a71-84c5-9ff7bc2552cf","Type":"ContainerStarted","Data":"bd1739f8f314c7770d49f0b7ce0f1cb9eb26e86bad750cd70c2651adc8a7748d"}
Jul 06 19:31:40.088318 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.088279    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:40.089739 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.089714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcvvm" event={"ID":"a44d935d-9386-4921-84b0-006f9cdc99ca","Type":"ContainerStarted","Data":"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"}
Jul 06 19:31:40.091151 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.091131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9wm7w" event={"ID":"a6276a5b-5f5d-4986-be51-f3510464d913","Type":"ContainerStarted","Data":"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"}
Jul 06 19:31:40.104072 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.104028    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" podStartSLOduration=1.919585587 podStartE2EDuration="7.104012765s" totalImagesPullingTime="5.184427178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:40.102857039 +0000 UTC m=+522.740355769" watchObservedRunningTime="2026-07-06 19:31:40.104012765 +0000 UTC m=+522.741511493"
Jul 06 19:31:40.122989 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.122929    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8" podStartSLOduration=1.4344212170000001 podStartE2EDuration="6.12291116s" totalImagesPullingTime="4.688489943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:40.120938699 +0000 UTC m=+522.758437419" watchObservedRunningTime="2026-07-06 19:31:40.12291116 +0000 UTC m=+522.760409888"
Jul 06 19:31:40.136586 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.136525    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lcvvm" podStartSLOduration=1.8935170970000001 podStartE2EDuration="6.136503769s" totalImagesPullingTime="4.242986672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:40.135966531 +0000 UTC m=+522.773465260" watchObservedRunningTime="2026-07-06 19:31:40.136503769 +0000 UTC m=+522.774002497"
Jul 06 19:31:40.153131 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.153076    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9wm7w" podStartSLOduration=2.371079973 podStartE2EDuration="6.153059351s" totalImagesPullingTime="3.781979378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:40.151435583 +0000 UTC m=+522.788934312" watchObservedRunningTime="2026-07-06 19:31:40.153059351 +0000 UTC m=+522.790558079"
Jul 06 19:31:40.182986 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:40.182955    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:42.100188 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:42.100149    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lcvvm" podUID="a44d935d-9386-4921-84b0-006f9cdc99ca" containerName="authorino" containerID="cri-o://b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64" gracePeriod=30
Jul 06 19:31:42.345682 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:42.345651    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:42.436363 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:42.436331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nktvl\" (UniqueName: \"kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl\") pod \"a44d935d-9386-4921-84b0-006f9cdc99ca\" (UID: \"a44d935d-9386-4921-84b0-006f9cdc99ca\") "
Jul 06 19:31:42.438527 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:42.438499    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl" (OuterVolumeSpecName: "kube-api-access-nktvl") pod "a44d935d-9386-4921-84b0-006f9cdc99ca" (UID: "a44d935d-9386-4921-84b0-006f9cdc99ca"). InnerVolumeSpecName "kube-api-access-nktvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:42.537371 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:42.537336    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nktvl\" (UniqueName: \"kubernetes.io/projected/a44d935d-9386-4921-84b0-006f9cdc99ca-kube-api-access-nktvl\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:31:43.105202 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.105165    2559 generic.go:356] "Generic (PLEG): container finished" podID="a44d935d-9386-4921-84b0-006f9cdc99ca" containerID="b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64" exitCode=0
Jul 06 19:31:43.105202 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.105200    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcvvm" event={"ID":"a44d935d-9386-4921-84b0-006f9cdc99ca","Type":"ContainerDied","Data":"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"}
Jul 06 19:31:43.105202 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.105204    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcvvm"
Jul 06 19:31:43.105725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.105227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcvvm" event={"ID":"a44d935d-9386-4921-84b0-006f9cdc99ca","Type":"ContainerDied","Data":"e5575f595c3f777a7afd586adb5cbe92318a14a0a772053f7ed816ef5f4811f8"}
Jul 06 19:31:43.105725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.105246    2559 scope.go:117] "RemoveContainer" containerID="b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"
Jul 06 19:31:43.113570 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.113551    2559 scope.go:117] "RemoveContainer" containerID="b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"
Jul 06 19:31:43.113865 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:31:43.113848    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64\": container with ID starting with b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64 not found: ID does not exist" containerID="b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"
Jul 06 19:31:43.113936 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.113878    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64"} err="failed to get container status \"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64\": rpc error: code = NotFound desc = could not find container \"b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64\": container with ID starting with b0aa5e068c313181181d3114af78433c9df424353c520f0cbc8d50b3b703cf64 not found: ID does not exist"
Jul 06 19:31:43.132501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.132478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:43.141282 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.141255    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcvvm"]
Jul 06 19:31:43.915265 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:43.915232    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a44d935d-9386-4921-84b0-006f9cdc99ca" path="/var/lib/kubelet/pods/a44d935d-9386-4921-84b0-006f9cdc99ca/volumes"
Jul 06 19:31:51.096998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.096915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"
Jul 06 19:31:51.098317 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.098295    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:51.220251 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.220221    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:51.220681 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.220383    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" podUID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" containerName="limitador" containerID="cri-o://ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3" gracePeriod=30
Jul 06 19:31:51.761949 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.761915    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:51.923196 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.923172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh7fb\" (UniqueName: \"kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb\") pod \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") "
Jul 06 19:31:51.923374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.923219    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file\") pod \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\" (UID: \"0f2f6792-1a39-44bb-bce1-920e671a1bf5\") "
Jul 06 19:31:51.923578 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.923550    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file" (OuterVolumeSpecName: "config-file") pod "0f2f6792-1a39-44bb-bce1-920e671a1bf5" (UID: "0f2f6792-1a39-44bb-bce1-920e671a1bf5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:31:51.925167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:51.925148    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb" (OuterVolumeSpecName: "kube-api-access-mh7fb") pod "0f2f6792-1a39-44bb-bce1-920e671a1bf5" (UID: "0f2f6792-1a39-44bb-bce1-920e671a1bf5"). InnerVolumeSpecName "kube-api-access-mh7fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:52.024434 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.024384    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh7fb\" (UniqueName: \"kubernetes.io/projected/0f2f6792-1a39-44bb-bce1-920e671a1bf5-kube-api-access-mh7fb\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:31:52.024434 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.024427    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f2f6792-1a39-44bb-bce1-920e671a1bf5-config-file\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:31:52.146493 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.146464    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" containerID="ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3" exitCode=0
Jul 06 19:31:52.146914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.146506    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"
Jul 06 19:31:52.146914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.146559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" event={"ID":"0f2f6792-1a39-44bb-bce1-920e671a1bf5","Type":"ContainerDied","Data":"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"}
Jul 06 19:31:52.146914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.146609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2bkc" event={"ID":"0f2f6792-1a39-44bb-bce1-920e671a1bf5","Type":"ContainerDied","Data":"5fa9229151ff9ec80be744007ce14d547087a78705275519474622ec1e4cc627"}
Jul 06 19:31:52.146914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.146659    2559 scope.go:117] "RemoveContainer" containerID="ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"
Jul 06 19:31:52.154944 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.154927    2559 scope.go:117] "RemoveContainer" containerID="ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"
Jul 06 19:31:52.155215 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:31:52.155197    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3\": container with ID starting with ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3 not found: ID does not exist" containerID="ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"
Jul 06 19:31:52.155297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.155223    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3"} err="failed to get container status \"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3\": rpc error: code = NotFound desc = could not find container \"ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3\": container with ID starting with ef5ac25ed547f086cd1e61e9806537e9cc2a765884acac779ae04b40ee2c74a3 not found: ID does not exist"
Jul 06 19:31:52.172650 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.172560    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:52.181210 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:52.181145    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2bkc"]
Jul 06 19:31:53.914685 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:53.914654    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" path="/var/lib/kubelet/pods/0f2f6792-1a39-44bb-bce1-920e671a1bf5/volumes"
Jul 06 19:31:54.065841 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:54.065811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:54.233876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:54.233781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:55.406350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:31:55.406314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:07.038922 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.038890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:07.200980 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.200949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:07.270435 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270400    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:07.270787 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270773    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" containerName="limitador"
Jul 06 19:32:07.270841 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270789    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" containerName="limitador"
Jul 06 19:32:07.270841 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270796    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44d935d-9386-4921-84b0-006f9cdc99ca" containerName="authorino"
Jul 06 19:32:07.270841 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44d935d-9386-4921-84b0-006f9cdc99ca" containerName="authorino"
Jul 06 19:32:07.270957 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44d935d-9386-4921-84b0-006f9cdc99ca" containerName="authorino"
Jul 06 19:32:07.270957 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.270867    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2f6792-1a39-44bb-bce1-920e671a1bf5" containerName="limitador"
Jul 06 19:32:07.278092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.278073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:07.281295 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.281268    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:07.347417 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.347321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqbc\" (UniqueName: \"kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc\") pod \"authorino-5d4b67c446-x26hl\" (UID: \"ea62c914-6cb2-4e47-b8f2-a10db2c80805\") " pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:07.448711 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.448676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqbc\" (UniqueName: \"kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc\") pod \"authorino-5d4b67c446-x26hl\" (UID: \"ea62c914-6cb2-4e47-b8f2-a10db2c80805\") " pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:07.464572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.464540    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqbc\" (UniqueName: \"kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc\") pod \"authorino-5d4b67c446-x26hl\" (UID: \"ea62c914-6cb2-4e47-b8f2-a10db2c80805\") " pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:07.519510 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.519474    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:07.519763 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.519750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:07.572470 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.572435    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7546d5dccd-zhcpt"]
Jul 06 19:32:07.575179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.575155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:07.597055 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.597025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7546d5dccd-zhcpt"]
Jul 06 19:32:07.651048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.651016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bprbt\" (UniqueName: \"kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt\") pod \"authorino-7546d5dccd-zhcpt\" (UID: \"42256807-e95f-4496-a887-55f04ce6d713\") " pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:07.661004 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.660978    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:07.665123 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:32:07.665098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea62c914_6cb2_4e47_b8f2_a10db2c80805.slice/crio-df4da295c125e4e2791c1321ddd86208a1b8aaa1e0c32a8b1f6b4178641dad91 WatchSource:0}: Error finding container df4da295c125e4e2791c1321ddd86208a1b8aaa1e0c32a8b1f6b4178641dad91: Status 404 returned error can't find the container with id df4da295c125e4e2791c1321ddd86208a1b8aaa1e0c32a8b1f6b4178641dad91
Jul 06 19:32:07.723069 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.723031    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7546d5dccd-zhcpt"]
Jul 06 19:32:07.723295 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:32:07.723275    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bprbt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7546d5dccd-zhcpt" podUID="42256807-e95f-4496-a887-55f04ce6d713"
Jul 06 19:32:07.751985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.751949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bprbt\" (UniqueName: \"kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt\") pod \"authorino-7546d5dccd-zhcpt\" (UID: \"42256807-e95f-4496-a887-55f04ce6d713\") " pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:07.775299 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:07.775267    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bprbt\" (UniqueName: \"kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt\") pod \"authorino-7546d5dccd-zhcpt\" (UID: \"42256807-e95f-4496-a887-55f04ce6d713\") " pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:08.218751 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.218722    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:08.219229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.218782    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x26hl" podUID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" containerName="authorino" containerID="cri-o://4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5" gracePeriod=30
Jul 06 19:32:08.219229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.218719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x26hl" event={"ID":"ea62c914-6cb2-4e47-b8f2-a10db2c80805","Type":"ContainerStarted","Data":"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"}
Jul 06 19:32:08.219229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.218850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x26hl" event={"ID":"ea62c914-6cb2-4e47-b8f2-a10db2c80805","Type":"ContainerStarted","Data":"df4da295c125e4e2791c1321ddd86208a1b8aaa1e0c32a8b1f6b4178641dad91"}
Jul 06 19:32:08.224839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.224819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:08.247993 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.247946    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x26hl" podStartSLOduration=0.809874655 podStartE2EDuration="1.247931138s" totalImagesPullingTime="438.056483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:08.246870124 +0000 UTC m=+550.884368852" watchObservedRunningTime="2026-07-06 19:32:08.247931138 +0000 UTC m=+550.885429867"
Jul 06 19:32:08.255708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.255686    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bprbt\" (UniqueName: \"kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt\") pod \"42256807-e95f-4496-a887-55f04ce6d713\" (UID: \"42256807-e95f-4496-a887-55f04ce6d713\") "
Jul 06 19:32:08.257777 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.257751    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt" (OuterVolumeSpecName: "kube-api-access-bprbt") pod "42256807-e95f-4496-a887-55f04ce6d713" (UID: "42256807-e95f-4496-a887-55f04ce6d713"). InnerVolumeSpecName "kube-api-access-bprbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:08.356533 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.356443    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bprbt\" (UniqueName: \"kubernetes.io/projected/42256807-e95f-4496-a887-55f04ce6d713-kube-api-access-bprbt\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:32:08.446255 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.446231    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:08.456713 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.456692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nqbc\" (UniqueName: \"kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc\") pod \"ea62c914-6cb2-4e47-b8f2-a10db2c80805\" (UID: \"ea62c914-6cb2-4e47-b8f2-a10db2c80805\") "
Jul 06 19:32:08.458734 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.458707    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc" (OuterVolumeSpecName: "kube-api-access-8nqbc") pod "ea62c914-6cb2-4e47-b8f2-a10db2c80805" (UID: "ea62c914-6cb2-4e47-b8f2-a10db2c80805"). InnerVolumeSpecName "kube-api-access-8nqbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:08.558155 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:08.558119    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nqbc\" (UniqueName: \"kubernetes.io/projected/ea62c914-6cb2-4e47-b8f2-a10db2c80805-kube-api-access-8nqbc\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:32:09.223560 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223523    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" containerID="4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5" exitCode=0
Jul 06 19:32:09.223560 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223564    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x26hl"
Jul 06 19:32:09.224144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x26hl" event={"ID":"ea62c914-6cb2-4e47-b8f2-a10db2c80805","Type":"ContainerDied","Data":"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"}
Jul 06 19:32:09.224144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x26hl" event={"ID":"ea62c914-6cb2-4e47-b8f2-a10db2c80805","Type":"ContainerDied","Data":"df4da295c125e4e2791c1321ddd86208a1b8aaa1e0c32a8b1f6b4178641dad91"}
Jul 06 19:32:09.224144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223655    2559 scope.go:117] "RemoveContainer" containerID="4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"
Jul 06 19:32:09.224144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.223684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546d5dccd-zhcpt"
Jul 06 19:32:09.233333 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.233317    2559 scope.go:117] "RemoveContainer" containerID="4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"
Jul 06 19:32:09.233664 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:32:09.233606    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5\": container with ID starting with 4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5 not found: ID does not exist" containerID="4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"
Jul 06 19:32:09.233759 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.233657    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5"} err="failed to get container status \"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5\": rpc error: code = NotFound desc = could not find container \"4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5\": container with ID starting with 4504ed592117d2162a44cb60ae0dc3175dfca8c2ab700b2ab67201de6851b0a5 not found: ID does not exist"
Jul 06 19:32:09.256581 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.256554    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:09.260586 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.260564    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x26hl"]
Jul 06 19:32:09.295561 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.295528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7546d5dccd-zhcpt"]
Jul 06 19:32:09.302101 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.302076    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7546d5dccd-zhcpt"]
Jul 06 19:32:09.915086 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.915055    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42256807-e95f-4496-a887-55f04ce6d713" path="/var/lib/kubelet/pods/42256807-e95f-4496-a887-55f04ce6d713/volumes"
Jul 06 19:32:09.915284 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:09.915273    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" path="/var/lib/kubelet/pods/ea62c914-6cb2-4e47-b8f2-a10db2c80805/volumes"
Jul 06 19:32:12.722187 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:12.722155    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:32:12.722563 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:12.722363    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9wm7w" podUID="a6276a5b-5f5d-4986-be51-f3510464d913" containerName="authorino" containerID="cri-o://86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31" gracePeriod=30
Jul 06 19:32:12.960282 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:12.960256    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:32:12.998260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:12.998173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh7mb\" (UniqueName: \"kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb\") pod \"a6276a5b-5f5d-4986-be51-f3510464d913\" (UID: \"a6276a5b-5f5d-4986-be51-f3510464d913\") "
Jul 06 19:32:13.000502 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.000473    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb" (OuterVolumeSpecName: "kube-api-access-lh7mb") pod "a6276a5b-5f5d-4986-be51-f3510464d913" (UID: "a6276a5b-5f5d-4986-be51-f3510464d913"). InnerVolumeSpecName "kube-api-access-lh7mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:13.099403 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.099364    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh7mb\" (UniqueName: \"kubernetes.io/projected/a6276a5b-5f5d-4986-be51-f3510464d913-kube-api-access-lh7mb\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:32:13.241566 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.241528    2559 generic.go:356] "Generic (PLEG): container finished" podID="a6276a5b-5f5d-4986-be51-f3510464d913" containerID="86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31" exitCode=0
Jul 06 19:32:13.241566 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.241568    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9wm7w"
Jul 06 19:32:13.241842 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.241574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9wm7w" event={"ID":"a6276a5b-5f5d-4986-be51-f3510464d913","Type":"ContainerDied","Data":"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"}
Jul 06 19:32:13.241842 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.241645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9wm7w" event={"ID":"a6276a5b-5f5d-4986-be51-f3510464d913","Type":"ContainerDied","Data":"4e1fc893ca575afbfcb0e018144b0db116411bc24243ee93529b8c5bca198a61"}
Jul 06 19:32:13.241842 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.241669    2559 scope.go:117] "RemoveContainer" containerID="86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"
Jul 06 19:32:13.250139 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.250123    2559 scope.go:117] "RemoveContainer" containerID="86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"
Jul 06 19:32:13.250364 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:32:13.250348    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31\": container with ID starting with 86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31 not found: ID does not exist" containerID="86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"
Jul 06 19:32:13.250412 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.250371    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31"} err="failed to get container status \"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31\": rpc error: code = NotFound desc = could not find container \"86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31\": container with ID starting with 86bde71062b94dc8407b8899d93eeb22a12001b497d972272eecb35f86d77b31 not found: ID does not exist"
Jul 06 19:32:13.263311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.263285    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:32:13.265482 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.265464    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9wm7w"]
Jul 06 19:32:13.914962 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:13.914926    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6276a5b-5f5d-4986-be51-f3510464d913" path="/var/lib/kubelet/pods/a6276a5b-5f5d-4986-be51-f3510464d913/volumes"
Jul 06 19:32:17.528852 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.528814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.549284 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549250    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:17.549684 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549668    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6276a5b-5f5d-4986-be51-f3510464d913" containerName="authorino"
Jul 06 19:32:17.549753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549686    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6276a5b-5f5d-4986-be51-f3510464d913" containerName="authorino"
Jul 06 19:32:17.549753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549700    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" containerName="authorino"
Jul 06 19:32:17.549753 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549705    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" containerName="authorino"
Jul 06 19:32:17.549874 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549787    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea62c914-6cb2-4e47-b8f2-a10db2c80805" containerName="authorino"
Jul 06 19:32:17.549874 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.549799    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6276a5b-5f5d-4986-be51-f3510464d913" containerName="authorino"
Jul 06 19:32:17.552241 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.552226    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.557484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.557460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:32:17.557687 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.557601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mhhmj\""
Jul 06 19:32:17.557687 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.557593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:32:17.638195 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.638165    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:17.640522 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.640493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.640700 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.640581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kjs7\" (UniqueName: \"kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.710116 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.710069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.742112 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.742072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.742320 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.742125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjs7\" (UniqueName: \"kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.744604 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.744584    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.760249 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.760210    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjs7\" (UniqueName: \"kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7\") pod \"maas-controller-6b88889fd8-lrhhr\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") " pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.774115 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.774085    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:32:17.776352 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.776338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.798510 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.798475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:32:17.843436 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.843404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.843613 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.843451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2v2\" (UniqueName: \"kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.854050 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.854019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.861861 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.861834    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:17.944394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.944309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.944394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.944364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2v2\" (UniqueName: \"kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.946697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.946668    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:17.959038 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:17.959006    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2v2\" (UniqueName: \"kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2\") pod \"maas-controller-5f86b54c6f-dtbdf\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") " pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:18.019043 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:18.019013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:18.020934 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:32:18.020905    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a4870d_ebc5_40a6_ae9e_78e0395c7a07.slice/crio-03221c6af5ad6f0dff68acf334957b7d01189ccb50e64b190612ca48db64b071 WatchSource:0}: Error finding container 03221c6af5ad6f0dff68acf334957b7d01189ccb50e64b190612ca48db64b071: Status 404 returned error can't find the container with id 03221c6af5ad6f0dff68acf334957b7d01189ccb50e64b190612ca48db64b071
Jul 06 19:32:18.086738 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:18.086650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:18.234797 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:18.234767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:32:18.237999 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:32:18.237974    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087939a9_cb4a_4dd6_b891_bee5f53d9f92.slice/crio-3c064577a1674d931a79be11d31212972a879f35b1a3f760d0583220a495262c WatchSource:0}: Error finding container 3c064577a1674d931a79be11d31212972a879f35b1a3f760d0583220a495262c: Status 404 returned error can't find the container with id 3c064577a1674d931a79be11d31212972a879f35b1a3f760d0583220a495262c
Jul 06 19:32:18.266417 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:18.266386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerStarted","Data":"3c064577a1674d931a79be11d31212972a879f35b1a3f760d0583220a495262c"}
Jul 06 19:32:18.267390 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:18.267370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" event={"ID":"47a4870d-ebc5-40a6-ae9e-78e0395c7a07","Type":"ContainerStarted","Data":"03221c6af5ad6f0dff68acf334957b7d01189ccb50e64b190612ca48db64b071"}
Jul 06 19:32:21.234686 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.234567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:21.288141 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.288103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerStarted","Data":"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"}
Jul 06 19:32:21.288328 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.288211    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:21.289615 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.289594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" event={"ID":"47a4870d-ebc5-40a6-ae9e-78e0395c7a07","Type":"ContainerStarted","Data":"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"}
Jul 06 19:32:21.289747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.289685    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:21.366368 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.366315    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" podStartSLOduration=1.694164011 podStartE2EDuration="4.366297261s" totalImagesPullingTime="2.67213325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:21.364949004 +0000 UTC m=+564.002447732" watchObservedRunningTime="2026-07-06 19:32:21.366297261 +0000 UTC m=+564.003795990"
Jul 06 19:32:21.424005 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.423954    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" podStartSLOduration=1.5241454700000001 podStartE2EDuration="4.423939624s" totalImagesPullingTime="2.899794154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:21.423386123 +0000 UTC m=+564.060884855" watchObservedRunningTime="2026-07-06 19:32:21.423939624 +0000 UTC m=+564.061438351"
Jul 06 19:32:21.515351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:21.515255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:32.305524 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.305493    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:32:32.305971 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.305678    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:32.399667 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.399621    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:32.399842 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.399816    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" podUID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" containerName="manager" containerID="cri-o://be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908" gracePeriod=30
Jul 06 19:32:32.635560 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.635533    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:32.794240 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.794206    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert\") pod \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") "
Jul 06 19:32:32.794418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.794310    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kjs7\" (UniqueName: \"kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7\") pod \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\" (UID: \"47a4870d-ebc5-40a6-ae9e-78e0395c7a07\") "
Jul 06 19:32:32.796388 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.796359    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7" (OuterVolumeSpecName: "kube-api-access-8kjs7") pod "47a4870d-ebc5-40a6-ae9e-78e0395c7a07" (UID: "47a4870d-ebc5-40a6-ae9e-78e0395c7a07"). InnerVolumeSpecName "kube-api-access-8kjs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:32.796503 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.796458    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "47a4870d-ebc5-40a6-ae9e-78e0395c7a07" (UID: "47a4870d-ebc5-40a6-ae9e-78e0395c7a07"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:32:32.900396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.896185    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-webhook-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.900396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:32.896228    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kjs7\" (UniqueName: \"kubernetes.io/projected/47a4870d-ebc5-40a6-ae9e-78e0395c7a07-kube-api-access-8kjs7\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:32:33.346844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.346746    2559 generic.go:356] "Generic (PLEG): container finished" podID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" containerID="be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908" exitCode=0
Jul 06 19:32:33.346844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.346801    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b88889fd8-lrhhr"
Jul 06 19:32:33.346844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.346805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" event={"ID":"47a4870d-ebc5-40a6-ae9e-78e0395c7a07","Type":"ContainerDied","Data":"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"}
Jul 06 19:32:33.347344 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.346858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b88889fd8-lrhhr" event={"ID":"47a4870d-ebc5-40a6-ae9e-78e0395c7a07","Type":"ContainerDied","Data":"03221c6af5ad6f0dff68acf334957b7d01189ccb50e64b190612ca48db64b071"}
Jul 06 19:32:33.347344 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.346885    2559 scope.go:117] "RemoveContainer" containerID="be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"
Jul 06 19:32:33.355518 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.355501    2559 scope.go:117] "RemoveContainer" containerID="be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"
Jul 06 19:32:33.355822 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:32:33.355802    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908\": container with ID starting with be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908 not found: ID does not exist" containerID="be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"
Jul 06 19:32:33.355884 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.355831    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908"} err="failed to get container status \"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908\": rpc error: code = NotFound desc = could not find container \"be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908\": container with ID starting with be38d38d776c83e2abb80df0d35c797e01033049b0652556429ba052470f8908 not found: ID does not exist"
Jul 06 19:32:33.370218 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.370195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:33.380297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.380271    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b88889fd8-lrhhr"]
Jul 06 19:32:33.915046 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:33.915009    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" path="/var/lib/kubelet/pods/47a4870d-ebc5-40a6-ae9e-78e0395c7a07/volumes"
Jul 06 19:32:56.510866 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:56.510823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:56.899955 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:56.899921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:57.001320 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.001283    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7f95bfd9ff-vsblg"]
Jul 06 19:32:57.001800 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.001782    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" containerName="manager"
Jul 06 19:32:57.001800 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.001801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" containerName="manager"
Jul 06 19:32:57.001932 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.001886    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a4870d-ebc5-40a6-ae9e-78e0395c7a07" containerName="manager"
Jul 06 19:32:57.003708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.003691    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.008286 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.008260    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vwbwq\""
Jul 06 19:32:57.008286 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.008260    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 19:32:57.035984 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.035942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7f95bfd9ff-vsblg"]
Jul 06 19:32:57.042236 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.042209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:57.094220 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.094182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e850616-6ef9-4dc2-a322-89d3f3efdd31-maas-api-tls\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.094220 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.094224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e850616-6ef9-4dc2-a322-89d3f3efdd31-openshift-service-ca\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.094448 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.094338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt647\" (UniqueName: \"kubernetes.io/projected/0e850616-6ef9-4dc2-a322-89d3f3efdd31-kube-api-access-gt647\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.195774 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.195697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e850616-6ef9-4dc2-a322-89d3f3efdd31-maas-api-tls\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.195774 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.195750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e850616-6ef9-4dc2-a322-89d3f3efdd31-openshift-service-ca\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.195950 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.195827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt647\" (UniqueName: \"kubernetes.io/projected/0e850616-6ef9-4dc2-a322-89d3f3efdd31-kube-api-access-gt647\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.196467 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.196448    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e850616-6ef9-4dc2-a322-89d3f3efdd31-openshift-service-ca\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.198168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.198144    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e850616-6ef9-4dc2-a322-89d3f3efdd31-maas-api-tls\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.206645 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.206607    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt647\" (UniqueName: \"kubernetes.io/projected/0e850616-6ef9-4dc2-a322-89d3f3efdd31-kube-api-access-gt647\") pod \"maas-api-7f95bfd9ff-vsblg\" (UID: \"0e850616-6ef9-4dc2-a322-89d3f3efdd31\") " pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.313243 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.313207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:57.454562 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.454482    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7f95bfd9ff-vsblg"]
Jul 06 19:32:57.457682 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:32:57.457653    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e850616_6ef9_4dc2_a322_89d3f3efdd31.slice/crio-848532eea39906a2d2cf1a4bb1049758b1a5d2d5f862d113de6dae9f1816d5a9 WatchSource:0}: Error finding container 848532eea39906a2d2cf1a4bb1049758b1a5d2d5f862d113de6dae9f1816d5a9: Status 404 returned error can't find the container with id 848532eea39906a2d2cf1a4bb1049758b1a5d2d5f862d113de6dae9f1816d5a9
Jul 06 19:32:57.486543 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.486494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:57.598424 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.598382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:57.698856 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:57.698818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:32:58.453641 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:58.453595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f95bfd9ff-vsblg" event={"ID":"0e850616-6ef9-4dc2-a322-89d3f3efdd31","Type":"ContainerStarted","Data":"848532eea39906a2d2cf1a4bb1049758b1a5d2d5f862d113de6dae9f1816d5a9"}
Jul 06 19:32:59.459001 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:59.458910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f95bfd9ff-vsblg" event={"ID":"0e850616-6ef9-4dc2-a322-89d3f3efdd31","Type":"ContainerStarted","Data":"49cc0efe8f2884f31f456c120d3da9c3e7a56f55711bf37c8c3def55d86cdb7f"}
Jul 06 19:32:59.459380 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:59.459013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:32:59.491253 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:32:59.491199    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7f95bfd9ff-vsblg" podStartSLOduration=1.79993217 podStartE2EDuration="3.491181841s" totalImagesPullingTime="1.691249671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:59.48891949 +0000 UTC m=+602.126418217" watchObservedRunningTime="2026-07-06 19:32:59.491181841 +0000 UTC m=+602.128680568"
Jul 06 19:33:05.470092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:05.470060    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7f95bfd9ff-vsblg"
Jul 06 19:33:07.851598 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:07.851559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:08.044441 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:08.044403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:22.428431 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:22.428338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:22.656250 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:22.656219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:23.219651 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:23.219598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:33:35.999358 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:35.999327    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"]
Jul 06 19:33:36.001782 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.001766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.003983 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.003963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-spm8h\""
Jul 06 19:33:36.005152 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.005134    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:33:36.005701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.005678    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 19:33:36.005701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.005682    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:33:36.016573 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.016550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"]
Jul 06 19:33:36.023702 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.023835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.023835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/572df269-a5cc-4c2a-81c5-5e7d818be703-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.023965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtjp\" (UniqueName: \"kubernetes.io/projected/572df269-a5cc-4c2a-81c5-5e7d818be703-kube-api-access-cvtjp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.023965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.023965 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.023922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.040185 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.040161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:36.124798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.124798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/572df269-a5cc-4c2a-81c5-5e7d818be703-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtjp\" (UniqueName: \"kubernetes.io/projected/572df269-a5cc-4c2a-81c5-5e7d818be703-kube-api-access-cvtjp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125061 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.124969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125295 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.125262    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125363 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.125309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.125363 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.125341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.127081 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.127063    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/572df269-a5cc-4c2a-81c5-5e7d818be703-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.127383 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.127367    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/572df269-a5cc-4c2a-81c5-5e7d818be703-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.135218 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.135195    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtjp\" (UniqueName: \"kubernetes.io/projected/572df269-a5cc-4c2a-81c5-5e7d818be703-kube-api-access-cvtjp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrhxf\" (UID: \"572df269-a5cc-4c2a-81c5-5e7d818be703\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.311676 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.311567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:36.443169 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.443143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"]
Jul 06 19:33:36.445696 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:33:36.445672    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572df269_a5cc_4c2a_81c5_5e7d818be703.slice/crio-172d8e8796dc908bbb748c116be28e2e97436ec62c3d3afbad5f0f4a3f72430b WatchSource:0}: Error finding container 172d8e8796dc908bbb748c116be28e2e97436ec62c3d3afbad5f0f4a3f72430b: Status 404 returned error can't find the container with id 172d8e8796dc908bbb748c116be28e2e97436ec62c3d3afbad5f0f4a3f72430b
Jul 06 19:33:36.446991 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.446972    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:33:36.622917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.622885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf" event={"ID":"572df269-a5cc-4c2a-81c5-5e7d818be703","Type":"ContainerStarted","Data":"172d8e8796dc908bbb748c116be28e2e97436ec62c3d3afbad5f0f4a3f72430b"}
Jul 06 19:33:36.702166 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:36.702118    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:33:37.629484 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:37.629443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf" event={"ID":"572df269-a5cc-4c2a-81c5-5e7d818be703","Type":"ContainerStarted","Data":"eee0593ebbd996e1763812fb3dd6a4ad494e31db159c5ff6a39da91ffd8d31f0"}
Jul 06 19:33:37.651880 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:37.651826    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf" podStartSLOduration=1.667778999 podStartE2EDuration="2.651809761s" totalImagesPullingTime="984.030762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:37.649858108 +0000 UTC m=+640.287356836" watchObservedRunningTime="2026-07-06 19:33:37.651809761 +0000 UTC m=+640.289308522"
Jul 06 19:33:40.115297 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.115255    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"]
Jul 06 19:33:40.117849 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.117828    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.122023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.122003    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 19:33:40.162223 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnr9\" (UniqueName: \"kubernetes.io/projected/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-kube-api-access-hlnr9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.162223 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.162501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.162501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.162501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.162501 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.162374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.182488 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.182455    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"]
Jul 06 19:33:40.220084 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.220053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:40.263789 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnr9\" (UniqueName: \"kubernetes.io/projected/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-kube-api-access-hlnr9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.263974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.263974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.263974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.263974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.263974 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.263909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.264392 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.264367    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.264487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.264432    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.264487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.264442    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.266122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.266105    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.266278 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.266263    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.280837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.280816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnr9\" (UniqueName: \"kubernetes.io/projected/63cb3fd8-3d49-4ea0-ab3d-a59c156c132b-kube-api-access-hlnr9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5qvz\" (UID: \"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.427953 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.427921    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:40.568751 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.568726    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"]
Jul 06 19:33:40.571266 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:33:40.571236    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cb3fd8_3d49_4ea0_ab3d_a59c156c132b.slice/crio-858be8c1711e26cd68587fa75ea53416af0148cabff1f0ae83fafedf7f5d4c3f WatchSource:0}: Error finding container 858be8c1711e26cd68587fa75ea53416af0148cabff1f0ae83fafedf7f5d4c3f: Status 404 returned error can't find the container with id 858be8c1711e26cd68587fa75ea53416af0148cabff1f0ae83fafedf7f5d4c3f
Jul 06 19:33:40.642817 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:40.642780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz" event={"ID":"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b","Type":"ContainerStarted","Data":"858be8c1711e26cd68587fa75ea53416af0148cabff1f0ae83fafedf7f5d4c3f"}
Jul 06 19:33:41.209695 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:41.209653    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:33:41.648973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:41.648938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz" event={"ID":"63cb3fd8-3d49-4ea0-ab3d-a59c156c132b","Type":"ContainerStarted","Data":"9d9d962e526cee1ea5f92525399d439448b3d0fcd6ed3bbe2bf038edf1feb0de"}
Jul 06 19:33:41.673910 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:41.673861    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz" podStartSLOduration=1.5156088319999999 podStartE2EDuration="1.673844747s" totalImagesPullingTime="158.235915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:41.673260791 +0000 UTC m=+644.310759521" watchObservedRunningTime="2026-07-06 19:33:41.673844747 +0000 UTC m=+644.311343475"
Jul 06 19:33:46.056824 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:46.056785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:46.312783 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:46.312680    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:46.312783 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:46.312748    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:46.325045 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:46.325018    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:46.683508 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:46.683480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrhxf"
Jul 06 19:33:47.433804 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:47.433775    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:33:50.428724 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:50.428689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:50.429157 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:50.428749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:50.441323 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:50.441291    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:33:50.701042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:33:50.700945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5qvz"
Jul 06 19:34:09.940652 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:09.940600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:11.820003 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:11.819970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:34:19.866900 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:19.866868    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"]
Jul 06 19:34:19.870315 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:19.870293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:19.872898 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:19.872880    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 19:34:19.905707 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:19.905674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"]
Jul 06 19:34:19.987763 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:19.987720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:20.017860 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.017824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmhs\" (UniqueName: \"kubernetes.io/projected/ab06d6e6-31c4-4099-9514-4dda0e83b71c-kube-api-access-pfmhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.018067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.017874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.018067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.017938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.018067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.017970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.018067 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.018045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.018256 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.018090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.118832 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.118800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119021 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.118843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119021 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.118863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119021 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.118889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119021 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.118941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmhs\" (UniqueName: \"kubernetes.io/projected/ab06d6e6-31c4-4099-9514-4dda0e83b71c-kube-api-access-pfmhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119253 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.119077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119310 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.119273    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.119311    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.119497 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.119477    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.121229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.121205    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab06d6e6-31c4-4099-9514-4dda0e83b71c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.121345 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.121327    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab06d6e6-31c4-4099-9514-4dda0e83b71c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.132235 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.132204    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmhs\" (UniqueName: \"kubernetes.io/projected/ab06d6e6-31c4-4099-9514-4dda0e83b71c-kube-api-access-pfmhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb\" (UID: \"ab06d6e6-31c4-4099-9514-4dda0e83b71c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.178897 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.178860    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:20.332716 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.332687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"]
Jul 06 19:34:20.348354 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:34:20.348330    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab06d6e6_31c4_4099_9514_4dda0e83b71c.slice/crio-b9dc7db16171393940b8808b07bcdd4cf99fa3fb40cf313d26f4ed1d9b6f3242 WatchSource:0}: Error finding container b9dc7db16171393940b8808b07bcdd4cf99fa3fb40cf313d26f4ed1d9b6f3242: Status 404 returned error can't find the container with id b9dc7db16171393940b8808b07bcdd4cf99fa3fb40cf313d26f4ed1d9b6f3242
Jul 06 19:34:20.819092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.819001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb" event={"ID":"ab06d6e6-31c4-4099-9514-4dda0e83b71c","Type":"ContainerStarted","Data":"dfb2a6b201587e076f4c7c758d741287013a01b8d86b723987480d07a61d726b"}
Jul 06 19:34:20.819092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.819040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb" event={"ID":"ab06d6e6-31c4-4099-9514-4dda0e83b71c","Type":"ContainerStarted","Data":"b9dc7db16171393940b8808b07bcdd4cf99fa3fb40cf313d26f4ed1d9b6f3242"}
Jul 06 19:34:20.883255 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:20.883200    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb" podStartSLOduration=1.713484609 podStartE2EDuration="1.883183646s" totalImagesPullingTime="169.699037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:20.883176053 +0000 UTC m=+683.520674782" watchObservedRunningTime="2026-07-06 19:34:20.883183646 +0000 UTC m=+683.520682373"
Jul 06 19:34:22.685322 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:22.685289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:34:30.179270 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:30.179224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:30.179886 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:30.179295    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:30.191766 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:30.191743    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:34:30.874986 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:34:30.874962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb"
Jul 06 19:35:13.415004 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:13.414916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:30.081282 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.081240    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-659fdf87bc-nl8rm"]
Jul 06 19:35:30.083835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.083813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.086611 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.086593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:35:30.087450 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.087434    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j85kz\""
Jul 06 19:35:30.094722 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.094696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-659fdf87bc-nl8rm"]
Jul 06 19:35:30.148674 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.148641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18148b66-6c0a-40a4-8f44-2f91e7bdec45-tls-cert\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.148843 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.148679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r45n\" (UniqueName: \"kubernetes.io/projected/18148b66-6c0a-40a4-8f44-2f91e7bdec45-kube-api-access-9r45n\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.250034 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.249997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18148b66-6c0a-40a4-8f44-2f91e7bdec45-tls-cert\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.250034 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.250034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r45n\" (UniqueName: \"kubernetes.io/projected/18148b66-6c0a-40a4-8f44-2f91e7bdec45-kube-api-access-9r45n\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.252390 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.252360    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18148b66-6c0a-40a4-8f44-2f91e7bdec45-tls-cert\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.258826 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.258803    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r45n\" (UniqueName: \"kubernetes.io/projected/18148b66-6c0a-40a4-8f44-2f91e7bdec45-kube-api-access-9r45n\") pod \"authorino-659fdf87bc-nl8rm\" (UID: \"18148b66-6c0a-40a4-8f44-2f91e7bdec45\") " pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.392919 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.392886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-659fdf87bc-nl8rm"
Jul 06 19:35:30.508147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.508117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:30.539957 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:30.539929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-659fdf87bc-nl8rm"]
Jul 06 19:35:30.541167 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:35:30.541141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18148b66_6c0a_40a4_8f44_2f91e7bdec45.slice/crio-d493903503451f321bfb36c9cc883b1b05bb81e37a18fae6249daceac7b6a338 WatchSource:0}: Error finding container d493903503451f321bfb36c9cc883b1b05bb81e37a18fae6249daceac7b6a338: Status 404 returned error can't find the container with id d493903503451f321bfb36c9cc883b1b05bb81e37a18fae6249daceac7b6a338
Jul 06 19:35:31.122108 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:31.122074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-659fdf87bc-nl8rm" event={"ID":"18148b66-6c0a-40a4-8f44-2f91e7bdec45","Type":"ContainerStarted","Data":"ab625200bd1a40692f6021adb9e713b76c0c5548eba25bd2c67cb87841f4d0a9"}
Jul 06 19:35:31.122108 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:31.122111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-659fdf87bc-nl8rm" event={"ID":"18148b66-6c0a-40a4-8f44-2f91e7bdec45","Type":"ContainerStarted","Data":"d493903503451f321bfb36c9cc883b1b05bb81e37a18fae6249daceac7b6a338"}
Jul 06 19:35:31.149152 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:31.149090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-659fdf87bc-nl8rm" podStartSLOduration=0.781615409 podStartE2EDuration="1.149065996s" totalImagesPullingTime="367.450587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:31.148547729 +0000 UTC m=+753.786046458" watchObservedRunningTime="2026-07-06 19:35:31.149065996 +0000 UTC m=+753.786564725"
Jul 06 19:35:32.148695 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:32.148660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:53.295486 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:53.295438    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:35:54.230843 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:54.230757    2559 generic.go:356] "Generic (PLEG): container finished" podID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerID="f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55" exitCode=1
Jul 06 19:35:54.230843 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:54.230817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerDied","Data":"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"}
Jul 06 19:35:54.231154 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:54.231141    2559 scope.go:117] "RemoveContainer" containerID="f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"
Jul 06 19:35:54.403504 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:35:54.403457    2559 controller.go:195] "Failed to update lease" err="Put \"https://a7094b167326a4c82a83b6b901f5856c-474eb07a5e9b8c2e.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-135-41.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:35:55.237307 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:55.237272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerStarted","Data":"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"}
Jul 06 19:35:55.237538 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:55.237522    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:35:57.966798 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:35:57.966770    2559 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-135-41.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 06 19:35:58.037451 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:58.037378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:58.217176 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:58.217083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:59.013250 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:35:59.013218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:06.247122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:06.247092    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:36:18.351970 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:18.351936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:36:31.108645 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:31.108600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:36:41.097048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:41.097014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:36:54.109286 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:54.109246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:36:59.878621 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:59.878584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:59.979437 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:36:59.979407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:03.004091 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:03.004056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:37:09.491902 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:09.491856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:09.648063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:09.648032    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:37:09.648250 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:09.648218    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager" containerID="cri-o://0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d" gracePeriod=30
Jul 06 19:37:09.892935 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:09.892913    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:37:10.030794 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.030705    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert\") pod \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") "
Jul 06 19:37:10.030794 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.030745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf2v2\" (UniqueName: \"kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2\") pod \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\" (UID: \"087939a9-cb4a-4dd6-b891-bee5f53d9f92\") "
Jul 06 19:37:10.032835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.032802    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "087939a9-cb4a-4dd6-b891-bee5f53d9f92" (UID: "087939a9-cb4a-4dd6-b891-bee5f53d9f92"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:10.032835 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.032824    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2" (OuterVolumeSpecName: "kube-api-access-qf2v2") pod "087939a9-cb4a-4dd6-b891-bee5f53d9f92" (UID: "087939a9-cb4a-4dd6-b891-bee5f53d9f92"). InnerVolumeSpecName "kube-api-access-qf2v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:10.132263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.132226    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/087939a9-cb4a-4dd6-b891-bee5f53d9f92-webhook-cert\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:37:10.132263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.132255    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf2v2\" (UniqueName: \"kubernetes.io/projected/087939a9-cb4a-4dd6-b891-bee5f53d9f92-kube-api-access-qf2v2\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:37:10.580969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.580935    2559 generic.go:356] "Generic (PLEG): container finished" podID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerID="0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d" exitCode=0
Jul 06 19:37:10.581374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.580978    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf"
Jul 06 19:37:10.581374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.581020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerDied","Data":"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"}
Jul 06 19:37:10.581374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.581072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-dtbdf" event={"ID":"087939a9-cb4a-4dd6-b891-bee5f53d9f92","Type":"ContainerDied","Data":"3c064577a1674d931a79be11d31212972a879f35b1a3f760d0583220a495262c"}
Jul 06 19:37:10.581374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.581095    2559 scope.go:117] "RemoveContainer" containerID="0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"
Jul 06 19:37:10.592350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.592334    2559 scope.go:117] "RemoveContainer" containerID="f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"
Jul 06 19:37:10.600046 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.600023    2559 scope.go:117] "RemoveContainer" containerID="0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"
Jul 06 19:37:10.600298 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:37:10.600279    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d\": container with ID starting with 0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d not found: ID does not exist" containerID="0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"
Jul 06 19:37:10.600361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.600305    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d"} err="failed to get container status \"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d\": rpc error: code = NotFound desc = could not find container \"0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d\": container with ID starting with 0f8443c67bf1f5a701ff4b742eb8131a2f9448f717790de6b75fc8580d46ac2d not found: ID does not exist"
Jul 06 19:37:10.600361 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.600322    2559 scope.go:117] "RemoveContainer" containerID="f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"
Jul 06 19:37:10.600551 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:37:10.600538    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55\": container with ID starting with f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55 not found: ID does not exist" containerID="f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"
Jul 06 19:37:10.600595 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.600554    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55"} err="failed to get container status \"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55\": rpc error: code = NotFound desc = could not find container \"f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55\": container with ID starting with f3b03d67e4f34430bc7136d8fc1bda628004878a7ec74354764ebee471a30f55 not found: ID does not exist"
Jul 06 19:37:10.609302 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.609278    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:37:10.615290 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.615268    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-dtbdf"]
Jul 06 19:37:10.913767 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:10.913741    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:37:11.297669 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.297570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:11.401900 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.401868    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-9rpnk"]
Jul 06 19:37:11.402244 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402214    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.402244 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402232    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.402244 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402244    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.402244 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402250    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.402537 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402309    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.402537 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.402321    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" containerName="manager"
Jul 06 19:37:11.406603 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.406578    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.409706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.409684    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:37:11.410335 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.410316    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:37:11.410446 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.410320    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mhhmj\""
Jul 06 19:37:11.417743 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.417720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-9rpnk"]
Jul 06 19:37:11.543541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.543500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-webhook-cert\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.543749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.543554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dbgq\" (UniqueName: \"kubernetes.io/projected/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-kube-api-access-2dbgq\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.644916 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.644883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-webhook-cert\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.645306 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.644927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dbgq\" (UniqueName: \"kubernetes.io/projected/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-kube-api-access-2dbgq\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.647295 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.647274    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-webhook-cert\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.653706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.653685    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dbgq\" (UniqueName: \"kubernetes.io/projected/e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8-kube-api-access-2dbgq\") pod \"maas-controller-5f86b54c6f-9rpnk\" (UID: \"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\") " pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.717894 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.717848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:11.869547 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.869523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f86b54c6f-9rpnk"]
Jul 06 19:37:11.872429 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:37:11.872403    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a6ddca_abc9_4f74_a7d0_4e2f59fd26e8.slice/crio-c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84 WatchSource:0}: Error finding container c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84: Status 404 returned error can't find the container with id c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84
Jul 06 19:37:11.915163 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:11.915079    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087939a9-cb4a-4dd6-b891-bee5f53d9f92" path="/var/lib/kubelet/pods/087939a9-cb4a-4dd6-b891-bee5f53d9f92/volumes"
Jul 06 19:37:12.592825 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:12.592740    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerStarted","Data":"feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40"}
Jul 06 19:37:12.592825 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:12.592788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerStarted","Data":"c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84"}
Jul 06 19:37:12.593013 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:12.592831    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:12.614094 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:12.614047    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podStartSLOduration=1.175491462 podStartE2EDuration="1.61403148s" totalImagesPullingTime="438.540018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:12.612218697 +0000 UTC m=+855.249717428" watchObservedRunningTime="2026-07-06 19:37:12.61403148 +0000 UTC m=+855.251530209"
Jul 06 19:37:23.603229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:23.603194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:37:32.433693 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:32.433659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:36.056914 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:36.056826    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:37:54.598937 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:37:54.598845    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:38:00.762246 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:00.762206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:04.599147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:04.599098    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:38:05.910606 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:05.910564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:10.443683 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:10.443645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:13.305755 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:13.305719    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:38:13.705917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:13.705885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:13.804609 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:13.804576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:14.005834 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:14.005748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:20.057048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:20.057005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:20.162614 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:20.162584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:20.291594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:20.291557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:20.457660 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:20.457599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:26.315305 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:26.315275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:38:26.722085 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:26.722045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:26.909319 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:26.909285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:43.115526 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:43.115491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:38:46.603426 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:46.603390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:46.695121 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:46.695086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:53.309606 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:38:53.309574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:39:00.609215 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:00.609181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:01.402380 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:01.402348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:39:10.906430 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:10.906390    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:39:24.598583 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:24.598497    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:39:25.562888 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:25.562857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:30.207602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:30.207560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:39:34.599122 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:34.599067    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:39:36.233814 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:36.233773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:36.361305 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:36.361266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:44.225668 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:44.225614    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:39:54.710206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:39:54.710171    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:40:04.524967 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:04.524927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:40:27.629898 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:27.629859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:40:34.598939 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:34.598895    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:40:40.454213 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:40:40.454182    2559 container.go:598] Failed to update stats for container "/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a6ddca_abc9_4f74_a7d0_4e2f59fd26e8.slice/crio-c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84": error while statting cgroup v2: [read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a6ddca_abc9_4f74_a7d0_4e2f59fd26e8.slice/crio-c37b8e074dc0d071223b76cbae38ff954b2fdbe2f1efd461dbfa92ab9e9f5d84/pids.max: no such device], continuing to push stats
Jul 06 19:40:40.523228 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.523197    2559 generic.go:356] "Generic (PLEG): container finished" podID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerID="feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40" exitCode=1
Jul 06 19:40:40.523413 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.523270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerDied","Data":"feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40"}
Jul 06 19:40:40.523653 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.523618    2559 scope.go:117] "RemoveContainer" containerID="feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40"
Jul 06 19:40:40.523984 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.523969    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:40:40.525221 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.525202    2559 generic.go:356] "Generic (PLEG): container finished" podID="7a1b3544-58a9-48ea-9de1-af3217c0b023" containerID="5febb61ef9df512270a8297d80a5d8d7db11658fb468e7483ab74a14d4f7f014" exitCode=1
Jul 06 19:40:40.525316 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.525281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerDied","Data":"5febb61ef9df512270a8297d80a5d8d7db11658fb468e7483ab74a14d4f7f014"}
Jul 06 19:40:40.525637 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:40.525607    2559 scope.go:117] "RemoveContainer" containerID="5febb61ef9df512270a8297d80a5d8d7db11658fb468e7483ab74a14d4f7f014"
Jul 06 19:40:41.532139 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:41.532042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerStarted","Data":"1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e"}
Jul 06 19:40:41.532598 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:41.532309    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:40:41.534311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:41.534290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s" event={"ID":"7a1b3544-58a9-48ea-9de1-af3217c0b023","Type":"ContainerStarted","Data":"7a9a4d72b646c33fbe6bee426e578bfe1ee3b127db7aaeb4ca2f6d1099808195"}
Jul 06 19:40:41.534488 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:41.534475    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:40:43.406057 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:43.406017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:44.945417 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:44.945382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:52.539987 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:52.539910    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7865995f8c-wpt2s"
Jul 06 19:40:52.543597 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:52.543576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:40:55.759949 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:40:55.759911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:56.292831 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:40:56.292779    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-06T19:40:40Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-06T19:40:40Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"64Mi\\\"},\\\"containerID\\\":\\\"cri-o://feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40\\\",\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:cc8d1d26400d3357a6c6b21836d25cc5461350210d591555b9e7c038b2eacd26\\\",\\\"imageID\\\":\\\"quay.io/opendatahub/maas-controller@sha256:582785e6f981cadb0d87c4ca6de2a0a7106e3b9bd4cd9cc5cadca31bb27a1917\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"500m\\\",\\\"memory\\\":\\\"512Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"64Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-06T19:40:40Z\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-06T19:37:12Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000660000],\\\"uid\\\":1000660000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2dbgq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"opendatahub\"/\"maas-controller-5f86b54c6f-9rpnk\": Internal error occurred: admission plugin \"ValidatingAdmissionWebhook\" failed to complete validation in 13s" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:41:05.849351 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:05.849302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:23.538911 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:23.538866    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:33.287415 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.287380    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": EOF"
Jul 06 19:41:33.768451 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.768413    2559 generic.go:356] "Generic (PLEG): container finished" podID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerID="1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e" exitCode=1
Jul 06 19:41:33.768685 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.768480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerDied","Data":"1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e"}
Jul 06 19:41:33.768685 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.768536    2559 scope.go:117] "RemoveContainer" containerID="feb83657ece4ade324ca645b9fc4e0cb94dcca85b5dc8102f166c2f6038bcd40"
Jul 06 19:41:33.768916 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.768901    2559 scope.go:117] "RemoveContainer" containerID="1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e"
Jul 06 19:41:33.769118 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:41:33.769099    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-5f86b54c6f-9rpnk_opendatahub(e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8)\"" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8"
Jul 06 19:41:33.770133 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.770110    2559 generic.go:356] "Generic (PLEG): container finished" podID="0e768003-c4e1-4f3f-bc6f-67cd06404e2a" containerID="eba412f911b222775faadc75bf80b39eb6304c0e7869bfde97d1feccaf0bd491" exitCode=1
Jul 06 19:41:33.770211 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.770188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5" event={"ID":"0e768003-c4e1-4f3f-bc6f-67cd06404e2a","Type":"ContainerDied","Data":"eba412f911b222775faadc75bf80b39eb6304c0e7869bfde97d1feccaf0bd491"}
Jul 06 19:41:33.770511 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:33.770499    2559 scope.go:117] "RemoveContainer" containerID="eba412f911b222775faadc75bf80b39eb6304c0e7869bfde97d1feccaf0bd491"
Jul 06 19:41:33.899787 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:41:33.899747    2559 controller.go:195] "Failed to update lease" err="Put \"https://a7094b167326a4c82a83b6b901f5856c-474eb07a5e9b8c2e.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-135-41.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:34.324834 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:34.324797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:41:34.778295 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:34.778256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5" event={"ID":"0e768003-c4e1-4f3f-bc6f-67cd06404e2a","Type":"ContainerStarted","Data":"399984ed911d6ffd0ef15422e325763709234b95bc3bdbe12439d3b7557f71d2"}
Jul 06 19:41:34.778465 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:34.778355    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:41:36.182192 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:36.182145    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" podUID="01a71ea3922c1a01f528cd43e38bc2b2" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Jul 06 19:41:39.701449 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:39.701416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:40.323289 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:40.323256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:42.538786 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:42.538754    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:41:42.539169 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:42.539158    2559 scope.go:117] "RemoveContainer" containerID="1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e"
Jul 06 19:41:42.539371 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:41:42.539350    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-5f86b54c6f-9rpnk_opendatahub(e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8)\"" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8"
Jul 06 19:41:45.784788 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:45.784760    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54d6cd8878-bnkn5"
Jul 06 19:41:46.150833 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:46.150801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:46.741368 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:46.741333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:51.718593 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:51.718562    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:41:51.718998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:51.718911    2559 scope.go:117] "RemoveContainer" containerID="1977f342155179f6055f1740ca5975a34087d981c6448cf5cab8d71c54a04a0e"
Jul 06 19:41:52.858508 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:52.858476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" event={"ID":"e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8","Type":"ContainerStarted","Data":"d2ba0d5656472f5d01a23ae2bfed08eb6f0942f207937ae222483c6ca97cf0f5"}
Jul 06 19:41:52.858910 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:52.858677    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:41:59.599462 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:41:59.599407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:03.870374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:03.870334    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk"
Jul 06 19:42:06.099536 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:06.099497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:08.062980 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:08.062940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:09.409105 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:09.409069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:09.596744 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:09.596711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:10.523990 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:10.523955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:13.847274 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:13.847236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:16.607504 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:16.607473    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:19.955184 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:19.955091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:20.539602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:20.539547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:20.770496 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:20.770462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:23.437825 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:23.437789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:34.070917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:34.070885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:36.086367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:36.086329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:39.620199 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:39.620151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:42:41.562359 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:41.562314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:52.708101 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:52.708056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:54.033517 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:42:54.033470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:04.701850 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:04.701804    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:43:14.960222 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:14.960187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:15.040900 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:15.040872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:15.496194 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:15.496156    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:43:19.731933 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:19.731896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:20.735608 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:20.735559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:25.007099 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:43:25.007069    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:44:55.895701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:44:55.895670    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:45:10.748641 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:45:10.748596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:45:19.826943 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:45:19.826862    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:45:29.240194 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:45:29.240163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:45:38.216689 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:45:38.216661    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:46:01.009006 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:46:01.008960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:31.449848 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:47:31.449813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:47:40.705644 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:47:40.705592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:47:54.863950 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:47:54.863906    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5f86b54c6f-9rpnk" podUID="e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:47:59.903092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:47:59.903057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:48:11.204401 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:48:11.204366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:48:20.588806 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:48:20.588586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:48:30.795734 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:48:30.795699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:48:41.605839 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:48:41.605806    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:48:51.993175 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:48:51.993137    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:49:02.999754 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:49:02.999718    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:49:12.808394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:49:12.808344    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:49:22.993493 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:49:22.993453    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:49:46.610719 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:49:46.610678    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:49:56.195171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:49:56.195083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:05.487420 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:05.487387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:17.233196 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:17.233162    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:25.101509 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:25.101471    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:25.905275 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:25.905234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:25.991713 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:25.991681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:31.266622 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:31.266585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:37.006800 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:37.006765    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:45.705861 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:45.705825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:50:56.000962 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:50:56.000927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:03.892638 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:03.892598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:12.792687 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:12.792656    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:21.721837 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:21.721757    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:37.409239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:37.409209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:46.107728 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:46.107694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:51:55.514028 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:51:55.513991    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:52:05.294439 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:52:05.294402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:52:18.899502 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:52:18.899465    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:52:27.704493 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:52:27.704459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:52:40.692288 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:52:40.692252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:52:54.189149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:52:54.189068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:06.888215 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:06.888179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:07.796676 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:07.796615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:15.488972 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:15.488923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:18.997388 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:18.997360    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:19.223012 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:19.222980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:19.326973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:19.326889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:23.707109 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:23.707072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:28.984340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:28.984309    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:28.985168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:28.985119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:31.698250 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:31.698209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:31.796113 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:31.796080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:32.133131 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:32.133099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:37.914245 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:37.914208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:38.116375 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:38.116333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:38.205613 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:38.205521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:38.491132 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:38.491049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:39.325092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.325049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:39.393245 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.393200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:39.397350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.397327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.400366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.400345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-138f1c39-serving-cert\""
Jul 06 19:53:39.407467 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.407438    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:39.411023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.410995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:39.472009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.471978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbszc\" (UniqueName: \"kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.472168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.472025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.472168 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.472061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.489918 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.489875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:39.572708 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.572674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbszc\" (UniqueName: \"kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.572901 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.572730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.572901 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.572770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.572901 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:39.572876    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-138f1c39-serving-cert: secret "maas-api-e2e-ait-138f1c39-serving-cert" not found
Jul 06 19:53:39.573074 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:39.572934    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls podName:10e79d5b-ead5-4a59-acfe-e08ba82ac007 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:40.072919389 +0000 UTC m=+1842.710418096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls") pod "maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" (UID: "10e79d5b-ead5-4a59-acfe-e08ba82ac007") : secret "maas-api-e2e-ait-138f1c39-serving-cert" not found
Jul 06 19:53:39.573431 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.573411    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.581861 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.581804    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbszc\" (UniqueName: \"kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:39.902488 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:39.902457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:40.000059 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:40.000012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:40.077773 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:40.077744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:40.077971 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:40.077893    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-138f1c39-serving-cert: secret "maas-api-e2e-ait-138f1c39-serving-cert" not found
Jul 06 19:53:40.077971 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:40.077970    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls podName:10e79d5b-ead5-4a59-acfe-e08ba82ac007 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:41.077953543 +0000 UTC m=+1843.715452253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls") pod "maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" (UID: "10e79d5b-ead5-4a59-acfe-e08ba82ac007") : secret "maas-api-e2e-ait-138f1c39-serving-cert" not found
Jul 06 19:53:40.129806 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:40.129774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:41.086775 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.086745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:41.089171 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.089148    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") " pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:41.208394 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.208363    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:41.340366 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.340281    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:41.344269 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:53:41.344241    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e79d5b_ead5_4a59_acfe_e08ba82ac007.slice/crio-8c58308e76709f1bd1be50a1adec1657483ae123ad764047d3252cd9c3516ad5 WatchSource:0}: Error finding container 8c58308e76709f1bd1be50a1adec1657483ae123ad764047d3252cd9c3516ad5: Status 404 returned error can't find the container with id 8c58308e76709f1bd1be50a1adec1657483ae123ad764047d3252cd9c3516ad5
Jul 06 19:53:41.345647 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.345607    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:53:41.516362 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:41.516334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:42.079192 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:42.079156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" event={"ID":"10e79d5b-ead5-4a59-acfe-e08ba82ac007","Type":"ContainerStarted","Data":"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"}
Jul 06 19:53:42.079377 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:42.079214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" event={"ID":"10e79d5b-ead5-4a59-acfe-e08ba82ac007","Type":"ContainerStarted","Data":"8c58308e76709f1bd1be50a1adec1657483ae123ad764047d3252cd9c3516ad5"}
Jul 06 19:53:42.079377 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:42.079254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:42.094554 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:42.094499    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" podStartSLOduration=2.562810212 podStartE2EDuration="3.094478219s" totalImagesPullingTime="531.668007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:53:42.094360188 +0000 UTC m=+1844.731858916" watchObservedRunningTime="2026-07-06 19:53:42.094478219 +0000 UTC m=+1844.731976951"
Jul 06 19:53:44.363380 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.363339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:44.558800 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.558758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:44.659372 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.659335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:44.770478 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.770444    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:44.770661 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.770637    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" podUID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" containerName="maas-api" containerID="cri-o://cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f" gracePeriod=30
Jul 06 19:53:44.800127 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:44.800098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:45.017737 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.017715    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:45.099017 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.098980    2559 generic.go:356] "Generic (PLEG): container finished" podID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" containerID="cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f" exitCode=0
Jul 06 19:53:45.099017 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.099022    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" event={"ID":"10e79d5b-ead5-4a59-acfe-e08ba82ac007","Type":"ContainerDied","Data":"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"}
Jul 06 19:53:45.099239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.099029    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"
Jul 06 19:53:45.099239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.099064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k" event={"ID":"10e79d5b-ead5-4a59-acfe-e08ba82ac007","Type":"ContainerDied","Data":"8c58308e76709f1bd1be50a1adec1657483ae123ad764047d3252cd9c3516ad5"}
Jul 06 19:53:45.099239 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.099093    2559 scope.go:117] "RemoveContainer" containerID="cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"
Jul 06 19:53:45.107475 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.107459    2559 scope.go:117] "RemoveContainer" containerID="cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"
Jul 06 19:53:45.107834 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:45.107801    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f\": container with ID starting with cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f not found: ID does not exist" containerID="cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"
Jul 06 19:53:45.107933 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.107830    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f"} err="failed to get container status \"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f\": rpc error: code = NotFound desc = could not find container \"cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f\": container with ID starting with cf39161a5f114f7196d6c5d783dad979eaf9f3c2f2b7fd7ed89ebd8e83c9209f not found: ID does not exist"
Jul 06 19:53:45.121648 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.121606    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbszc\" (UniqueName: \"kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc\") pod \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") "
Jul 06 19:53:45.121734 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.121699    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca\") pod \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") "
Jul 06 19:53:45.121768 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.121752    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") pod \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\" (UID: \"10e79d5b-ead5-4a59-acfe-e08ba82ac007\") "
Jul 06 19:53:45.122042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.122023    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10e79d5b-ead5-4a59-acfe-e08ba82ac007" (UID: "10e79d5b-ead5-4a59-acfe-e08ba82ac007"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:45.123711 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.123691    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10e79d5b-ead5-4a59-acfe-e08ba82ac007" (UID: "10e79d5b-ead5-4a59-acfe-e08ba82ac007"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:45.123807 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.123694    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc" (OuterVolumeSpecName: "kube-api-access-rbszc") pod "10e79d5b-ead5-4a59-acfe-e08ba82ac007" (UID: "10e79d5b-ead5-4a59-acfe-e08ba82ac007"). InnerVolumeSpecName "kube-api-access-rbszc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:45.223042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.222963    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10e79d5b-ead5-4a59-acfe-e08ba82ac007-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:45.223042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.222991    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbszc\" (UniqueName: \"kubernetes.io/projected/10e79d5b-ead5-4a59-acfe-e08ba82ac007-kube-api-access-rbszc\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:45.223042 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.223000    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e79d5b-ead5-4a59-acfe-e08ba82ac007-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:45.424085 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.424054    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:45.429210 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.429184    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-138f1c39-7889fc6d5b-6jg5k"]
Jul 06 19:53:45.914953 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:45.914919    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" path="/var/lib/kubelet/pods/10e79d5b-ead5-4a59-acfe-e08ba82ac007/volumes"
Jul 06 19:53:47.660834 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:47.660804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.422853 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:50.422809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.530823 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:50.530794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.667053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:50.667021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.766320 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:50.766228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:51.833336 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.833296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:51.904433 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.904401    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:51.904966 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.904949    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" containerName="maas-api"
Jul 06 19:53:51.905023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.904970    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" containerName="maas-api"
Jul 06 19:53:51.905079 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.905069    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="10e79d5b-ead5-4a59-acfe-e08ba82ac007" containerName="maas-api"
Jul 06 19:53:51.909952 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.909927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:51.912053 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.912031    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-d34b5c74-serving-cert\""
Jul 06 19:53:51.926997 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.926972    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:51.939245 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.939216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:51.984237 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.984195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9tgj\" (UniqueName: \"kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:51.984387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.984294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:51.984387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:51.984359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.039419 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.039384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:52.085541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.085448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9tgj\" (UniqueName: \"kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.085541 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.085521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.085764 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.085564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.085764 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:52.085692    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-d34b5c74-serving-cert: secret "maas-api-e2e-ait-d34b5c74-serving-cert" not found
Jul 06 19:53:52.085841 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:52.085765    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls podName:d817438a-fe3a-4886-ac17-afe6b52433dc nodeName:}" failed. No retries permitted until 2026-07-06 19:53:52.585745366 +0000 UTC m=+1855.223244090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls") pod "maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" (UID: "d817438a-fe3a-4886-ac17-afe6b52433dc") : secret "maas-api-e2e-ait-d34b5c74-serving-cert" not found
Jul 06 19:53:52.086233 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.086215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.096097 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.096071    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9tgj\" (UniqueName: \"kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.169243 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.169193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:52.500259 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.500218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:52.589696 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.589665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.592083 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.592052    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") pod \"maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") " pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.600934 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.600909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:52.821303 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.821219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:52.963776 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:52.963750    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:52.965754 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:53:52.965718    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd817438a_fe3a_4886_ac17_afe6b52433dc.slice/crio-1b10e36eeae596fd04e22fd495f518d50c46c5ae05eb0367fafe57cbf9736b65 WatchSource:0}: Error finding container 1b10e36eeae596fd04e22fd495f518d50c46c5ae05eb0367fafe57cbf9736b65: Status 404 returned error can't find the container with id 1b10e36eeae596fd04e22fd495f518d50c46c5ae05eb0367fafe57cbf9736b65
Jul 06 19:53:53.136517 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:53.136485    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" event={"ID":"d817438a-fe3a-4886-ac17-afe6b52433dc","Type":"ContainerStarted","Data":"1b10e36eeae596fd04e22fd495f518d50c46c5ae05eb0367fafe57cbf9736b65"}
Jul 06 19:53:53.888149 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:53.888120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:54.142376 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:54.142338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" event={"ID":"d817438a-fe3a-4886-ac17-afe6b52433dc","Type":"ContainerStarted","Data":"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"}
Jul 06 19:53:54.142766 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:54.142456    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:54.161743 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:54.161691    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" podStartSLOduration=2.7392630540000003 podStartE2EDuration="3.161673009s" totalImagesPullingTime="422.409955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:53:54.160008762 +0000 UTC m=+1856.797507492" watchObservedRunningTime="2026-07-06 19:53:54.161673009 +0000 UTC m=+1856.799171738"
Jul 06 19:53:55.788910 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:55.788875    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:53:56.916565 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:56.916530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:57.263200 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.263107    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:57.263512 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.263462    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" podUID="d817438a-fe3a-4886-ac17-afe6b52433dc" containerName="maas-api" containerID="cri-o://078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f" gracePeriod=30
Jul 06 19:53:57.287253 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.287227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:57.509932 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.509904    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:57.638612 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.638583    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9tgj\" (UniqueName: \"kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj\") pod \"d817438a-fe3a-4886-ac17-afe6b52433dc\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") "
Jul 06 19:53:57.638788 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.638618    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") pod \"d817438a-fe3a-4886-ac17-afe6b52433dc\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") "
Jul 06 19:53:57.638840 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.638785    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca\") pod \"d817438a-fe3a-4886-ac17-afe6b52433dc\" (UID: \"d817438a-fe3a-4886-ac17-afe6b52433dc\") "
Jul 06 19:53:57.639120 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.639086    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d817438a-fe3a-4886-ac17-afe6b52433dc" (UID: "d817438a-fe3a-4886-ac17-afe6b52433dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:57.640698 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.640668    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d817438a-fe3a-4886-ac17-afe6b52433dc" (UID: "d817438a-fe3a-4886-ac17-afe6b52433dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:57.640788 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.640766    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj" (OuterVolumeSpecName: "kube-api-access-j9tgj") pod "d817438a-fe3a-4886-ac17-afe6b52433dc" (UID: "d817438a-fe3a-4886-ac17-afe6b52433dc"). InnerVolumeSpecName "kube-api-access-j9tgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:57.740292 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.740254    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9tgj\" (UniqueName: \"kubernetes.io/projected/d817438a-fe3a-4886-ac17-afe6b52433dc-kube-api-access-j9tgj\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:57.740292 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.740285    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d817438a-fe3a-4886-ac17-afe6b52433dc-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:57.740292 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:57.740294    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d817438a-fe3a-4886-ac17-afe6b52433dc-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:53:58.162679 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.162639    2559 generic.go:356] "Generic (PLEG): container finished" podID="d817438a-fe3a-4886-ac17-afe6b52433dc" containerID="078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f" exitCode=0
Jul 06 19:53:58.163145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.162694    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"
Jul 06 19:53:58.163145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.162717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" event={"ID":"d817438a-fe3a-4886-ac17-afe6b52433dc","Type":"ContainerDied","Data":"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"}
Jul 06 19:53:58.163145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.162770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw" event={"ID":"d817438a-fe3a-4886-ac17-afe6b52433dc","Type":"ContainerDied","Data":"1b10e36eeae596fd04e22fd495f518d50c46c5ae05eb0367fafe57cbf9736b65"}
Jul 06 19:53:58.163145 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.162792    2559 scope.go:117] "RemoveContainer" containerID="078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"
Jul 06 19:53:58.170917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.170901    2559 scope.go:117] "RemoveContainer" containerID="078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"
Jul 06 19:53:58.171200 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:53:58.171179    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f\": container with ID starting with 078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f not found: ID does not exist" containerID="078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"
Jul 06 19:53:58.171247 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.171208    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f"} err="failed to get container status \"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f\": rpc error: code = NotFound desc = could not find container \"078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f\": container with ID starting with 078d24cb75f6d610dea8df3324045673d5f2c08578edf66abd4aa73f80c99c4f not found: ID does not exist"
Jul 06 19:53:58.177693 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.177619    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:58.181138 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:58.181120    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d34b5c74-766f59fd58-x7jtw"]
Jul 06 19:53:59.915997 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:53:59.915964    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d817438a-fe3a-4886-ac17-afe6b52433dc" path="/var/lib/kubelet/pods/d817438a-fe3a-4886-ac17-afe6b52433dc/volumes"
Jul 06 19:54:03.000598 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:03.000546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:03.092961 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:03.092926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:05.939832 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:05.939801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:06.441954 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:06.441923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:54:09.274860 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:09.274824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:09.384520 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:09.384480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:09.599293 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:09.599199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:09.694107 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:09.694072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:10.689733 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.689696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:10.836309 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.836276    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:10.836655 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.836620    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d817438a-fe3a-4886-ac17-afe6b52433dc" containerName="maas-api"
Jul 06 19:54:10.836655 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.836655    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d817438a-fe3a-4886-ac17-afe6b52433dc" containerName="maas-api"
Jul 06 19:54:10.836802 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.836775    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d817438a-fe3a-4886-ac17-afe6b52433dc" containerName="maas-api"
Jul 06 19:54:10.838330 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.838291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:10.840172 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.840158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:10.845009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.844987    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-2e7906ed-serving-cert\""
Jul 06 19:54:10.865415 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.865379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:10.955102 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.955021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:10.955102 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.955058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:10.955102 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.955098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhhl\" (UniqueName: \"kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:10.998418 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:10.998381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:11.056109 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.056076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.056109 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.056116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.056340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.056135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhhl\" (UniqueName: \"kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.056340 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:54:11.056238    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-2e7906ed-serving-cert: secret "maas-api-e2e-derive-2e7906ed-serving-cert" not found
Jul 06 19:54:11.056340 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:54:11.056304    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls podName:bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b nodeName:}" failed. No retries permitted until 2026-07-06 19:54:11.556285105 +0000 UTC m=+1874.193783811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls") pod "maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" (UID: "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b") : secret "maas-api-e2e-derive-2e7906ed-serving-cert" not found
Jul 06 19:54:11.056910 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.056891    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.071333 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.071310    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhhl\" (UniqueName: \"kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.560610 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.560576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.561428 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.561399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:11.563159 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.563141    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") pod \"maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") " pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.750950 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.750897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:11.894072 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.894050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:11.896965 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:54:11.896925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc25ad5e_4356_4ee7_9a3f_eb6ab945a59b.slice/crio-7cc2c10c145bedf510d2174260b5ee28954bb32808e1da701601c104439eb206 WatchSource:0}: Error finding container 7cc2c10c145bedf510d2174260b5ee28954bb32808e1da701601c104439eb206: Status 404 returned error can't find the container with id 7cc2c10c145bedf510d2174260b5ee28954bb32808e1da701601c104439eb206
Jul 06 19:54:11.997513 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:11.997479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:12.136604 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:12.136573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:12.230358 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:12.230334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" event={"ID":"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b","Type":"ContainerStarted","Data":"7cc2c10c145bedf510d2174260b5ee28954bb32808e1da701601c104439eb206"}
Jul 06 19:54:12.884131 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:12.884092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:13.237383 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:13.237338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" event={"ID":"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b","Type":"ContainerStarted","Data":"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"}
Jul 06 19:54:13.237556 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:13.237415    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:13.256037 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:13.255987    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" podStartSLOduration=2.927746278 podStartE2EDuration="3.255969216s" totalImagesPullingTime="328.222938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:13.254561578 +0000 UTC m=+1875.892060324" watchObservedRunningTime="2026-07-06 19:54:13.255969216 +0000 UTC m=+1875.893467943"
Jul 06 19:54:15.108491 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.108453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:15.281752 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.281717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:15.395380 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.395345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:15.465345 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.465316    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:15.465594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.465567    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" podUID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" containerName="maas-api" containerID="cri-o://a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc" gracePeriod=30
Jul 06 19:54:15.491619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.491593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:15.703144 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.703117    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:15.800377 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.800350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") pod \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") "
Jul 06 19:54:15.800548 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.800480    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca\") pod \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") "
Jul 06 19:54:15.800548 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.800498    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzhhl\" (UniqueName: \"kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl\") pod \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\" (UID: \"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b\") "
Jul 06 19:54:15.800862 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.800833    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" (UID: "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:15.802397 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.802374    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" (UID: "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:15.802622 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.802601    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl" (OuterVolumeSpecName: "kube-api-access-lzhhl") pod "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" (UID: "bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b"). InnerVolumeSpecName "kube-api-access-lzhhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:15.901396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.901343    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:54:15.901396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.901387    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzhhl\" (UniqueName: \"kubernetes.io/projected/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-kube-api-access-lzhhl\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:54:15.901396 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:15.901399    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:54:16.259189 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.259156    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" containerID="a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc" exitCode=0
Jul 06 19:54:16.259701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.259202    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"
Jul 06 19:54:16.259701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.259241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" event={"ID":"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b","Type":"ContainerDied","Data":"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"}
Jul 06 19:54:16.259701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.259298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm" event={"ID":"bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b","Type":"ContainerDied","Data":"7cc2c10c145bedf510d2174260b5ee28954bb32808e1da701601c104439eb206"}
Jul 06 19:54:16.259701 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.259331    2559 scope.go:117] "RemoveContainer" containerID="a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"
Jul 06 19:54:16.267960 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.267946    2559 scope.go:117] "RemoveContainer" containerID="a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"
Jul 06 19:54:16.268198 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:54:16.268179    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc\": container with ID starting with a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc not found: ID does not exist" containerID="a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"
Jul 06 19:54:16.268264 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.268206    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc"} err="failed to get container status \"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc\": rpc error: code = NotFound desc = could not find container \"a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc\": container with ID starting with a6469d9c7b005ab87d5c1cff8055c974375b0075a87d9dbdd16912564c2f79fc not found: ID does not exist"
Jul 06 19:54:16.275706 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.275684    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:16.281218 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.281199    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-2e7906ed-69688d7c9-s6zxm"]
Jul 06 19:54:16.803368 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:16.803338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:17.915731 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:17.915702    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" path="/var/lib/kubelet/pods/bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b/volumes"
Jul 06 19:54:22.274260 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:22.274182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:22.385684 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:22.385646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:22.788426 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:22.788384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:22.946333 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:22.946296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:23.095302 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:23.095209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:24.504880 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:24.504841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.579849 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:30.579812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.771309 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:30.771273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.911132 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:30.911075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:31.477236 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:31.477199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.294099 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:54:57.294064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.971420 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:03.971385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.196680 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:04.196618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.619134 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:04.619096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:20.244830 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:20.244795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:26.259474 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:26.259440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:26.389725 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:26.389685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:26.657276 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:26.657234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:37.061127 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:37.061090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:37.871024 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:37.870991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.643739 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:43.643694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.720475 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:43.720444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.810406 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:43.810374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.910822 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:43.910730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.745966 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:44.745931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.841360 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:44.841322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.978985 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:44.978939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:46.506097 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:46.506062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:48.991957 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:48.991926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:55:52.459008 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:52.458976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:52.537888 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:52.537854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:53.144703 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:53.144663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:59.547229 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:59.547193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:59.615259 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:59.615224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:59.795035 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:59.794999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:59.993334 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:55:59.993299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:56:00.126096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:00.126061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:00.257048 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:00.256960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.332773 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.332720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.484804 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.484765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.528104 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.528071    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:03.528675 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.528655    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" containerName="maas-api"
Jul 06 19:56:03.528745 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.528676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" containerName="maas-api"
Jul 06 19:56:03.528803 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.528768    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc25ad5e-4356-4ee7-9a3f-eb6ab945a59b" containerName="maas-api"
Jul 06 19:56:03.532054 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.532035    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.536428 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.536407    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-03cdb5ed-serving-cert\""
Jul 06 19:56:03.546876 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.546842    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:03.552024 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.551994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.552147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.552078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szv5h\" (UniqueName: \"kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.552147 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.552114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.615583 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.615465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.653644 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.653606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szv5h\" (UniqueName: \"kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.653891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.653660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.653891 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.653765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.654428 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.654409    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.656112 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.656093    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.662102 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.662079    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szv5h\" (UniqueName: \"kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h\") pod \"maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") " pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.708962 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.708926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.842799 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.842763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:03.990617 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:03.990588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:03.993337 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:56:03.993307    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fc7afe_81d6_40bb_bfca_a05313f1c4db.slice/crio-19b35bfb905aba817c735643f7c0ee52b1da9f42538995fbae859e2879499f52 WatchSource:0}: Error finding container 19b35bfb905aba817c735643f7c0ee52b1da9f42538995fbae859e2879499f52: Status 404 returned error can't find the container with id 19b35bfb905aba817c735643f7c0ee52b1da9f42538995fbae859e2879499f52
Jul 06 19:56:04.165185 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.165081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:04.265367 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.265322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:04.750117 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.750034    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" event={"ID":"b3fc7afe-81d6-40bb-bfca-a05313f1c4db","Type":"ContainerStarted","Data":"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"}
Jul 06 19:56:04.750117 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.750084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" event={"ID":"b3fc7afe-81d6-40bb-bfca-a05313f1c4db","Type":"ContainerStarted","Data":"19b35bfb905aba817c735643f7c0ee52b1da9f42538995fbae859e2879499f52"}
Jul 06 19:56:04.750557 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.750120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:04.767354 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:04.767302    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" podStartSLOduration=1.267897419 podStartE2EDuration="1.767282102s" totalImagesPullingTime="499.384683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:04.766494592 +0000 UTC m=+1987.403993335" watchObservedRunningTime="2026-07-06 19:56:04.767282102 +0000 UTC m=+1987.404780877"
Jul 06 19:56:07.685137 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:07.685101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:08.343716 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:08.343678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:08.469479 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:08.469449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:08.827262 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:08.827223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.206973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:10.206936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:56:10.760827 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:10.760797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:14.738561 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:14.738526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.810786 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:14.810750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:15.298096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:15.298040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:15.645365 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:15.645335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:15.770257 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:15.770228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:15.770656 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:15.770413    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" podUID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" containerName="maas-api" containerID="cri-o://d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3" gracePeriod=30
Jul 06 19:56:15.808742 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:15.808712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:16.018127 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.018103    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:16.170281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.170240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca\") pod \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") "
Jul 06 19:56:16.170281 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.170287    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls\") pod \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") "
Jul 06 19:56:16.170547 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.170440    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szv5h\" (UniqueName: \"kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h\") pod \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\" (UID: \"b3fc7afe-81d6-40bb-bfca-a05313f1c4db\") "
Jul 06 19:56:16.170682 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.170658    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3fc7afe-81d6-40bb-bfca-a05313f1c4db" (UID: "b3fc7afe-81d6-40bb-bfca-a05313f1c4db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:56:16.170795 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.170778    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:56:16.172362 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.172337    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3fc7afe-81d6-40bb-bfca-a05313f1c4db" (UID: "b3fc7afe-81d6-40bb-bfca-a05313f1c4db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:56:16.172487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.172462    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h" (OuterVolumeSpecName: "kube-api-access-szv5h") pod "b3fc7afe-81d6-40bb-bfca-a05313f1c4db" (UID: "b3fc7afe-81d6-40bb-bfca-a05313f1c4db"). InnerVolumeSpecName "kube-api-access-szv5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:56:16.271333 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.271239    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szv5h\" (UniqueName: \"kubernetes.io/projected/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-kube-api-access-szv5h\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:56:16.271333 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.271272    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3fc7afe-81d6-40bb-bfca-a05313f1c4db-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:56:16.807962 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.807930    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" containerID="d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3" exitCode=0
Jul 06 19:56:16.808387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.807988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" event={"ID":"b3fc7afe-81d6-40bb-bfca-a05313f1c4db","Type":"ContainerDied","Data":"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"}
Jul 06 19:56:16.808387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.807992    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"
Jul 06 19:56:16.808387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.808056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb" event={"ID":"b3fc7afe-81d6-40bb-bfca-a05313f1c4db","Type":"ContainerDied","Data":"19b35bfb905aba817c735643f7c0ee52b1da9f42538995fbae859e2879499f52"}
Jul 06 19:56:16.808387 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.808079    2559 scope.go:117] "RemoveContainer" containerID="d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"
Jul 06 19:56:16.817858 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.817837    2559 scope.go:117] "RemoveContainer" containerID="d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"
Jul 06 19:56:16.818120 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:56:16.818104    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3\": container with ID starting with d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3 not found: ID does not exist" containerID="d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"
Jul 06 19:56:16.818161 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.818129    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3"} err="failed to get container status \"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3\": rpc error: code = NotFound desc = could not find container \"d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3\": container with ID starting with d7a73fe860b0860b27dfa617f78687e4b12edd0ee00d8fe8f09613bd939956e3 not found: ID does not exist"
Jul 06 19:56:16.832982 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.832955    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:16.835679 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:16.835652    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-03cdb5ed-bf9c84fbf-qptwb"]
Jul 06 19:56:17.915609 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:17.915570    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" path="/var/lib/kubelet/pods/b3fc7afe-81d6-40bb-bfca-a05313f1c4db/volumes"
Jul 06 19:56:18.999994 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:18.999962    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:56:19.337618 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:19.337530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.375365 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:22.375331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.488694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:22.488661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.673141 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:22.673038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.976765 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:22.976662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.127926 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:23.127894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.278697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:23.278584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:29.327069 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:29.327038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:29.407096 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:29.407058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:29.558577 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:29.558545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:29.704960 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:29.704929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:35.533567 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:35.533531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:35.633620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:35.633583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:40.234082 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:40.234049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:42.288798 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:42.288763    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:42.669124 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:42.669089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:42.770981 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:42.770947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.493047 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.493014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.560537 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.560498    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:56:45.561023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.561001    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" containerName="maas-api"
Jul 06 19:56:45.561088 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.561027    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" containerName="maas-api"
Jul 06 19:56:45.561189 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.561171    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3fc7afe-81d6-40bb-bfca-a05313f1c4db" containerName="maas-api"
Jul 06 19:56:45.564421 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.564401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.566927 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.566907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-173a5950-serving-cert\""
Jul 06 19:56:45.573927 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.573898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:56:45.596221 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.596186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.624452 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.624419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.624594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.624463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrmf\" (UniqueName: \"kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.624594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.624483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.689947 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.689891    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.724993 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.724960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.725167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.725009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrmf\" (UniqueName: \"kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.725167 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.725038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.725167 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:56:45.725115    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-173a5950-serving-cert: secret "maas-api-e2e-mt-173a5950-serving-cert" not found
Jul 06 19:56:45.725294 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:56:45.725184    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls podName:ffd8be71-714f-4446-86f9-32ce9be56fd1 nodeName:}" failed. No retries permitted until 2026-07-06 19:56:46.225165691 +0000 UTC m=+2028.862664415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls") pod "maas-api-e2e-mt-173a5950-66cb59d694-gssq5" (UID: "ffd8be71-714f-4446-86f9-32ce9be56fd1") : secret "maas-api-e2e-mt-173a5950-serving-cert" not found
Jul 06 19:56:45.725770 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.725751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.733443 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.733418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrmf\" (UniqueName: \"kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:45.886772 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:45.886740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:46.154785 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.154687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:46.229015 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.228984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:46.231397 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.231377    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") pod \"maas-api-e2e-mt-173a5950-66cb59d694-gssq5\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") " pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:46.258954 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.258918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:46.475998 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.475917    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:46.611818 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.611795    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:56:46.614097 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:56:46.614071    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd8be71_714f_4446_86f9_32ce9be56fd1.slice/crio-9c92477698369f58b4a37566566fea115efb7f13aaccfb3aec7af94b35c2a0f3 WatchSource:0}: Error finding container 9c92477698369f58b4a37566566fea115efb7f13aaccfb3aec7af94b35c2a0f3: Status 404 returned error can't find the container with id 9c92477698369f58b4a37566566fea115efb7f13aaccfb3aec7af94b35c2a0f3
Jul 06 19:56:46.946809 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:46.946767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" event={"ID":"ffd8be71-714f-4446-86f9-32ce9be56fd1","Type":"ContainerStarted","Data":"9c92477698369f58b4a37566566fea115efb7f13aaccfb3aec7af94b35c2a0f3"}
Jul 06 19:56:47.952596 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:47.952560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" event={"ID":"ffd8be71-714f-4446-86f9-32ce9be56fd1","Type":"ContainerStarted","Data":"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"}
Jul 06 19:56:47.953019 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:47.952650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:47.975819 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:47.975764    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" podStartSLOduration=2.663249827 podStartE2EDuration="2.975746852s" totalImagesPullingTime="312.497025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:47.974675154 +0000 UTC m=+2030.612173881" watchObservedRunningTime="2026-07-06 19:56:47.975746852 +0000 UTC m=+2030.613245580"
Jul 06 19:56:50.006514 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:50.006487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:50.897305 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:50.897274    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:56:53.962596 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:53.962566    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:56:58.834242 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:56:58.834200    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:03.499653 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:03.499602    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:57:13.932340 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:13.932308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:14.034296 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:14.034260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.900268 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:18.900231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:57:22.514594 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:22.514560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:22.987752 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:22.987709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:23.085917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.085873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:23.244947 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.244871    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:57:23.245103 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.245081    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" podUID="ffd8be71-714f-4446-86f9-32ce9be56fd1" containerName="maas-api" containerID="cri-o://7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc" gracePeriod=30
Jul 06 19:57:23.273427 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.273394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:23.490543 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.490517    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:57:23.670698 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.670656    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") pod \"ffd8be71-714f-4446-86f9-32ce9be56fd1\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") "
Jul 06 19:57:23.671193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.670720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca\") pod \"ffd8be71-714f-4446-86f9-32ce9be56fd1\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") "
Jul 06 19:57:23.671193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.670767    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvrmf\" (UniqueName: \"kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf\") pod \"ffd8be71-714f-4446-86f9-32ce9be56fd1\" (UID: \"ffd8be71-714f-4446-86f9-32ce9be56fd1\") "
Jul 06 19:57:23.671193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.671165    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffd8be71-714f-4446-86f9-32ce9be56fd1" (UID: "ffd8be71-714f-4446-86f9-32ce9be56fd1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:23.672818 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.672788    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf" (OuterVolumeSpecName: "kube-api-access-fvrmf") pod "ffd8be71-714f-4446-86f9-32ce9be56fd1" (UID: "ffd8be71-714f-4446-86f9-32ce9be56fd1"). InnerVolumeSpecName "kube-api-access-fvrmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:23.672818 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.672790    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffd8be71-714f-4446-86f9-32ce9be56fd1" (UID: "ffd8be71-714f-4446-86f9-32ce9be56fd1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:23.771829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.771793    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd8be71-714f-4446-86f9-32ce9be56fd1-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:57:23.771829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.771823    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8be71-714f-4446-86f9-32ce9be56fd1-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:57:23.771829 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:23.771835    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvrmf\" (UniqueName: \"kubernetes.io/projected/ffd8be71-714f-4446-86f9-32ce9be56fd1-kube-api-access-fvrmf\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 19:57:24.113405 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.113369    2559 generic.go:356] "Generic (PLEG): container finished" podID="ffd8be71-714f-4446-86f9-32ce9be56fd1" containerID="7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc" exitCode=0
Jul 06 19:57:24.113588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.113415    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"
Jul 06 19:57:24.113588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.113449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" event={"ID":"ffd8be71-714f-4446-86f9-32ce9be56fd1","Type":"ContainerDied","Data":"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"}
Jul 06 19:57:24.113588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.113499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5" event={"ID":"ffd8be71-714f-4446-86f9-32ce9be56fd1","Type":"ContainerDied","Data":"9c92477698369f58b4a37566566fea115efb7f13aaccfb3aec7af94b35c2a0f3"}
Jul 06 19:57:24.113588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.113522    2559 scope.go:117] "RemoveContainer" containerID="7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"
Jul 06 19:57:24.123453 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.123435    2559 scope.go:117] "RemoveContainer" containerID="7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"
Jul 06 19:57:24.123737 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:57:24.123714    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc\": container with ID starting with 7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc not found: ID does not exist" containerID="7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"
Jul 06 19:57:24.123851 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.123744    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc"} err="failed to get container status \"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc\": rpc error: code = NotFound desc = could not find container \"7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc\": container with ID starting with 7f2657907924f6b930d1517c8d79818e2760b9c747c5b4af3bac229c2553fdbc not found: ID does not exist"
Jul 06 19:57:24.130619 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.130595    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:57:24.134774 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:24.134751    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-173a5950-66cb59d694-gssq5"]
Jul 06 19:57:25.915405 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:25.915372    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd8be71-714f-4446-86f9-32ce9be56fd1" path="/var/lib/kubelet/pods/ffd8be71-714f-4446-86f9-32ce9be56fd1/volumes"
Jul 06 19:57:28.534530 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:28.534496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:31.594642 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:31.594584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:57:33.572995 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:57:33.572960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:10.802669 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:10.802617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:12.203057 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:12.203022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:15.104694 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:15.104658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:58:17.833373 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:17.833337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:17.965311 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:17.965269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:18.169602 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:18.169568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:18.379129 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:18.379080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:19.551268 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:19.551237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:19.683973 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:19.683942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:20.474023 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:20.473991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:20.576580 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:20.576545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:22.049152 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:22.049108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:27.988749 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:27.988715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:58:28.019518 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:28.019481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:28.129278 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:28.129235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:28.730680 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:28.730645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:35.286363 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:35.286317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:35.434141 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:35.434110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:37.948227 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:37.948180    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:58:45.862256 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:45.862221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:50.308346 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:50.308254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:50.410206 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:50.410172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:51.341317 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:58:51.341279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:12.290860 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:12.290828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:18.989877 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:18.989826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.112030 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:19.111985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.458246 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:19.458213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.876851 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:19.876816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.083945 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:20.083914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:23.568129 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.568091    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 19:59:23.568639 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.568606    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd8be71-714f-4446-86f9-32ce9be56fd1" containerName="maas-api"
Jul 06 19:59:23.568731 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.568643    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd8be71-714f-4446-86f9-32ce9be56fd1" containerName="maas-api"
Jul 06 19:59:23.568785 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.568750    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd8be71-714f-4446-86f9-32ce9be56fd1" containerName="maas-api"
Jul 06 19:59:23.571620 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.571601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.577108 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.577081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-34eebf-serving-cert\""
Jul 06 19:59:23.581917 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.581887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:23.599750 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.599723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 19:59:23.642539 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.642503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.642747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.642558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.642747 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.642583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2d99\" (UniqueName: \"kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.743751 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.743716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.743939 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.743779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.743939 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.743804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2d99\" (UniqueName: \"kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.743939 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:59:23.743870    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-34eebf-serving-cert: secret "maas-api-e2e-inf-a-34eebf-serving-cert" not found
Jul 06 19:59:23.744074 ip-10-0-135-41 kubenswrapper[2559]: E0706 19:59:23.743949    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls podName:df2b4e5a-2f97-48fc-a002-fb16e602012b nodeName:}" failed. No retries permitted until 2026-07-06 19:59:24.243933487 +0000 UTC m=+2186.881432193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls") pod "maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" (UID: "df2b4e5a-2f97-48fc-a002-fb16e602012b") : secret "maas-api-e2e-inf-a-34eebf-serving-cert" not found
Jul 06 19:59:23.744506 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.744486    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.770992 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.770957    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2d99\" (UniqueName: \"kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:23.795006 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.794962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:23.968669 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:23.968612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:24.249526 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.249429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:24.251920 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.251895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") pod \"maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") " pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:24.482686 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.482650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:24.598863 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.598828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:24.629353 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.629325    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 19:59:24.633000 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:59:24.630535    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2b4e5a_2f97_48fc_a002_fb16e602012b.slice/crio-2bd479d982ecb9a01f75e34a95edb0fc9ca76668341df56eca807475104c0173 WatchSource:0}: Error finding container 2bd479d982ecb9a01f75e34a95edb0fc9ca76668341df56eca807475104c0173: Status 404 returned error can't find the container with id 2bd479d982ecb9a01f75e34a95edb0fc9ca76668341df56eca807475104c0173
Jul 06 19:59:24.634008 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.633988    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:59:24.662092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.662059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" event={"ID":"df2b4e5a-2f97-48fc-a002-fb16e602012b","Type":"ContainerStarted","Data":"2bd479d982ecb9a01f75e34a95edb0fc9ca76668341df56eca807475104c0173"}
Jul 06 19:59:24.695105 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:24.695068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:25.669762 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:25.669729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" event={"ID":"df2b4e5a-2f97-48fc-a002-fb16e602012b","Type":"ContainerStarted","Data":"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"}
Jul 06 19:59:25.670251 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:25.669845    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:25.689350 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:25.689299    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" podStartSLOduration=2.25824254 podStartE2EDuration="2.689282906s" totalImagesPullingTime="431.040366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:25.686883668 +0000 UTC m=+2188.324382395" watchObservedRunningTime="2026-07-06 19:59:25.689282906 +0000 UTC m=+2188.326781634"
Jul 06 19:59:27.929271 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:27.929237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.269703 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:28.269606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.586223 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:28.586131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.682556 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:28.682515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:29.302476 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:29.302441    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:59:31.412720 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.412676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.472875 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.472842    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 19:59:31.477005 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.476979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.479587 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.479564    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-6bd627-serving-cert\""
Jul 06 19:59:31.490374 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.490347    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 19:59:31.529781 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.529748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.617072 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.617036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grldk\" (UniqueName: \"kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.617072 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.617075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.617304 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.617110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.632791 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.632756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.679588 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.679515    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 19:59:31.718009 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.717976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.718179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.718079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grldk\" (UniqueName: \"kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.718179 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.718137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.718969 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.718946    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.720668 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.720614    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.732924 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.732896    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grldk\" (UniqueName: \"kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk\") pod \"maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") " pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.788878 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.788840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:31.801703 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.801669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.921046 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:31.921023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 19:59:31.923453 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:59:31.923425    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515c1339_547c_4d03_b79d_ab46d14c1cca.slice/crio-5a56108c64cc5872b0d4778df2a86ddfc4932b2dd80ba2c43cadb6651913386c WatchSource:0}: Error finding container 5a56108c64cc5872b0d4778df2a86ddfc4932b2dd80ba2c43cadb6651913386c: Status 404 returned error can't find the container with id 5a56108c64cc5872b0d4778df2a86ddfc4932b2dd80ba2c43cadb6651913386c
Jul 06 19:59:32.139092 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.139058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.239184 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.239143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.708063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.708029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" event={"ID":"515c1339-547c-4d03-b79d-ab46d14c1cca","Type":"ContainerStarted","Data":"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"}
Jul 06 19:59:32.708477 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.708100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" event={"ID":"515c1339-547c-4d03-b79d-ab46d14c1cca","Type":"ContainerStarted","Data":"5a56108c64cc5872b0d4778df2a86ddfc4932b2dd80ba2c43cadb6651913386c"}
Jul 06 19:59:32.708477 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.708157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:32.730169 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:32.730119    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" podStartSLOduration=1.356623282 podStartE2EDuration="1.730100569s" totalImagesPullingTime="373.477287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:32.729745792 +0000 UTC m=+2195.367244532" watchObservedRunningTime="2026-07-06 19:59:32.730100569 +0000 UTC m=+2195.367599673"
Jul 06 19:59:35.837591 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:35.837556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:38.718142 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:38.718114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 19:59:41.694155 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:41.694119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:59:45.618500 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.618445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:45.720263 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.720225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:45.816457 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.816428    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 19:59:45.820157 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.820138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.822844 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.822824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-34eebf\"/\"kube-root-ca.crt\""
Jul 06 19:59:45.823420 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.823398    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-34eebf\"/\"openshift-service-ca.crt\""
Jul 06 19:59:45.823528 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.823402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-34eebf\"/\"test-model-34eebf-kserve-self-signed-certs\""
Jul 06 19:59:45.823528 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.823454    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-34eebf\"/\"default-dockercfg-m4lq8\""
Jul 06 19:59:45.832063 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.832042    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 19:59:45.847496 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.847592 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.847592 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45494\" (UniqueName: \"kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.847707 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.847748 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.847872 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.847848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.917912 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.917809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:45.948572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.948572 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45494\" (UniqueName: \"kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.948847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.948847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.948847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.948847 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.948708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.949127 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.949104    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.949187 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.949120    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.949242 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.949183    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.950898 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.950873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.951125 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.951107    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:45.960894 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:45.960869    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45494\" (UniqueName: \"kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494\") pod \"test-model-34eebf-kserve-87fcf6cf-ngqh2\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") " pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:46.130487 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:46.130445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:46.267193 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:46.267166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 19:59:46.268762 ip-10-0-135-41 kubenswrapper[2559]: W0706 19:59:46.268725    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fd3ce69_47d6_48ff_9344_16c9a7e3fc47.slice/crio-6c43e0c175d937e66df1912ebde757d4363b32786a2157c9fbed4390225bc9f8 WatchSource:0}: Error finding container 6c43e0c175d937e66df1912ebde757d4363b32786a2157c9fbed4390225bc9f8: Status 404 returned error can't find the container with id 6c43e0c175d937e66df1912ebde757d4363b32786a2157c9fbed4390225bc9f8
Jul 06 19:59:46.773886 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:46.773849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" event={"ID":"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47","Type":"ContainerStarted","Data":"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"}
Jul 06 19:59:46.773886 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:46.773898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" event={"ID":"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47","Type":"ContainerStarted","Data":"6c43e0c175d937e66df1912ebde757d4363b32786a2157c9fbed4390225bc9f8"}
Jul 06 19:59:46.792731 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:46.792669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" podStartSLOduration=1.79265009 podStartE2EDuration="1.79265009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:46.792299516 +0000 UTC m=+2209.429798244" watchObservedRunningTime="2026-07-06 19:59:46.79265009 +0000 UTC m=+2209.430148813"
Jul 06 19:59:51.414256 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:51.414217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 19:59:52.960877 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:52.960845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:53.064713 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:53.064672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:56.130824 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:56.130785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:56.131278 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:56.130837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:56.143065 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:56.143040    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 19:59:56.831697 ip-10-0-135-41 kubenswrapper[2559]: I0706 19:59:56.831667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 20:00:01.914833 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:01.914786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:02.021071 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:02.021037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.037265 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:16.037215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:22.297087 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:22.297002    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:00:50.622205 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:50.622167    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 20:00:50.647122 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:50.647086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:51.560403 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:51.560370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:51.725127 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:51.725093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.097810 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.097772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.197252 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.197221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.413288 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.413235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.418399 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.418370    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 20:00:52.418618 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.418592    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" podUID="df2b4e5a-2f97-48fc-a002-fb16e602012b" containerName="maas-api" containerID="cri-o://2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87" gracePeriod=30
Jul 06 20:00:52.478709 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.478680    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.666556 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.666488    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 20:00:52.785226 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.785189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2d99\" (UniqueName: \"kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99\") pod \"df2b4e5a-2f97-48fc-a002-fb16e602012b\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") "
Jul 06 20:00:52.785226 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.785231    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") pod \"df2b4e5a-2f97-48fc-a002-fb16e602012b\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") "
Jul 06 20:00:52.785685 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.785277    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca\") pod \"df2b4e5a-2f97-48fc-a002-fb16e602012b\" (UID: \"df2b4e5a-2f97-48fc-a002-fb16e602012b\") "
Jul 06 20:00:52.785763 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.785695    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df2b4e5a-2f97-48fc-a002-fb16e602012b" (UID: "df2b4e5a-2f97-48fc-a002-fb16e602012b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:00:52.787395 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.787370    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99" (OuterVolumeSpecName: "kube-api-access-b2d99") pod "df2b4e5a-2f97-48fc-a002-fb16e602012b" (UID: "df2b4e5a-2f97-48fc-a002-fb16e602012b"). InnerVolumeSpecName "kube-api-access-b2d99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:52.787484 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.787425    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df2b4e5a-2f97-48fc-a002-fb16e602012b" (UID: "df2b4e5a-2f97-48fc-a002-fb16e602012b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:00:52.886310 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.886274    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2b4e5a-2f97-48fc-a002-fb16e602012b-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:00:52.886310 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.886302    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2d99\" (UniqueName: \"kubernetes.io/projected/df2b4e5a-2f97-48fc-a002-fb16e602012b-kube-api-access-b2d99\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:00:52.886310 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:52.886314    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2b4e5a-2f97-48fc-a002-fb16e602012b-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:00:53.075790 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.075685    2559 generic.go:356] "Generic (PLEG): container finished" podID="df2b4e5a-2f97-48fc-a002-fb16e602012b" containerID="2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87" exitCode=0
Jul 06 20:00:53.075790 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.075737    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"
Jul 06 20:00:53.075790 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.075770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" event={"ID":"df2b4e5a-2f97-48fc-a002-fb16e602012b","Type":"ContainerDied","Data":"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"}
Jul 06 20:00:53.076037 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.075830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r" event={"ID":"df2b4e5a-2f97-48fc-a002-fb16e602012b","Type":"ContainerDied","Data":"2bd479d982ecb9a01f75e34a95edb0fc9ca76668341df56eca807475104c0173"}
Jul 06 20:00:53.076037 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.075854    2559 scope.go:117] "RemoveContainer" containerID="2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"
Jul 06 20:00:53.085356 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.085335    2559 scope.go:117] "RemoveContainer" containerID="2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"
Jul 06 20:00:53.085677 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:00:53.085651    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87\": container with ID starting with 2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87 not found: ID does not exist" containerID="2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"
Jul 06 20:00:53.085783 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.085684    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87"} err="failed to get container status \"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87\": rpc error: code = NotFound desc = could not find container \"2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87\": container with ID starting with 2199d2db0c07a4d167f8351e72bda0c5de568d8633c40b733574c326a41f7b87 not found: ID does not exist"
Jul 06 20:00:53.097670 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.097639    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 20:00:53.099982 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.099957    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-34eebf-6d86ccd498-6gs7r"]
Jul 06 20:00:53.915675 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:53.915641    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2b4e5a-2f97-48fc-a002-fb16e602012b" path="/var/lib/kubelet/pods/df2b4e5a-2f97-48fc-a002-fb16e602012b/volumes"
Jul 06 20:00:54.988042 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:54.988005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:00:57.194175 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:00:57.194139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:05.419256 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:05.419215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:05.481944 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:05.481902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:05.642286 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:05.642243    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" podUID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" containerName="main" containerID="cri-o://f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2" gracePeriod=45
Jul 06 20:01:05.888668 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:05.888644    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 20:01:06.000041 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:05.999997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000086    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000148    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45494\" (UniqueName: \"kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs\") pod \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\" (UID: \"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47\") "
Jul 06 20:01:06.000485 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000324    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:06.000485 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000334    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home" (OuterVolumeSpecName: "home") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:06.000485 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000369    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:06.000610 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000531    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-home\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.000610 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000544    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tmp-dir\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.000610 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.000553    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-model-cache\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.002444 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.002418    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494" (OuterVolumeSpecName: "kube-api-access-45494") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "kube-api-access-45494". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:06.002444 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.002420    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm" (OuterVolumeSpecName: "dshm") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:06.002638 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.002457    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" (UID: "0fd3ce69-47d6-48ff-9344-16c9a7e3fc47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:06.101720 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.101682    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45494\" (UniqueName: \"kubernetes.io/projected/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-kube-api-access-45494\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.101720 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.101711    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-tls-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.101720 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.101722    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47-dshm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:06.137797 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.137760    2559 generic.go:356] "Generic (PLEG): container finished" podID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" containerID="f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2" exitCode=0
Jul 06 20:01:06.137957 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.137803    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"
Jul 06 20:01:06.137957 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.137810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" event={"ID":"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47","Type":"ContainerDied","Data":"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"}
Jul 06 20:01:06.137957 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.137852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2" event={"ID":"0fd3ce69-47d6-48ff-9344-16c9a7e3fc47","Type":"ContainerDied","Data":"6c43e0c175d937e66df1912ebde757d4363b32786a2157c9fbed4390225bc9f8"}
Jul 06 20:01:06.137957 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.137868    2559 scope.go:117] "RemoveContainer" containerID="f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"
Jul 06 20:01:06.146529 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.146513    2559 scope.go:117] "RemoveContainer" containerID="f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"
Jul 06 20:01:06.146926 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:06.146904    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2\": container with ID starting with f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2 not found: ID does not exist" containerID="f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"
Jul 06 20:01:06.147010 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.146933    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2"} err="failed to get container status \"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2\": rpc error: code = NotFound desc = could not find container \"f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2\": container with ID starting with f1bb8f781ea2e56802a4ed81a00ff43f11cd3491a5bbc22033d60f175e21e0b2 not found: ID does not exist"
Jul 06 20:01:06.162036 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.162011    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 20:01:06.168575 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:06.168553    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-34eebf/test-model-34eebf-kserve-87fcf6cf-ngqh2"]
Jul 06 20:01:07.916527 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:07.916493    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" path="/var/lib/kubelet/pods/0fd3ce69-47d6-48ff-9344-16c9a7e3fc47/volumes"
Jul 06 20:01:34.210971 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:34.210938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:34.573824 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:34.573732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:34.637687 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:34.637652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:34.716799 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:34.716755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:34.918036 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:34.917997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:35.350321 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.350234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:35.451120 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.451088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:35.550296 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.550253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:35.673612 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.673583    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 20:01:35.673855 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.673833    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" podUID="515c1339-547c-4d03-b79d-ab46d14c1cca" containerName="maas-api" containerID="cri-o://e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5" gracePeriod=30
Jul 06 20:01:35.728552 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.728523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:35.919134 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:35.919106    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 20:01:36.064201 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.064127    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca\") pod \"515c1339-547c-4d03-b79d-ab46d14c1cca\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") "
Jul 06 20:01:36.064345 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.064236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grldk\" (UniqueName: \"kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk\") pod \"515c1339-547c-4d03-b79d-ab46d14c1cca\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") "
Jul 06 20:01:36.064345 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.064262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls\") pod \"515c1339-547c-4d03-b79d-ab46d14c1cca\" (UID: \"515c1339-547c-4d03-b79d-ab46d14c1cca\") "
Jul 06 20:01:36.064472 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.064451    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "515c1339-547c-4d03-b79d-ab46d14c1cca" (UID: "515c1339-547c-4d03-b79d-ab46d14c1cca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:01:36.064749 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.064611    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515c1339-547c-4d03-b79d-ab46d14c1cca-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:36.066263 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.066239    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk" (OuterVolumeSpecName: "kube-api-access-grldk") pod "515c1339-547c-4d03-b79d-ab46d14c1cca" (UID: "515c1339-547c-4d03-b79d-ab46d14c1cca"). InnerVolumeSpecName "kube-api-access-grldk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:36.066366 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.066322    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "515c1339-547c-4d03-b79d-ab46d14c1cca" (UID: "515c1339-547c-4d03-b79d-ab46d14c1cca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:36.165045 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.165003    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grldk\" (UniqueName: \"kubernetes.io/projected/515c1339-547c-4d03-b79d-ab46d14c1cca-kube-api-access-grldk\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:36.165045 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.165036    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515c1339-547c-4d03-b79d-ab46d14c1cca-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:01:36.279141 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.279113    2559 generic.go:356] "Generic (PLEG): container finished" podID="515c1339-547c-4d03-b79d-ab46d14c1cca" containerID="e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5" exitCode=0
Jul 06 20:01:36.279290 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.279166    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"
Jul 06 20:01:36.279290 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.279201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" event={"ID":"515c1339-547c-4d03-b79d-ab46d14c1cca","Type":"ContainerDied","Data":"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"}
Jul 06 20:01:36.279290 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.279261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh" event={"ID":"515c1339-547c-4d03-b79d-ab46d14c1cca","Type":"ContainerDied","Data":"5a56108c64cc5872b0d4778df2a86ddfc4932b2dd80ba2c43cadb6651913386c"}
Jul 06 20:01:36.279290 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.279285    2559 scope.go:117] "RemoveContainer" containerID="e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"
Jul 06 20:01:36.290873 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.290854    2559 scope.go:117] "RemoveContainer" containerID="e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"
Jul 06 20:01:36.291167 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:36.291148    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5\": container with ID starting with e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5 not found: ID does not exist" containerID="e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"
Jul 06 20:01:36.291242 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.291179    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5"} err="failed to get container status \"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5\": rpc error: code = NotFound desc = could not find container \"e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5\": container with ID starting with e102aa287f3d7488d58faa9d4615560fc02ae12e2aa22002c95ef3b4a845b1b5 not found: ID does not exist"
Jul 06 20:01:36.302373 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.302349    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 20:01:36.306118 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:36.306092    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6bd627-6c58ccc875-7gdhh"]
Jul 06 20:01:37.915285 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:37.915252    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515c1339-547c-4d03-b79d-ab46d14c1cca" path="/var/lib/kubelet/pods/515c1339-547c-4d03-b79d-ab46d14c1cca/volumes"
Jul 06 20:01:38.299707 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:38.299614    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:01:41.711899 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:41.711867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:41.788502 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:41.788461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:41.987002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:41.986903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:42.227989 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:42.227946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:42.561980 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:42.561944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:42.889080 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:42.889048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:43.861449 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:43.861416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:46.198942 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.198910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:46.282069 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282033    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:01:46.282393 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282381    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2b4e5a-2f97-48fc-a002-fb16e602012b" containerName="maas-api"
Jul 06 20:01:46.282437 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282394    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2b4e5a-2f97-48fc-a002-fb16e602012b" containerName="maas-api"
Jul 06 20:01:46.282437 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282413    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515c1339-547c-4d03-b79d-ab46d14c1cca" containerName="maas-api"
Jul 06 20:01:46.282437 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282419    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="515c1339-547c-4d03-b79d-ab46d14c1cca" containerName="maas-api"
Jul 06 20:01:46.282437 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282429    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" containerName="main"
Jul 06 20:01:46.282437 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282435    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" containerName="main"
Jul 06 20:01:46.282594 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282489    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd3ce69-47d6-48ff-9344-16c9a7e3fc47" containerName="main"
Jul 06 20:01:46.282594 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282498    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2b4e5a-2f97-48fc-a002-fb16e602012b" containerName="maas-api"
Jul 06 20:01:46.282594 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.282506    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="515c1339-547c-4d03-b79d-ab46d14c1cca" containerName="maas-api"
Jul 06 20:01:46.291392 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.291365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.294133 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.294106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-aaefa8-serving-cert\""
Jul 06 20:01:46.303669 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.303597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:01:46.312247 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.312213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:46.360419 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.360387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.360616 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.360438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.360616 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.360516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvdm\" (UniqueName: \"kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.406947 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.406911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:46.461651 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.461538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.461651 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.461584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.461651 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.461617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvdm\" (UniqueName: \"kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.461940 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:46.461754    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-aaefa8-serving-cert: secret "maas-api-e2e-api-a-aaefa8-serving-cert" not found
Jul 06 20:01:46.461940 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:46.461857    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls podName:cf329a55-3537-49a1-9413-a1c1eb1bb9a5 nodeName:}" failed. No retries permitted until 2026-07-06 20:01:46.961822044 +0000 UTC m=+2329.599320764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls") pod "maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" (UID: "cf329a55-3537-49a1-9413-a1c1eb1bb9a5") : secret "maas-api-e2e-api-a-aaefa8-serving-cert" not found
Jul 06 20:01:46.462283 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.462262    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.470063 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.470035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvdm\" (UniqueName: \"kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.579482 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.579446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:46.964961 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.964927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:46.967333 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:46.967305    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") pod \"maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") " pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:47.019134 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:47.019099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:47.201922 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:47.201890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:47.210315 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:47.210283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:47.347967 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:47.347943    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:01:47.349676 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:01:47.349644    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf329a55_3537_49a1_9413_a1c1eb1bb9a5.slice/crio-c8ded76aec9a9a205cad4f694745e7cb25ae199c20a8634ee847e4b4c437e7c3 WatchSource:0}: Error finding container c8ded76aec9a9a205cad4f694745e7cb25ae199c20a8634ee847e4b4c437e7c3: Status 404 returned error can't find the container with id c8ded76aec9a9a205cad4f694745e7cb25ae199c20a8634ee847e4b4c437e7c3
Jul 06 20:01:48.335233 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:48.335193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" event={"ID":"cf329a55-3537-49a1-9413-a1c1eb1bb9a5","Type":"ContainerStarted","Data":"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"}
Jul 06 20:01:48.335654 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:48.335255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" event={"ID":"cf329a55-3537-49a1-9413-a1c1eb1bb9a5","Type":"ContainerStarted","Data":"c8ded76aec9a9a205cad4f694745e7cb25ae199c20a8634ee847e4b4c437e7c3"}
Jul 06 20:01:48.335654 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:48.335294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:48.445946 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:48.445892    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" podStartSLOduration=1.9822807249999999 podStartE2EDuration="2.445867131s" totalImagesPullingTime="463.586406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:48.443260236 +0000 UTC m=+2331.080758963" watchObservedRunningTime="2026-07-06 20:01:48.445867131 +0000 UTC m=+2331.083365859"
Jul 06 20:01:50.621531 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:50.621456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:51.101480 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:51.101376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:51.470909 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:51.470876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:51.703978 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:51.703946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:53.907694 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:53.907659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:01:54.202106 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.202003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.279808 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.279778    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:01:54.283593 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.283568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.286257 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.286230    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-a82399-serving-cert\""
Jul 06 20:01:54.310152 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.310117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:01:54.329727 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.329691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.329920 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.329746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.329920 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.329762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.338931 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.338901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.345828 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.345806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:01:54.430743 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.430708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.430943 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.430787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.430943 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.430813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.431134 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:54.430945    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-a82399-serving-cert: secret "maas-api-e2e-api-b-a82399-serving-cert" not found
Jul 06 20:01:54.431134 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:01:54.431017    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls podName:008fda12-bf98-4861-a353-a24c5642b2bc nodeName:}" failed. No retries permitted until 2026-07-06 20:01:54.93099452 +0000 UTC m=+2337.568493225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls") pod "maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" (UID: "008fda12-bf98-4861-a353-a24c5642b2bc") : secret "maas-api-e2e-api-b-a82399-serving-cert" not found
Jul 06 20:01:54.431845 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.431819    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.450790 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.450763    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.453829 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.453757    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.868129 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.868093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.935053 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.935013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:54.937397 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:54.937373    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") pod \"maas-api-e2e-api-b-a82399-647fd5477f-mwsv9\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") " pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:55.197032 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:55.196944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:55.360826 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:55.360659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:01:55.363718 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:01:55.363671    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008fda12_bf98_4861_a353_a24c5642b2bc.slice/crio-63b824cea794db845cc57f80fb2b55b4a54681832c0cecb3e4d65a69d15cb0e3 WatchSource:0}: Error finding container 63b824cea794db845cc57f80fb2b55b4a54681832c0cecb3e4d65a69d15cb0e3: Status 404 returned error can't find the container with id 63b824cea794db845cc57f80fb2b55b4a54681832c0cecb3e4d65a69d15cb0e3
Jul 06 20:01:55.372541 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:55.372474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:55.373172 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:55.373153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" event={"ID":"008fda12-bf98-4861-a353-a24c5642b2bc","Type":"ContainerStarted","Data":"63b824cea794db845cc57f80fb2b55b4a54681832c0cecb3e4d65a69d15cb0e3"}
Jul 06 20:01:55.516270 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:55.516162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:56.379991 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:56.379950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" event={"ID":"008fda12-bf98-4861-a353-a24c5642b2bc","Type":"ContainerStarted","Data":"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"}
Jul 06 20:01:56.380474 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:56.380118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:01:56.401808 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:56.401751    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" podStartSLOduration=2.089672731 podStartE2EDuration="2.401733855s" totalImagesPullingTime="312.061124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:56.400259408 +0000 UTC m=+2339.037758137" watchObservedRunningTime="2026-07-06 20:01:56.401733855 +0000 UTC m=+2339.039232584"
Jul 06 20:01:58.659391 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:01:58.659347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:02.390088 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:02.390059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:02:06.897548 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:06.897512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:07.095911 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.095877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:02:07.237131 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.237040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:07.468584 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.468547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:07.578579 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.578490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:07.781271 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.781236    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:02:07.781455 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.781427    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" podUID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" containerName="maas-api" containerID="cri-o://86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee" gracePeriod=30
Jul 06 20:02:07.847720 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:07.847610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:08.026910 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.026888    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:02:08.155955 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.155919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgvdm\" (UniqueName: \"kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm\") pod \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") "
Jul 06 20:02:08.156161 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.156010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") pod \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") "
Jul 06 20:02:08.156161 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.156035    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca\") pod \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\" (UID: \"cf329a55-3537-49a1-9413-a1c1eb1bb9a5\") "
Jul 06 20:02:08.156444 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.156419    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf329a55-3537-49a1-9413-a1c1eb1bb9a5" (UID: "cf329a55-3537-49a1-9413-a1c1eb1bb9a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:08.158027 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.158006    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm" (OuterVolumeSpecName: "kube-api-access-hgvdm") pod "cf329a55-3537-49a1-9413-a1c1eb1bb9a5" (UID: "cf329a55-3537-49a1-9413-a1c1eb1bb9a5"). InnerVolumeSpecName "kube-api-access-hgvdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:08.158119 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.158039    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf329a55-3537-49a1-9413-a1c1eb1bb9a5" (UID: "cf329a55-3537-49a1-9413-a1c1eb1bb9a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:02:08.257349 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.257314    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:08.257349 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.257345    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:08.257541 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.257357    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgvdm\" (UniqueName: \"kubernetes.io/projected/cf329a55-3537-49a1-9413-a1c1eb1bb9a5-kube-api-access-hgvdm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:08.436330 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.436235    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" containerID="86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee" exitCode=0
Jul 06 20:02:08.436330 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.436278    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"
Jul 06 20:02:08.436330 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.436317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" event={"ID":"cf329a55-3537-49a1-9413-a1c1eb1bb9a5","Type":"ContainerDied","Data":"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"}
Jul 06 20:02:08.436587 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.436369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl" event={"ID":"cf329a55-3537-49a1-9413-a1c1eb1bb9a5","Type":"ContainerDied","Data":"c8ded76aec9a9a205cad4f694745e7cb25ae199c20a8634ee847e4b4c437e7c3"}
Jul 06 20:02:08.436587 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.436390    2559 scope.go:117] "RemoveContainer" containerID="86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"
Jul 06 20:02:08.445561 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.445543    2559 scope.go:117] "RemoveContainer" containerID="86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"
Jul 06 20:02:08.445820 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:08.445802    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee\": container with ID starting with 86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee not found: ID does not exist" containerID="86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"
Jul 06 20:02:08.445874 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.445829    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee"} err="failed to get container status \"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee\": rpc error: code = NotFound desc = could not find container \"86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee\": container with ID starting with 86e43c61e28e207279454a7550dfb4f8558a8bbfaa7d6ccdf7054420e8031fee not found: ID does not exist"
Jul 06 20:02:08.461589 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.461561    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:02:08.465889 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:08.465861    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-aaefa8-7987b89758-4lxzl"]
Jul 06 20:02:09.915481 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:09.915450    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" path="/var/lib/kubelet/pods/cf329a55-3537-49a1-9413-a1c1eb1bb9a5/volumes"
Jul 06 20:02:13.525273 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:13.525234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:13.950915 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:13.950884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:14.238219 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:14.238127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:14.624125 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:14.624091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:14.869136 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:14.869104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:15.055050 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:15.054964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:15.280136 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:15.280101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:15.549095 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:15.549057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.156985 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.156957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.302948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.302917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.422908 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.422823    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:02:16.423047 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.423009    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" podUID="008fda12-bf98-4861-a353-a24c5642b2bc" containerName="maas-api" containerID="cri-o://76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4" gracePeriod=30
Jul 06 20:02:16.478925 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.478888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.664125 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.664104    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:02:16.735728 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.735557    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") pod \"008fda12-bf98-4861-a353-a24c5642b2bc\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") "
Jul 06 20:02:16.735898 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.735769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7\") pod \"008fda12-bf98-4861-a353-a24c5642b2bc\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") "
Jul 06 20:02:16.735898 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.735822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca\") pod \"008fda12-bf98-4861-a353-a24c5642b2bc\" (UID: \"008fda12-bf98-4861-a353-a24c5642b2bc\") "
Jul 06 20:02:16.736200 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.736178    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "008fda12-bf98-4861-a353-a24c5642b2bc" (UID: "008fda12-bf98-4861-a353-a24c5642b2bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:16.737594 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.737557    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "008fda12-bf98-4861-a353-a24c5642b2bc" (UID: "008fda12-bf98-4861-a353-a24c5642b2bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:02:16.737725 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.737675    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7" (OuterVolumeSpecName: "kube-api-access-bsfk7") pod "008fda12-bf98-4861-a353-a24c5642b2bc" (UID: "008fda12-bf98-4861-a353-a24c5642b2bc"). InnerVolumeSpecName "kube-api-access-bsfk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:16.837467 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.837434    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/008fda12-bf98-4861-a353-a24c5642b2bc-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:16.837467 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.837461    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/008fda12-bf98-4861-a353-a24c5642b2bc-kube-api-access-bsfk7\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:16.837467 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:16.837470    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/008fda12-bf98-4861-a353-a24c5642b2bc-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:02:17.481613 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.481531    2559 generic.go:356] "Generic (PLEG): container finished" podID="008fda12-bf98-4861-a353-a24c5642b2bc" containerID="76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4" exitCode=0
Jul 06 20:02:17.481613 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.481576    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"
Jul 06 20:02:17.482235 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.481591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" event={"ID":"008fda12-bf98-4861-a353-a24c5642b2bc","Type":"ContainerDied","Data":"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"}
Jul 06 20:02:17.482235 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.481696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9" event={"ID":"008fda12-bf98-4861-a353-a24c5642b2bc","Type":"ContainerDied","Data":"63b824cea794db845cc57f80fb2b55b4a54681832c0cecb3e4d65a69d15cb0e3"}
Jul 06 20:02:17.482235 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.481755    2559 scope.go:117] "RemoveContainer" containerID="76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"
Jul 06 20:02:17.490831 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.490814    2559 scope.go:117] "RemoveContainer" containerID="76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"
Jul 06 20:02:17.491104 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:17.491085    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4\": container with ID starting with 76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4 not found: ID does not exist" containerID="76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"
Jul 06 20:02:17.491157 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.491112    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4"} err="failed to get container status \"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4\": rpc error: code = NotFound desc = could not find container \"76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4\": container with ID starting with 76543490e27e4353c3b216861538f07329eb54dc7a3d9b8248d6d8d80e8ab5a4 not found: ID does not exist"
Jul 06 20:02:17.511224 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.511194    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:02:17.516842 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.516818    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-a82399-647fd5477f-mwsv9"]
Jul 06 20:02:17.917581 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:17.917547    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="008fda12-bf98-4861-a353-a24c5642b2bc" path="/var/lib/kubelet/pods/008fda12-bf98-4861-a353-a24c5642b2bc/volumes"
Jul 06 20:02:18.414140 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:18.414111    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:02:20.995598 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:20.995559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:21.096769 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:21.096723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:21.255071 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:21.254979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:21.463158 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:21.463100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:21.792004 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:21.791974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:22.151920 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:22.151886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:22.518000 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:22.517918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.374330 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.374296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.515403 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.515367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.628558 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628482    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:02:25.628862 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628849    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008fda12-bf98-4861-a353-a24c5642b2bc" containerName="maas-api"
Jul 06 20:02:25.628907 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628866    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="008fda12-bf98-4861-a353-a24c5642b2bc" containerName="maas-api"
Jul 06 20:02:25.628907 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628894    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" containerName="maas-api"
Jul 06 20:02:25.628907 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628900    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" containerName="maas-api"
Jul 06 20:02:25.629000 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628950    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="008fda12-bf98-4861-a353-a24c5642b2bc" containerName="maas-api"
Jul 06 20:02:25.629000 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.628962    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf329a55-3537-49a1-9413-a1c1eb1bb9a5" containerName="maas-api"
Jul 06 20:02:25.632204 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.632183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.636813 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.636793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-c21a78-serving-cert\""
Jul 06 20:02:25.659109 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.659083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:02:25.739860 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.739817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.817896 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.817854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.817896 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.817897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.818149 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.817931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72n4t\" (UniqueName: \"kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.918535 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.918444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.918535 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.918482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.918535 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.918524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72n4t\" (UniqueName: \"kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.918852 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:25.918590    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-c21a78-serving-cert: secret "maas-api-e2e-shared-a-c21a78-serving-cert" not found
Jul 06 20:02:25.918852 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:25.918664    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls podName:38eab34f-da71-4573-bd48-baffec1754f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:02:26.418647873 +0000 UTC m=+2369.056146578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls") pod "maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" (UID: "38eab34f-da71-4573-bd48-baffec1754f0") : secret "maas-api-e2e-shared-a-c21a78-serving-cert" not found
Jul 06 20:02:25.919140 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.919122    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:25.944872 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:25.944845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72n4t\" (UniqueName: \"kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:26.251462 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.251359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:26.423494 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.423447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:26.426150 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.426122    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") " pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:26.496816 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.496752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:26.542681 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.542567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:26.699489 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.699463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:02:26.702336 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:02:26.702309    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eab34f_da71_4573_bd48_baffec1754f0.slice/crio-fb5d249f17890f0f1a10c19d15bc62c71f9dfa8d75fe3f7f11b8e30e216b8cd8 WatchSource:0}: Error finding container fb5d249f17890f0f1a10c19d15bc62c71f9dfa8d75fe3f7f11b8e30e216b8cd8: Status 404 returned error can't find the container with id fb5d249f17890f0f1a10c19d15bc62c71f9dfa8d75fe3f7f11b8e30e216b8cd8
Jul 06 20:02:26.791129 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:26.791091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:27.529649 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:27.529522    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" event={"ID":"38eab34f-da71-4573-bd48-baffec1754f0","Type":"ContainerStarted","Data":"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"}
Jul 06 20:02:27.529649 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:27.529582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" event={"ID":"38eab34f-da71-4573-bd48-baffec1754f0","Type":"ContainerStarted","Data":"fb5d249f17890f0f1a10c19d15bc62c71f9dfa8d75fe3f7f11b8e30e216b8cd8"}
Jul 06 20:02:27.529649 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:27.529609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:27.563971 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:27.563920    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" podStartSLOduration=2.104106121 podStartE2EDuration="2.56390244s" totalImagesPullingTime="459.796319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:27.562098953 +0000 UTC m=+2370.199597683" watchObservedRunningTime="2026-07-06 20:02:27.56390244 +0000 UTC m=+2370.201401168"
Jul 06 20:02:29.879868 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:29.879834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:30.224914 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:30.224828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:30.676968 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:30.676933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:30.954593 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:30.954508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.457057 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.457024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.540580 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.540556    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:02:33.541344 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.541326    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:02:33.613244 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.613211    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:02:33.616844 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.616822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.622335 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.622309    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-f7a150-serving-cert\""
Jul 06 20:02:33.646188 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.646155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:02:33.685960 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.685921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.686166 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.685972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.686166 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.686106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zdj9\" (UniqueName: \"kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.694666 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.694612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.786830 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.786744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.786830 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.786792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.787045 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.786860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zdj9\" (UniqueName: \"kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.787045 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:33.786968    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f7a150-serving-cert: secret "maas-api-e2e-shared-b-f7a150-serving-cert" not found
Jul 06 20:02:33.787111 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:02:33.787047    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls podName:300353aa-59eb-4291-99b3-e84f58bcec6d nodeName:}" failed. No retries permitted until 2026-07-06 20:02:34.287023769 +0000 UTC m=+2376.924522476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls") pod "maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" (UID: "300353aa-59eb-4291-99b3-e84f58bcec6d") : secret "maas-api-e2e-shared-b-f7a150-serving-cert" not found
Jul 06 20:02:33.787513 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.787496    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.832842 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.832806    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zdj9\" (UniqueName: \"kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:33.983153 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:33.983118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:34.247722 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.247681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:34.291012 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.290981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:34.293374 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.293352    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") " pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:34.527739 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.527649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:34.597355 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.597320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:34.668421 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.668396    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:02:34.670450 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:02:34.670428    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300353aa_59eb_4291_99b3_e84f58bcec6d.slice/crio-bcda140f868a8abfeaccf1eb52865a2340a88e65f0219d4e7eabd50c77d9a526 WatchSource:0}: Error finding container bcda140f868a8abfeaccf1eb52865a2340a88e65f0219d4e7eabd50c77d9a526: Status 404 returned error can't find the container with id bcda140f868a8abfeaccf1eb52865a2340a88e65f0219d4e7eabd50c77d9a526
Jul 06 20:02:34.696842 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:34.696815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:35.568209 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:35.568168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" event={"ID":"300353aa-59eb-4291-99b3-e84f58bcec6d","Type":"ContainerStarted","Data":"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"}
Jul 06 20:02:35.568744 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:35.568260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" event={"ID":"300353aa-59eb-4291-99b3-e84f58bcec6d","Type":"ContainerStarted","Data":"bcda140f868a8abfeaccf1eb52865a2340a88e65f0219d4e7eabd50c77d9a526"}
Jul 06 20:02:35.568744 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:35.568300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:35.591854 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:35.591803    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" podStartSLOduration=2.233204923 podStartE2EDuration="2.591786487s" totalImagesPullingTime="358.581564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:35.591108401 +0000 UTC m=+2378.228607132" watchObservedRunningTime="2026-07-06 20:02:35.591786487 +0000 UTC m=+2378.229285225"
Jul 06 20:02:37.935814 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:37.935773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:41.579243 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:41.579216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:02:49.588548 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:49.588502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:02:55.300482 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:55.300425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:55.835995 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:55.835959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:55.938881 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:55.938848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:56.678958 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:56.678925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:56.849363 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:56.849332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:57.524167 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:57.524130    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:57.624848 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:57.624820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:58.486868 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:58.486831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:58.588280 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:02:58.588252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:04.487217 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:04.487184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:03:20.696875 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.696800    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:03:20.699746 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.699730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.702457 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.702438    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"default-dockercfg-qxfbv\""
Jul 06 20:03:20.702979 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.702960    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"kube-root-ca.crt\""
Jul 06 20:03:20.703071 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.703054    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"auth-test-model-f7a150-kserve-self-signed-certs\""
Jul 06 20:03:20.703134 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.703113    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"openshift-service-ca.crt\""
Jul 06 20:03:20.712556 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.712532    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:03:20.783993 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.783962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.783993 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.783995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ptq\" (UniqueName: \"kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.784193 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.784093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.784193 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.784162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.784267 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.784220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.784302 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.784276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.824015 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.823980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:20.885788 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.885994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.885994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.885994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ptq\" (UniqueName: \"kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.885994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.885994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.885924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.886266 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.886221    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.886266 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.886249    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.886391 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.886372    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.888196 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.888173    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.888484 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.888464    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:20.898440 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:20.898414    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ptq\" (UniqueName: \"kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq\") pod \"auth-test-model-f7a150-kserve-7ddc778987-smqj2\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") " pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:21.009169 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:21.009080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:21.142772 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:21.142646    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:03:21.144830 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:03:21.144802    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82742025_76fd_47ec_9e59_d57e9e26d690.slice/crio-f384a534c3823957052577bded3cf2d6db1862325c44fde18c10d2e9b6124737 WatchSource:0}: Error finding container f384a534c3823957052577bded3cf2d6db1862325c44fde18c10d2e9b6124737: Status 404 returned error can't find the container with id f384a534c3823957052577bded3cf2d6db1862325c44fde18c10d2e9b6124737
Jul 06 20:03:21.782740 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:21.782700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" event={"ID":"82742025-76fd-47ec-9e59-d57e9e26d690","Type":"ContainerStarted","Data":"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"}
Jul 06 20:03:21.783124 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:21.782747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" event={"ID":"82742025-76fd-47ec-9e59-d57e9e26d690","Type":"ContainerStarted","Data":"f384a534c3823957052577bded3cf2d6db1862325c44fde18c10d2e9b6124737"}
Jul 06 20:03:21.800962 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:21.800900    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" podStartSLOduration=1.800881124 podStartE2EDuration="1.800881124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:21.800184014 +0000 UTC m=+2424.437682743" watchObservedRunningTime="2026-07-06 20:03:21.800881124 +0000 UTC m=+2424.438379853"
Jul 06 20:03:25.502932 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:25.502898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:03:31.009902 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.009860    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:31.010357 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.009935    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:31.022780 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.022751    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:31.842099 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.842072    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:03:31.890444 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.890415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:31.991391 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:31.991361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:41.489037 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:41.489006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:03:57.096286 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:03:57.096247    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:04:15.195402 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:04:15.195356    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:04:33.199919 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:04:33.199878    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:04:50.322808 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:04:50.322715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:05:06.020043 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:06.020010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:05:19.126223 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:19.126179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:19.840965 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:19.840936    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:05:19.881826 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:19.881791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:22.706155 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:22.706119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:05:24.063903 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:24.063864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:34.859982 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:34.859922    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" podUID="82742025-76fd-47ec-9e59-d57e9e26d690" containerName="main" containerID="cri-o://357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc" gracePeriod=45
Jul 06 20:05:35.111858 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.111797    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:05:35.240776 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240741    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.240948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240787    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.240948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.240948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240876    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.240948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240918    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.240948 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.240943    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5ptq\" (UniqueName: \"kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq\") pod \"82742025-76fd-47ec-9e59-d57e9e26d690\" (UID: \"82742025-76fd-47ec-9e59-d57e9e26d690\") "
Jul 06 20:05:35.241188 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.241101    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:35.241188 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.241127    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache" (OuterVolumeSpecName: "model-cache") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:35.241302 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.241203    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home" (OuterVolumeSpecName: "home") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:35.241302 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.241239    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-model-cache\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.241302 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.241253    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-tmp-dir\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.243050 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.243025    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm" (OuterVolumeSpecName: "dshm") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:35.243163 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.243078    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:05:35.243163 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.243086    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq" (OuterVolumeSpecName: "kube-api-access-q5ptq") pod "82742025-76fd-47ec-9e59-d57e9e26d690" (UID: "82742025-76fd-47ec-9e59-d57e9e26d690"). InnerVolumeSpecName "kube-api-access-q5ptq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:05:35.341904 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.341856    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82742025-76fd-47ec-9e59-d57e9e26d690-tls-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.341904 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.341895    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-home\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.341904 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.341906    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5ptq\" (UniqueName: \"kubernetes.io/projected/82742025-76fd-47ec-9e59-d57e9e26d690-kube-api-access-q5ptq\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.341904 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.341915    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82742025-76fd-47ec-9e59-d57e9e26d690-dshm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:05:35.407413 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.407376    2559 generic.go:356] "Generic (PLEG): container finished" podID="82742025-76fd-47ec-9e59-d57e9e26d690" containerID="357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc" exitCode=0
Jul 06 20:05:35.407413 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.407417    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"
Jul 06 20:05:35.407667 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.407461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" event={"ID":"82742025-76fd-47ec-9e59-d57e9e26d690","Type":"ContainerDied","Data":"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"}
Jul 06 20:05:35.407667 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.407497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2" event={"ID":"82742025-76fd-47ec-9e59-d57e9e26d690","Type":"ContainerDied","Data":"f384a534c3823957052577bded3cf2d6db1862325c44fde18c10d2e9b6124737"}
Jul 06 20:05:35.407667 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.407514    2559 scope.go:117] "RemoveContainer" containerID="357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"
Jul 06 20:05:35.418587 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.418524    2559 scope.go:117] "RemoveContainer" containerID="357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"
Jul 06 20:05:35.419022 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:05:35.418998    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc\": container with ID starting with 357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc not found: ID does not exist" containerID="357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"
Jul 06 20:05:35.419081 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.419035    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc"} err="failed to get container status \"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc\": rpc error: code = NotFound desc = could not find container \"357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc\": container with ID starting with 357ef5435cfc7e10a2fa88ae3e28c9d3620704ce1df79dee02684e6d62ed55dc not found: ID does not exist"
Jul 06 20:05:35.432661 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.432615    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:05:35.437724 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.437699    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/auth-test-model-f7a150-kserve-7ddc778987-smqj2"]
Jul 06 20:05:35.916852 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:35.916823    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82742025-76fd-47ec-9e59-d57e9e26d690" path="/var/lib/kubelet/pods/82742025-76fd-47ec-9e59-d57e9e26d690/volumes"
Jul 06 20:05:38.728003 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:38.727967    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:05:49.939003 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.938966    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:05:49.939382 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.939322    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82742025-76fd-47ec-9e59-d57e9e26d690" containerName="main"
Jul 06 20:05:49.939382 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.939332    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82742025-76fd-47ec-9e59-d57e9e26d690" containerName="main"
Jul 06 20:05:49.939454 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.939396    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82742025-76fd-47ec-9e59-d57e9e26d690" containerName="main"
Jul 06 20:05:49.943774 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.943758    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.955968 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.955945    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"default-dockercfg-qxfbv\""
Jul 06 20:05:49.956707 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.956673    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"openshift-service-ca.crt\""
Jul 06 20:05:49.956843 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.956711    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"sub-test-model-f7a150-kserve-self-signed-certs\""
Jul 06 20:05:49.956843 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.956809    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"kube-root-ca.crt\""
Jul 06 20:05:49.967415 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.967385    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:05:49.978800 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.978772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xh8m\" (UniqueName: \"kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.978917 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.978814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.978917 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.978843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.978917 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.978884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.979034 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.978941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.979071 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.979031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:49.993751 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:49.993726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:50.079514 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xh8m\" (UniqueName: \"kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.079514 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.079802 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.079802 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.079802 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.079802 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.080009 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.079978    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.080093 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.080071    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.080146 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.080114    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.081827 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.081805    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.082078 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.082061    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.090577 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.090546    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xh8m\" (UniqueName: \"kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m\") pod \"sub-test-model-f7a150-kserve-84d8576c67-zwbm8\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") " pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.252344 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.252253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:05:50.392504 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.392479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:05:50.395177 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:05:50.395148    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91255bf5_9481_4cf7_8521_423c7183f7e3.slice/crio-1abcc06ed915e0e8042eaf657847d5bc7adca7660cfc995068535701cca021bf WatchSource:0}: Error finding container 1abcc06ed915e0e8042eaf657847d5bc7adca7660cfc995068535701cca021bf: Status 404 returned error can't find the container with id 1abcc06ed915e0e8042eaf657847d5bc7adca7660cfc995068535701cca021bf
Jul 06 20:05:50.477939 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.477907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" event={"ID":"91255bf5-9481-4cf7-8521-423c7183f7e3","Type":"ContainerStarted","Data":"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"}
Jul 06 20:05:50.478098 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.477950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" event={"ID":"91255bf5-9481-4cf7-8521-423c7183f7e3","Type":"ContainerStarted","Data":"1abcc06ed915e0e8042eaf657847d5bc7adca7660cfc995068535701cca021bf"}
Jul 06 20:05:50.532747 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:50.532638    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" podStartSLOduration=1.532606667 podStartE2EDuration="1.532606667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:50.53185881 +0000 UTC m=+2573.169357538" watchObservedRunningTime="2026-07-06 20:05:50.532606667 +0000 UTC m=+2573.170105394"
Jul 06 20:05:57.569058 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:05:57.569022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:06:00.253468 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:00.253420    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:00.253886 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:00.253489    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:00.265899 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:00.265874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:00.536258 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:00.536170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:18.841842 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:18.841806    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:06:26.059103 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:26.059071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:26.818854 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:26.818817    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:06:26.847314 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:26.847282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:36.702315 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:36.702275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:06:37.927450 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:37.927417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:41.838479 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:41.838406    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" podUID="91255bf5-9481-4cf7-8521-423c7183f7e3" containerName="main" containerID="cri-o://112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22" gracePeriod=45
Jul 06 20:06:42.091548 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.091487    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:42.155845 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.155815    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156022 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.155859    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156022 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.155893    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156022 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.155916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xh8m\" (UniqueName: \"kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156022 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.155998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156022 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.156022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache\") pod \"91255bf5-9481-4cf7-8521-423c7183f7e3\" (UID: \"91255bf5-9481-4cf7-8521-423c7183f7e3\") "
Jul 06 20:06:42.156302 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.156136    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:42.156414 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.156378    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:42.156414 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.156403    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-tmp-dir\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.156606 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.156418    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home" (OuterVolumeSpecName: "home") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:42.158091 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.158062    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:42.158196 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.158110    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m" (OuterVolumeSpecName: "kube-api-access-5xh8m") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "kube-api-access-5xh8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:42.158376 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.158353    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm" (OuterVolumeSpecName: "dshm") pod "91255bf5-9481-4cf7-8521-423c7183f7e3" (UID: "91255bf5-9481-4cf7-8521-423c7183f7e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:42.257049 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.257013    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-home\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.257049 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.257046    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-model-cache\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.257049 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.257055    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91255bf5-9481-4cf7-8521-423c7183f7e3-dshm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.257471 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.257063    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91255bf5-9481-4cf7-8521-423c7183f7e3-tls-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.257471 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.257072    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xh8m\" (UniqueName: \"kubernetes.io/projected/91255bf5-9481-4cf7-8521-423c7183f7e3-kube-api-access-5xh8m\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:06:42.726021 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.725985    2559 generic.go:356] "Generic (PLEG): container finished" podID="91255bf5-9481-4cf7-8521-423c7183f7e3" containerID="112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22" exitCode=0
Jul 06 20:06:42.726237 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.726026    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"
Jul 06 20:06:42.726237 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.726077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" event={"ID":"91255bf5-9481-4cf7-8521-423c7183f7e3","Type":"ContainerDied","Data":"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"}
Jul 06 20:06:42.726237 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.726124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8" event={"ID":"91255bf5-9481-4cf7-8521-423c7183f7e3","Type":"ContainerDied","Data":"1abcc06ed915e0e8042eaf657847d5bc7adca7660cfc995068535701cca021bf"}
Jul 06 20:06:42.726237 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.726147    2559 scope.go:117] "RemoveContainer" containerID="112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"
Jul 06 20:06:42.736837 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.736789    2559 scope.go:117] "RemoveContainer" containerID="112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"
Jul 06 20:06:42.737354 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:06:42.737334    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22\": container with ID starting with 112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22 not found: ID does not exist" containerID="112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"
Jul 06 20:06:42.737424 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.737364    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22"} err="failed to get container status \"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22\": rpc error: code = NotFound desc = could not find container \"112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22\": container with ID starting with 112aa632dd3ef79ae4cb764d479a919d8729f3d5832b8fc4d47a88b4e4195e22 not found: ID does not exist"
Jul 06 20:06:42.747669 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.747643    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:06:42.752357 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:42.752336    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/sub-test-model-f7a150-kserve-84d8576c67-zwbm8"]
Jul 06 20:06:43.856771 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:43.856727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:43.915457 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:43.915425    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91255bf5-9481-4cf7-8521-423c7183f7e3" path="/var/lib/kubelet/pods/91255bf5-9481-4cf7-8521-423c7183f7e3/volumes"
Jul 06 20:06:48.122475 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:06:48.122432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:07:17.002407 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.002372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:17.232765 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.232728    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:07:17.233096 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.233084    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91255bf5-9481-4cf7-8521-423c7183f7e3" containerName="main"
Jul 06 20:07:17.233153 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.233097    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91255bf5-9481-4cf7-8521-423c7183f7e3" containerName="main"
Jul 06 20:07:17.233191 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.233161    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91255bf5-9481-4cf7-8521-423c7183f7e3" containerName="main"
Jul 06 20:07:17.236055 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.236039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.243010 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.242987    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"kube-root-ca.crt\""
Jul 06 20:07:17.243759 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.243738    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"default-dockercfg-qxfbv\""
Jul 06 20:07:17.243821 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.243743    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"rate-test-model-f7a150-kserve-self-signed-certs\""
Jul 06 20:07:17.243821 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.243792    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a150\"/\"openshift-service-ca.crt\""
Jul 06 20:07:17.281282 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.281282 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.281486 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.281486 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxq88\" (UniqueName: \"kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.281486 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.281486 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.281381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.288245 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.288211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:07:17.336217 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.336166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:17.382119 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382301 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382301 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382301 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxq88\" (UniqueName: \"kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382301 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382301 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382555 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382644 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382573    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.382704 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.382649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.384515 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.384489    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.384753 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.384736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.401297 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.401270    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxq88\" (UniqueName: \"kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88\") pod \"rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") " pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.494336 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.494304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:17.545380 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.545290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:17.717840 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.717805    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:07:17.720968 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:07:17.720942    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5652a68_e8f0_46bb_9204_55c5cf6bee23.slice/crio-152d440873e5cb31395ee12be12bb64c3efa8e841c98cf92261356feb140af98 WatchSource:0}: Error finding container 152d440873e5cb31395ee12be12bb64c3efa8e841c98cf92261356feb140af98: Status 404 returned error can't find the container with id 152d440873e5cb31395ee12be12bb64c3efa8e841c98cf92261356feb140af98
Jul 06 20:07:17.889483 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.889449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" event={"ID":"e5652a68-e8f0-46bb-9204-55c5cf6bee23","Type":"ContainerStarted","Data":"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"}
Jul 06 20:07:17.889671 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.889498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" event={"ID":"e5652a68-e8f0-46bb-9204-55c5cf6bee23","Type":"ContainerStarted","Data":"152d440873e5cb31395ee12be12bb64c3efa8e841c98cf92261356feb140af98"}
Jul 06 20:07:17.912189 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:17.912130    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" podStartSLOduration=0.912111072 podStartE2EDuration="912.111072ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:17.910389715 +0000 UTC m=+2660.547888443" watchObservedRunningTime="2026-07-06 20:07:17.912111072 +0000 UTC m=+2660.549609801"
Jul 06 20:07:23.724897 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:23.724856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:07:27.546295 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:27.546257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:27.546788 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:27.546535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:27.558908 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:27.558883    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:27.946563 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:27.946535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:07:38.739116 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:38.739079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:07:59.175338 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:59.175244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:59.289139 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:07:59.289103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:00.240793 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:00.240754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:00.335990 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:00.335950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:10.718433 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:10.718395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:08:14.691644 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:14.691603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:15.791762 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:15.791724    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:08:15.888522 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:15.888488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:16.968596 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:16.968558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:17.517747 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:17.517715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:17.915088 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:17.915052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:18.051711 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.051674    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:18.233034 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.232954    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:08:18.233247 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.233219    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" podUID="38eab34f-da71-4573-bd48-baffec1754f0" containerName="maas-api" containerID="cri-o://f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964" gracePeriod=30
Jul 06 20:08:18.348724 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.348699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:18.473799 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.473777    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:08:18.532195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.532112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca\") pod \"38eab34f-da71-4573-bd48-baffec1754f0\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") "
Jul 06 20:08:18.532195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.532144    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72n4t\" (UniqueName: \"kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t\") pod \"38eab34f-da71-4573-bd48-baffec1754f0\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") "
Jul 06 20:08:18.532374 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.532213    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") pod \"38eab34f-da71-4573-bd48-baffec1754f0\" (UID: \"38eab34f-da71-4573-bd48-baffec1754f0\") "
Jul 06 20:08:18.532522 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.532502    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38eab34f-da71-4573-bd48-baffec1754f0" (UID: "38eab34f-da71-4573-bd48-baffec1754f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:08:18.534277 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.534246    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t" (OuterVolumeSpecName: "kube-api-access-72n4t") pod "38eab34f-da71-4573-bd48-baffec1754f0" (UID: "38eab34f-da71-4573-bd48-baffec1754f0"). InnerVolumeSpecName "kube-api-access-72n4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:18.534402 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.534339    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38eab34f-da71-4573-bd48-baffec1754f0" (UID: "38eab34f-da71-4573-bd48-baffec1754f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:18.633378 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.633340    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38eab34f-da71-4573-bd48-baffec1754f0-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:18.633378 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.633370    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72n4t\" (UniqueName: \"kubernetes.io/projected/38eab34f-da71-4573-bd48-baffec1754f0-kube-api-access-72n4t\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:18.633378 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:18.633380    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38eab34f-da71-4573-bd48-baffec1754f0-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:19.173883 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.173849    2559 generic.go:356] "Generic (PLEG): container finished" podID="38eab34f-da71-4573-bd48-baffec1754f0" containerID="f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964" exitCode=0
Jul 06 20:08:19.174286 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.173892    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"
Jul 06 20:08:19.174286 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.173894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" event={"ID":"38eab34f-da71-4573-bd48-baffec1754f0","Type":"ContainerDied","Data":"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"}
Jul 06 20:08:19.174286 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.173952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8" event={"ID":"38eab34f-da71-4573-bd48-baffec1754f0","Type":"ContainerDied","Data":"fb5d249f17890f0f1a10c19d15bc62c71f9dfa8d75fe3f7f11b8e30e216b8cd8"}
Jul 06 20:08:19.175088 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.173974    2559 scope.go:117] "RemoveContainer" containerID="f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"
Jul 06 20:08:19.184130 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.184101    2559 scope.go:117] "RemoveContainer" containerID="f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"
Jul 06 20:08:19.184424 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:08:19.184404    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964\": container with ID starting with f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964 not found: ID does not exist" containerID="f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"
Jul 06 20:08:19.184479 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.184432    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964"} err="failed to get container status \"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964\": rpc error: code = NotFound desc = could not find container \"f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964\": container with ID starting with f303d3085857b56cb489a6f577530932ccbc6ef290e2fe81eee1dcc259fbd964 not found: ID does not exist"
Jul 06 20:08:19.199580 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.199550    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:08:19.205847 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.205826    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c21a78-656f67d669-vrfd8"]
Jul 06 20:08:19.915133 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:19.915096    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38eab34f-da71-4573-bd48-baffec1754f0" path="/var/lib/kubelet/pods/38eab34f-da71-4573-bd48-baffec1754f0/volumes"
Jul 06 20:08:22.467179 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:22.467142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:23.630877 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:23.630843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:26.904075 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:26.904039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:08:30.811880 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:30.811841    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" podUID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" containerName="main" containerID="cri-o://4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7" gracePeriod=45
Jul 06 20:08:31.058351 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.058327    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:08:31.139445 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139605 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139518    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139605 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139577    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxq88\" (UniqueName: \"kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139753 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139753 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139864 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139749    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache" (OuterVolumeSpecName: "model-cache") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:31.139864 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139796    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home\") pod \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\" (UID: \"e5652a68-e8f0-46bb-9204-55c5cf6bee23\") "
Jul 06 20:08:31.139972 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.139939    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:31.140109 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.140084    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home" (OuterVolumeSpecName: "home") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:31.140207 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.140189    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-home\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.140275 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.140212    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-model-cache\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.140275 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.140228    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tmp-dir\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.141727 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.141688    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:31.141828 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.141731    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm" (OuterVolumeSpecName: "dshm") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:31.141828 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.141767    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88" (OuterVolumeSpecName: "kube-api-access-fxq88") pod "e5652a68-e8f0-46bb-9204-55c5cf6bee23" (UID: "e5652a68-e8f0-46bb-9204-55c5cf6bee23"). InnerVolumeSpecName "kube-api-access-fxq88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:31.230330 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.230296    2559 generic.go:356] "Generic (PLEG): container finished" podID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" containerID="4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7" exitCode=0
Jul 06 20:08:31.230505 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.230345    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"
Jul 06 20:08:31.230505 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.230374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" event={"ID":"e5652a68-e8f0-46bb-9204-55c5cf6bee23","Type":"ContainerDied","Data":"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"}
Jul 06 20:08:31.230505 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.230410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m" event={"ID":"e5652a68-e8f0-46bb-9204-55c5cf6bee23","Type":"ContainerDied","Data":"152d440873e5cb31395ee12be12bb64c3efa8e841c98cf92261356feb140af98"}
Jul 06 20:08:31.230505 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.230429    2559 scope.go:117] "RemoveContainer" containerID="4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"
Jul 06 20:08:31.239044 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.239029    2559 scope.go:117] "RemoveContainer" containerID="4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"
Jul 06 20:08:31.239288 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:08:31.239269    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7\": container with ID starting with 4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7 not found: ID does not exist" containerID="4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"
Jul 06 20:08:31.239336 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.239295    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7"} err="failed to get container status \"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7\": rpc error: code = NotFound desc = could not find container \"4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7\": container with ID starting with 4d1134a42a71c1c893ef988551b74cb874a2802b4727c3216c2a308b6f1deff7 not found: ID does not exist"
Jul 06 20:08:31.240673 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.240655    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5652a68-e8f0-46bb-9204-55c5cf6bee23-dshm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.240752 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.240675    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxq88\" (UniqueName: \"kubernetes.io/projected/e5652a68-e8f0-46bb-9204-55c5cf6bee23-kube-api-access-fxq88\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.240752 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.240685    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5652a68-e8f0-46bb-9204-55c5cf6bee23-tls-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:08:31.254898 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.254875    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:08:31.259576 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.259554    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f7a150/rate-test-model-f7a150-kserve-6c8789dbf5-7zt9m"]
Jul 06 20:08:31.916268 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:08:31.916232    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" path="/var/lib/kubelet/pods/e5652a68-e8f0-46bb-9204-55c5cf6bee23/volumes"
Jul 06 20:09:00.218661 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:00.218596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:00.551644 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:00.551544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:00.767320 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:00.767287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:00.959187 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:00.959154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:01.353775 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.353684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:01.504276 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.504241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:01.604291 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.604207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:01.821385 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.821341    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:09:01.821706 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.821658    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" podUID="300353aa-59eb-4291-99b3-e84f58bcec6d" containerName="maas-api" containerID="cri-o://a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b" gracePeriod=30
Jul 06 20:09:01.838006 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:01.837962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:02.067272 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.067247    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:09:02.214148 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.214062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca\") pod \"300353aa-59eb-4291-99b3-e84f58bcec6d\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") "
Jul 06 20:09:02.214148 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.214098    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zdj9\" (UniqueName: \"kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9\") pod \"300353aa-59eb-4291-99b3-e84f58bcec6d\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") "
Jul 06 20:09:02.214358 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.214157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") pod \"300353aa-59eb-4291-99b3-e84f58bcec6d\" (UID: \"300353aa-59eb-4291-99b3-e84f58bcec6d\") "
Jul 06 20:09:02.214413 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.214390    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "300353aa-59eb-4291-99b3-e84f58bcec6d" (UID: "300353aa-59eb-4291-99b3-e84f58bcec6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:02.216206 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.216173    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9" (OuterVolumeSpecName: "kube-api-access-4zdj9") pod "300353aa-59eb-4291-99b3-e84f58bcec6d" (UID: "300353aa-59eb-4291-99b3-e84f58bcec6d"). InnerVolumeSpecName "kube-api-access-4zdj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:02.216206 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.216197    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "300353aa-59eb-4291-99b3-e84f58bcec6d" (UID: "300353aa-59eb-4291-99b3-e84f58bcec6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:02.315679 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.315610    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/300353aa-59eb-4291-99b3-e84f58bcec6d-maas-api-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:09:02.315679 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.315674    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/300353aa-59eb-4291-99b3-e84f58bcec6d-openshift-service-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:09:02.315679 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.315685    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zdj9\" (UniqueName: \"kubernetes.io/projected/300353aa-59eb-4291-99b3-e84f58bcec6d-kube-api-access-4zdj9\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\""
Jul 06 20:09:02.380775 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.380744    2559 generic.go:356] "Generic (PLEG): container finished" podID="300353aa-59eb-4291-99b3-e84f58bcec6d" containerID="a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b" exitCode=0
Jul 06 20:09:02.381195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.380795    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"
Jul 06 20:09:02.381195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.380816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" event={"ID":"300353aa-59eb-4291-99b3-e84f58bcec6d","Type":"ContainerDied","Data":"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"}
Jul 06 20:09:02.381195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.380857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf" event={"ID":"300353aa-59eb-4291-99b3-e84f58bcec6d","Type":"ContainerDied","Data":"bcda140f868a8abfeaccf1eb52865a2340a88e65f0219d4e7eabd50c77d9a526"}
Jul 06 20:09:02.381195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.380878    2559 scope.go:117] "RemoveContainer" containerID="a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"
Jul 06 20:09:02.390112 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.390092    2559 scope.go:117] "RemoveContainer" containerID="a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"
Jul 06 20:09:02.390391 ip-10-0-135-41 kubenswrapper[2559]: E0706 20:09:02.390370    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b\": container with ID starting with a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b not found: ID does not exist" containerID="a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"
Jul 06 20:09:02.390489 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.390397    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b"} err="failed to get container status \"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b\": rpc error: code = NotFound desc = could not find container \"a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b\": container with ID starting with a284a0cad9ca92a4954e3017c7c2eb842e5c646e5961fc41cd2793ca59de743b not found: ID does not exist"
Jul 06 20:09:02.404254 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.404228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:09:02.409524 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:02.409494    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a150-5994df7bdd-ljnqf"]
Jul 06 20:09:03.914981 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:03.914945    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="300353aa-59eb-4291-99b3-e84f58bcec6d" path="/var/lib/kubelet/pods/300353aa-59eb-4291-99b3-e84f58bcec6d/volumes"
Jul 06 20:09:09.100528 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:09.100494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:09.205323 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:09.205289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:09.422412 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:09.422382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:09.635031 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:09.634997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:09.702195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:09.702099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cjtg8"]
Jul 06 20:09:10.017944 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:10.017862    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-659fdf87bc-nl8rm_18148b66-6c0a-40a4-8f44-2f91e7bdec45/authorino/0.log"
Jul 06 20:09:14.885945 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:14.885916    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7f95bfd9ff-vsblg_0e850616-6ef9-4dc2-a322-89d3f3efdd31/maas-api/0.log"
Jul 06 20:09:15.277694 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:15.277609    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f86b54c6f-9rpnk_e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8/manager/2.log"
Jul 06 20:09:15.402276 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:15.402249    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bxk4h_d0170e3d-338b-4d76-8442-3e3e39a4706f/server/0.log"
Jul 06 20:09:15.958908 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:15.958881    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7865995f8c-wpt2s_7a1b3544-58a9-48ea-9de1-af3217c0b023/copy-manifests/0.log"
Jul 06 20:09:15.993801 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:15.993775    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7865995f8c-wpt2s_7a1b3544-58a9-48ea-9de1-af3217c0b023/manager/1.log"
Jul 06 20:09:17.700250 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:17.700221    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-659fdf87bc-nl8rm_18148b66-6c0a-40a4-8f44-2f91e7bdec45/authorino/0.log"
Jul 06 20:09:18.464687 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:18.464660    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cjtg8_9bc436d7-e715-4a71-84c5-9ff7bc2552cf/limitador/0.log"
Jul 06 20:09:19.276102 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:19.276032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67db589d55-v92tc_7477bf6d-5dbb-44de-b0c7-cfda0be32c40/kube-auth-proxy/0.log"
Jul 06 20:09:20.209383 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:20.209360    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qrhxf_572df269-a5cc-4c2a-81c5-5e7d818be703/main/0.log"
Jul 06 20:09:20.330601 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:20.330568    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-h5qvz_63cb3fd8-3d49-4ea0-ab3d-a59c156c132b/main/0.log"
Jul 06 20:09:20.679714 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:20.679681    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qx4rb_ab06d6e6-31c4-4099-9514-4dda0e83b71c/main/0.log"
Jul 06 20:09:24.617990 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:24.617951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:24.717119 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:24.717084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:27.920516 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:27.920486    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2gj7k_d72de2bc-6164-472c-bd1c-f2811047f5c6/global-pull-secret-syncer/0.log"
Jul 06 20:09:28.140852 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:28.140822    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k2tkj_90bb1f0e-d09f-4c21-97d3-8879c855e26a/konnectivity-agent/0.log"
Jul 06 20:09:28.259953 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:28.259874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-41.ec2.internal_01a71ea3922c1a01f528cd43e38bc2b2/haproxy/0.log"
Jul 06 20:09:33.529273 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:33.529192    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-659fdf87bc-nl8rm_18148b66-6c0a-40a4-8f44-2f91e7bdec45/authorino/0.log"
Jul 06 20:09:33.912076 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:33.912048    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cjtg8_9bc436d7-e715-4a71-84c5-9ff7bc2552cf/limitador/0.log"
Jul 06 20:09:35.899598 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:35.899567    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/alertmanager/0.log"
Jul 06 20:09:35.944255 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:35.944181    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/config-reloader/0.log"
Jul 06 20:09:35.997784 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:35.997762    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/kube-rbac-proxy-web/0.log"
Jul 06 20:09:36.050537 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.050507    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/kube-rbac-proxy/0.log"
Jul 06 20:09:36.092195 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.092165    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/kube-rbac-proxy-metric/0.log"
Jul 06 20:09:36.146112 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.146084    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/prom-label-proxy/0.log"
Jul 06 20:09:36.192353 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.192323    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a6e3527-ea36-4f26-a6ee-f5b5e50f14e5/init-config-reloader/0.log"
Jul 06 20:09:36.316773 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.316690    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zk8j6_28a862a1-6e75-464d-b0ce-ce9d194e634d/kube-state-metrics/0.log"
Jul 06 20:09:36.354317 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.354267    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zk8j6_28a862a1-6e75-464d-b0ce-ce9d194e634d/kube-rbac-proxy-main/0.log"
Jul 06 20:09:36.398200 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.398165    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zk8j6_28a862a1-6e75-464d-b0ce-ce9d194e634d/kube-rbac-proxy-self/0.log"
Jul 06 20:09:36.503989 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.503964    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-dkf6m_edb17436-fe86-48b0-b388-1dff0a7973ea/monitoring-plugin/0.log"
Jul 06 20:09:36.693159 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.693136    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lmt5_8ddde874-6b06-4a9a-9ad8-a050a0286cb7/node-exporter/0.log"
Jul 06 20:09:36.732220 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.732194    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lmt5_8ddde874-6b06-4a9a-9ad8-a050a0286cb7/kube-rbac-proxy/0.log"
Jul 06 20:09:36.766271 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:36.766247    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lmt5_8ddde874-6b06-4a9a-9ad8-a050a0286cb7/init-textfile/0.log"
Jul 06 20:09:37.054961 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.054873    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/prometheus/0.log"
Jul 06 20:09:37.094768 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.094742    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/config-reloader/0.log"
Jul 06 20:09:37.131818 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.131788    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/thanos-sidecar/0.log"
Jul 06 20:09:37.191991 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.191969    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/kube-rbac-proxy-web/0.log"
Jul 06 20:09:37.242543 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.242521    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/kube-rbac-proxy/0.log"
Jul 06 20:09:37.295211 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.295186    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/kube-rbac-proxy-thanos/0.log"
Jul 06 20:09:37.382718 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.382689    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_024eb530-7553-4324-8887-d091a2539561/init-config-reloader/0.log"
Jul 06 20:09:37.448028 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.447993    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wjs7t_5d663a04-97c4-4b42-958a-1f33e49189ad/prometheus-operator/0.log"
Jul 06 20:09:37.504078 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.504049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wjs7t_5d663a04-97c4-4b42-958a-1f33e49189ad/kube-rbac-proxy/0.log"
Jul 06 20:09:37.937371 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937338    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"]
Jul 06 20:09:37.937681 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="300353aa-59eb-4291-99b3-e84f58bcec6d" containerName="maas-api"
Jul 06 20:09:37.937733 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937683    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="300353aa-59eb-4291-99b3-e84f58bcec6d" containerName="maas-api"
Jul 06 20:09:37.937733 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937702    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38eab34f-da71-4573-bd48-baffec1754f0" containerName="maas-api"
Jul 06 20:09:37.937733 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937708    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="38eab34f-da71-4573-bd48-baffec1754f0" containerName="maas-api"
Jul 06 20:09:37.937733 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937714    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" containerName="main"
Jul 06 20:09:37.937733 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937719    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" containerName="main"
Jul 06 20:09:37.937892 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937783    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="300353aa-59eb-4291-99b3-e84f58bcec6d" containerName="maas-api"
Jul 06 20:09:37.937892 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937794    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5652a68-e8f0-46bb-9204-55c5cf6bee23" containerName="main"
Jul 06 20:09:37.937892 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.937800    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="38eab34f-da71-4573-bd48-baffec1754f0" containerName="maas-api"
Jul 06 20:09:37.940773 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.940750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:37.948454 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.948435    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tfs5f\"/\"kube-root-ca.crt\""
Jul 06 20:09:37.949540 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.949522    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tfs5f\"/\"openshift-service-ca.crt\""
Jul 06 20:09:37.950891 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.950873    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tfs5f\"/\"default-dockercfg-2txjc\""
Jul 06 20:09:37.991721 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:37.991692    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"]
Jul 06 20:09:38.031298 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.031263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-sys\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.031471 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.031321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-proc\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.031471 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.031412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-lib-modules\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.031471 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.031449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8kz\" (UniqueName: \"kubernetes.io/projected/d637e98d-4545-4356-aff9-a4ee718305e3-kube-api-access-wm8kz\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.031581 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.031473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-podres\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.132558 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-sys\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-proc\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-lib-modules\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8kz\" (UniqueName: \"kubernetes.io/projected/d637e98d-4545-4356-aff9-a4ee718305e3-kube-api-access-wm8kz\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-podres\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132679    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-sys\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132725    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-proc\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132788    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-lib-modules\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.133002 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.132806    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d637e98d-4545-4356-aff9-a4ee718305e3-podres\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.142239 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.142211    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8kz\" (UniqueName: \"kubernetes.io/projected/d637e98d-4545-4356-aff9-a4ee718305e3-kube-api-access-wm8kz\") pod \"perf-node-gather-daemonset-ldx26\" (UID: \"d637e98d-4545-4356-aff9-a4ee718305e3\") " pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.251375 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.251279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.400074 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.399896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"]
Jul 06 20:09:38.402252 ip-10-0-135-41 kubenswrapper[2559]: W0706 20:09:38.402226    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd637e98d_4545_4356_aff9_a4ee718305e3.slice/crio-609196ea370c8b05b1ca072958010117e960b7bfee663892d73edcdd22772cff WatchSource:0}: Error finding container 609196ea370c8b05b1ca072958010117e960b7bfee663892d73edcdd22772cff: Status 404 returned error can't find the container with id 609196ea370c8b05b1ca072958010117e960b7bfee663892d73edcdd22772cff
Jul 06 20:09:38.547029 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.546999    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26" event={"ID":"d637e98d-4545-4356-aff9-a4ee718305e3","Type":"ContainerStarted","Data":"903d92f49ebec8dfcdca9e85ef489f0de3d81314dd1b2ef494588adab47bf8bb"}
Jul 06 20:09:38.547159 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.547054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26" event={"ID":"d637e98d-4545-4356-aff9-a4ee718305e3","Type":"ContainerStarted","Data":"609196ea370c8b05b1ca072958010117e960b7bfee663892d73edcdd22772cff"}
Jul 06 20:09:38.547159 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.547123    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:38.589004 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:38.588949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26" podStartSLOduration=1.588928742 podStartE2EDuration="1.588928742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:38.587119248 +0000 UTC m=+2801.224617980" watchObservedRunningTime="2026-07-06 20:09:38.588928742 +0000 UTC m=+2801.226427470"
Jul 06 20:09:42.509998 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:42.509971    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgc4k_dea2c908-2790-4a43-9de3-ec8a261dd2b9/dns/0.log"
Jul 06 20:09:42.543055 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:42.543005    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgc4k_dea2c908-2790-4a43-9de3-ec8a261dd2b9/kube-rbac-proxy/0.log"
Jul 06 20:09:42.663786 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:42.663759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gn64b_004e02dd-5a2a-40a6-bbb7-d46a1761e2ba/dns-node-resolver/0.log"
Jul 06 20:09:43.398046 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:43.398017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79jkp_ec75eca3-2343-44b7-9134-e23b7a89b098/node-ca/0.log"
Jul 06 20:09:44.561712 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:44.561688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tfs5f/perf-node-gather-daemonset-ldx26"
Jul 06 20:09:44.917615 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:44.917583    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67db589d55-v92tc_7477bf6d-5dbb-44de-b0c7-cfda0be32c40/kube-auth-proxy/0.log"
Jul 06 20:09:46.192795 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:46.192757    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gtxd_79c01869-c6ef-405e-9647-a7359ef79882/serve-healthcheck-canary/0.log"
Jul 06 20:09:47.266670 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:47.266621    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jv62_aa4b4631-720f-4357-b59e-f4dcb5cec061/kube-rbac-proxy/0.log"
Jul 06 20:09:47.373432 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:47.373399    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jv62_aa4b4631-720f-4357-b59e-f4dcb5cec061/exporter/0.log"
Jul 06 20:09:47.457661 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:47.457569    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jv62_aa4b4631-720f-4357-b59e-f4dcb5cec061/extractor/0.log"
Jul 06 20:09:49.731478 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:49.731444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67db589d55-v92tc_7477bf6d-5dbb-44de-b0c7-cfda0be32c40/kube-auth-proxy/0.log"
Jul 06 20:09:50.470258 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:50.470228    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7f95bfd9ff-vsblg_0e850616-6ef9-4dc2-a322-89d3f3efdd31/maas-api/0.log"
Jul 06 20:09:50.602351 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:50.602311    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f86b54c6f-9rpnk_e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8/manager/1.log"
Jul 06 20:09:50.677994 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:50.677954    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f86b54c6f-9rpnk_e5a6ddca-abc9-4f74-a7d0-4e2f59fd26e8/manager/2.log"
Jul 06 20:09:50.742551 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:50.742480    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bxk4h_d0170e3d-338b-4d76-8442-3e3e39a4706f/server/0.log"
Jul 06 20:09:51.025403 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:51.025311    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7865995f8c-wpt2s_7a1b3544-58a9-48ea-9de1-af3217c0b023/manager/1.log"
Jul 06 20:09:51.035961 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:51.035930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7865995f8c-wpt2s_7a1b3544-58a9-48ea-9de1-af3217c0b023/manager/0.log"
Jul 06 20:09:51.078221 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:51.078191    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7865995f8c-wpt2s_7a1b3544-58a9-48ea-9de1-af3217c0b023/copy-manifests/0.log"
Jul 06 20:09:51.293073 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:51.292995    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67db589d55-v92tc_7477bf6d-5dbb-44de-b0c7-cfda0be32c40/kube-auth-proxy/0.log"
Jul 06 20:09:52.608088 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:52.608062    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54d6cd8878-bnkn5_0e768003-c4e1-4f3f-bc6f-67cd06404e2a/manager/1.log"
Jul 06 20:09:52.608564 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:52.608330    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54d6cd8878-bnkn5_0e768003-c4e1-4f3f-bc6f-67cd06404e2a/manager/0.log"
Jul 06 20:09:52.631811 ip-10-0-135-41 kubenswrapper[2559]: I0706 20:09:52.631781    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vps2p_5ffbaa8c-dbcc-4a74-9d02-b99eac0bd78d/openshift-lws-operator/0.log"