Jul 22 18:54:40.229804 ip-10-0-129-246 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 18:54:40.229816 ip-10-0-129-246 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 18:54:40.229823 ip-10-0-129-246 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 18:54:40.230078 ip-10-0-129-246 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 18:54:49.742816 ip-10-0-129-246 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 18:54:49.742830 ip-10-0-129-246 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b51bcc92a7614cacbe141e745bcdb7c6 --
Jul 22 18:56:38.318488 ip-10-0-129-246 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 18:56:38.727853 ip-10-0-129-246 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 18:56:38.727853 ip-10-0-129-246 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 18:56:38.727853 ip-10-0-129-246 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 18:56:38.727853 ip-10-0-129-246 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 18:56:38.727853 ip-10-0-129-246 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 18:56:38.728737 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.728660    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 18:56:38.733019 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733004    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.733019 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733019    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733023    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733026    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733029    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733032    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733034    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733037    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733040    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733042    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733047    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733051    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733053    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733056    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733059    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733061    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733068    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733070    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733073    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733076    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733078    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.733083 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733081    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733083    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733086    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733089    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733091    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733094    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733097    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733099    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733102    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733104    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733106    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733109    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733112    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733114    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733117    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733119    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733122    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733125    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733127    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.733568 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733129    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733132    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733134    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733136    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733139    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733141    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733144    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733146    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733149    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733151    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733154    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733156    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733159    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733162    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733166    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733169    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733172    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733175    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733178    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733181    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.734054 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733183    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733186    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733189    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733192    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733195    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733197    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733199    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733202    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733219    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733222    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733225    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733228    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733230    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733233    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733235    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733238    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733240    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733243    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733245    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733248    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.734554 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733252    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733255    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733258    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733261    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733264    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733266    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733269    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733272    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733274    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733277    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733280    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733282    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733285    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733287    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733289    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733292    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733295    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733297    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.733314    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734769    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.735029 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734777    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734780    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734783    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734787    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734789    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734792    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734795    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734797    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734800    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734802    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734805    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734807    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734809    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734812    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734814    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734817    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734819    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734821    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734824    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734827    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.735522 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734830    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734833    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734835    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734837    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734840    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734842    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734844    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734847    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734850    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734853    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734855    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734858    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734860    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734863    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734865    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734867    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734871    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734873    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734876    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734878    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.736012 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734880    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734883    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734885    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734888    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734899    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734902    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734905    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734907    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734911    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734913    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734915    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734918    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734921    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734924    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734926    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734929    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734931    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734934    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734936    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.736532 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734939    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734942    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734944    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734946    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734949    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734951    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734955    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734959    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734962    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734964    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734968    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734971    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734975    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734978    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734981    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734984    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734987    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734989    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734992    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.736994 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734994    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734997    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.734999    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735002    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735005    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735007    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735010    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735013    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735017    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735020    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735024    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735026    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735029    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735031    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735034    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735037    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735039    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735042    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735044    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.737464 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735047    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735438    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735444    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735448    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735451    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735454    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735457    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735467    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735470    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735473    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735476    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735478    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735481    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735483    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735486    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735488    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735491    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735494    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735496    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.737915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735500    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735504    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735507    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735510    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735512    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735515    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735517    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735520    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735522    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735524    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735527    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735531    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735534    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735537    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735540    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735542    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735545    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735548    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735551    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735553    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.738377 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735556    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735560    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735562    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735565    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735567    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735569    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735572    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735575    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735577    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735580    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735582    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735585    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735587    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735590    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735592    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735594    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735597    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735599    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735602    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735604    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.738940 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735606    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735609    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735611    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735615    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735617    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735619    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735622    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735624    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735627    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735629    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735631    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735636    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735639    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735641    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735643    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735646    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735648    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735650    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735654    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.739438 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735661    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735664    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735666    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735669    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735671    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735675    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735677    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735680    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735682    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735684    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735687    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735689    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735692    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735694    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735697    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735699    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735702    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735704    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735706    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735709    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.739902 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735711    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.735714    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735781    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735789    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735797    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735805    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735811    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735816    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735822    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735825    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735828    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735839    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735844    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735847    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735850    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735854    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735856    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735864    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735866    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735869    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735873    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735876    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735879    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 18:56:38.740403 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735882    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735885    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735889    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735892    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735895    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735898    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735901    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735904    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735906    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735909    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735912    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735916    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735918    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735921    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735924    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735927    2578 flags.go:64] FLAG: --enable-server="true"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735930    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735934    2578 flags.go:64] FLAG: --event-burst="100"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735937    2578 flags.go:64] FLAG: --event-qps="50"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735939    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735942    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735946    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735950    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735952    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735955    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 18:56:38.740951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735958    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735962    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735965    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735967    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735971    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735973    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735976    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735979    2578 flags.go:64] FLAG: --feature-gates=""
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735982    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735985    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735988    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735990    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735993    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735996    2578 flags.go:64] FLAG: --help="false"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.735999    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-246.ec2.internal"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736002    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736013    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736017    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736021    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736025    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736028    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736030    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736033    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 18:56:38.741562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736035    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736038    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736041    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736044    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736046    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736050    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736053    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736056    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736059    2578 flags.go:64] FLAG: --lock-file=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736061    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736065    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736067    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736073    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736076    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736078    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736081    2578 flags.go:64] FLAG: --logging-format="text"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736083    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736087    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736089    2578 flags.go:64] FLAG: --manifest-url=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736092    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736096    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736098    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736105    2578 flags.go:64] FLAG: --max-pods="110"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736108    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736111    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 18:56:38.742176 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736113    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736116    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736119    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736122    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736124    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736130    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736133    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736136    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736139    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736142    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736147    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736150    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736153    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736157    2578 flags.go:64] FLAG: --port="10250"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736159    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736163    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02654b9113734abc6"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736166    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736169    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736172    2578 flags.go:64] FLAG: --register-node="true"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736175    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736178    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736181    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736184    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736186    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736190    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 18:56:38.742838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736193    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736196    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736199    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736202    2578 flags.go:64] FLAG: --runonce="false"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736216    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736220    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736223    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736225    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736228    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736231    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736234    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736237    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736239    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736242    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736245    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736247    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736251    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736253    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736256    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736261    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736265    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736267    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736272    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736274    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736278    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 18:56:38.743781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736281    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736283    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736286    2578 flags.go:64] FLAG: --v="2"
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736290    2578 flags.go:64] FLAG: --version="false"
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736294    2578 flags.go:64] FLAG: --vmodule=""
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736297    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.736300    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736419    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736423    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736426    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736429    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736432    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736434    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736437    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736440    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736442    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736444    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736447    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736449    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736451    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736454    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.744604 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736456    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736459    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736461    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736464    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736467    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736469    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736473    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736475    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736478    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736480    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736484    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736486    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736488    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736491    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736495    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736499    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736501    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736503    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736506    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736508    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.745106 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736511    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736514    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736516    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736519    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736521    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736523    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736526    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736528    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736530    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736533    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736535    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736538    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736541    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736543    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736546    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736548    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736551    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736554    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736558    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736561    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.745627 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736563    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736565    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736569    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736571    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736575    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736578    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736581    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736584    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736587    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736589    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736592    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736595    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736598    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736600    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736603    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736606    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736608    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736611    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736613    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.746139 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736616    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736618    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736621    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736623    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736626    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736628    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736631    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736634    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736636    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736638    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736641    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736645    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736648    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736651    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736653    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736655    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736658    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736660    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736662    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736665    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.746625 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736667    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736671    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736674    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736676    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736679    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.736681    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.737410    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.745566    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.745580    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.745593    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.745599    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745655    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745660    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745663    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.747111 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745665    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745668    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745671    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745673    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745676    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745678    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745681    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745684    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745686    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745689    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745692    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745694    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745697    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745699    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745701    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745704    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745706    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745709    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745711    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745714    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.747487 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745717    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745721    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745724    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745726    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745729    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745733    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745735    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745737    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745740    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745742    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745745    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745747    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745749    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745752    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745754    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745756    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745759    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745761    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745763    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.747964 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745767    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745770    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745773    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745776    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745778    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745781    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745784    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745787    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745789    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745792    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745795    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745797    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745800    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745802    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745804    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745806    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745809    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745812    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745814    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745817    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.748449 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745819    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745821    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745823    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745826    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745828    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745830    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745833    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745835    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745837    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745840    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745842    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745844    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745847    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745849    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745851    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745854    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745856    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745866    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745869    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745872    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.748921 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745874    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745876    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745879    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745881    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745884    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745886    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745889    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745891    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745894    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745897    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745901    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745904    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745906    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745909    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745911    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745913    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.749518 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.745916    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.745921    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746033    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746038    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746041    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746044    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746047    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746049    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746052    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746054    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746057    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746059    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746062    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746064    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746067    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 18:56:38.749898 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746070    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746073    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746075    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746077    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746080    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746082    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746084    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746087    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746089    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746092    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746094    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746096    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746100    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746104    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746107    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746110    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746112    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746115    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746117    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 18:56:38.750282 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746119    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746122    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746124    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746126    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746129    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746131    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746134    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746137    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746139    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746141    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746144    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746147    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746149    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746152    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746155    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746157    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746160    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746162    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746164    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746167    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 18:56:38.750725 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746169    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746172    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746174    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746176    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746179    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746181    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746183    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746186    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746188    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746191    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746193    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746195    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746198    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746200    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746203    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746219    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746222    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746224    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746229    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746232    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 18:56:38.751202 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746234    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746236    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746239    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746241    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746244    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746247    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746251    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746254    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746258    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746260    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746263    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746265    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746268    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746270    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746273    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746275    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746278    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746280    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746283    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746285    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 18:56:38.751708 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746287    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746290    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746293    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746296    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746299    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746302    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:38.746304    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.746309    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.746409    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.748725    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.750424    2578 server.go:1019] "Starting client certificate rotation"
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.750527    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 18:56:38.752191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.750560    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 18:56:38.752918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.752905    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 18:56:38.754075 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.754055    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 18:56:38.763594 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.763579    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 22 18:56:38.767635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.767620    2578 log.go:25] "Validated CRI v1 image API"
Jul 22 18:56:38.769244 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.769229    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 18:56:38.772295 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.772278    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 900a3bc4-224d-4a09-bd9f-a09426f9b657:/dev/nvme0n1p4 b8339393-46eb-447b-ad3a-cb3adef282c4:/dev/nvme0n1p3]
Jul 22 18:56:38.772352 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.772300    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 18:56:38.780629 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.780486    2578 manager.go:216] Machine: {Timestamp:2026-07-22 18:56:38.779172634 +0000 UTC m=+0.347516996 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100733 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279e912ea16e71fc5555bb6b17ebef SystemUUID:ec279e91-2ea1-6e71-fc55-55bb6b17ebef BootID:b51bcc92-a761-4cac-be14-1e745bcdb7c6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:15:9a:fa:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:15:9a:fa:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:6e:86:9c:fa:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 18:56:38.780629 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.780626    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 18:56:38.780752 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.780710    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 18:56:38.783638 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.783614    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 18:56:38.783762 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.783641    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 18:56:38.784519 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.784509    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 18:56:38.784556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.784521    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 18:56:38.784556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.784529    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 18:56:38.785328 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.785318    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 18:56:38.785560 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.785544    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 18:56:38.786964 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.786951    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 18:56:38.790553 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790542    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 18:56:38.790675 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790665    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 18:56:38.790706 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790699    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 18:56:38.790733 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790711    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 18:56:38.790733 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790726    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 18:56:38.790789 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790734    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 22 18:56:38.790789 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.790742    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 18:56:38.791092 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.791080    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 18:56:38.791128 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.791098    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 18:56:38.793236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.793217    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 18:56:38.795377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.795365    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 18:56:38.795433 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.795395    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 18:56:38.796510 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796491    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 18:56:38.796510 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796512    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796522    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796531    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796544    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796551    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796562    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796569    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796579    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796586    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796609    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 18:56:38.796635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.796616    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 18:56:38.797472 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.797462    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 18:56:38.797472 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.797472    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 18:56:38.800469 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.800456    2578 server.go:1268] "Started kubelet"
Jul 22 18:56:38.800556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.800523    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 18:56:38.800667 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.800610    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 18:56:38.800761 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.800687    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 18:56:38.801982 ip-10-0-129-246 systemd[1]: Started Kubernetes Kubelet.
Jul 22 18:56:38.802635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.802609    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 18:56:38.803193 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.803145    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 18:56:38.803376 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.803358    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 18:56:38.803376 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.803361    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 18:56:38.803685 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.803671    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 18:56:38.807187 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.807169    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 18:56:38.809044 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.808096    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-246.ec2.internal.18c4b1935b961a86  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-246.ec2.internal,UID:ip-10-0-129-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-246.ec2.internal,},FirstTimestamp:2026-07-22 18:56:38.80043175 +0000 UTC m=+0.368776112,LastTimestamp:2026-07-22 18:56:38.80043175 +0000 UTC m=+0.368776112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-246.ec2.internal,}"
Jul 22 18:56:38.811541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.811527    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 18:56:38.811594 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.811552    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 18:56:38.811766 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.811743    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:38.811832 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.811769    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d4jsl"
Jul 22 18:56:38.812300 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812282    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 18:56:38.812372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812298    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 18:56:38.812372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812321    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 18:56:38.812372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812343    2578 factory.go:55] Registering systemd factory
Jul 22 18:56:38.812372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812357    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 22 18:56:38.812528 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812396    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 18:56:38.812528 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812405    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 18:56:38.812595 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812565    2578 factory.go:153] Registering CRI-O factory
Jul 22 18:56:38.812595 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812579    2578 factory.go:223] Registration of the crio container factory successfully
Jul 22 18:56:38.812671 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812656    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 18:56:38.812704 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812676    2578 factory.go:103] Registering Raw factory
Jul 22 18:56:38.812704 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.812686    2578 manager.go:1196] Started watching for new ooms in manager
Jul 22 18:56:38.813071 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.813056    2578 manager.go:349] Starting recovery of all containers
Jul 22 18:56:38.814096 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.814062    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 18:56:38.814341 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.814317    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 18:56:38.820442 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.820419    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d4jsl"
Jul 22 18:56:38.824887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.824869    2578 manager.go:354] Recovery completed
Jul 22 18:56:38.828981 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.828964    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:38.831885 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.831870    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:38.831956 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.831903    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:38.831956 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.831919    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:38.832441 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.832425    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 18:56:38.832441 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.832432    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:38.832441 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.832440    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 18:56:38.832596 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.832454    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 18:56:38.833370 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833353    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:38.833433 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833379    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:38.833433 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833392    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:38.833545 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833517    2578 policy_none.go:49] "None policy: Start"
Jul 22 18:56:38.833578 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833550    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 18:56:38.833578 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.833561    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 18:56:38.833985 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.833927    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-246.ec2.internal.18c4b1935d760b21  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-246.ec2.internal,UID:ip-10-0-129-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-246.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-246.ec2.internal,},FirstTimestamp:2026-07-22 18:56:38.831885089 +0000 UTC m=+0.400229454,LastTimestamp:2026-07-22 18:56:38.831885089 +0000 UTC m=+0.400229454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-246.ec2.internal,}"
Jul 22 18:56:38.834695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.834684    2578 policy_none.go:47] "Start"
Jul 22 18:56:38.870754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.870737    2578 manager.go:337] "Starting Device Plugin manager"
Jul 22 18:56:38.870817 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.870768    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 18:56:38.870817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.870780    2578 server.go:87] "Starting device plugin registration server"
Jul 22 18:56:38.871000 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.870984    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 18:56:38.871094 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.870999    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 18:56:38.871094 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.871080    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 18:56:38.871255 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.871172    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 18:56:38.871255 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.871184    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 18:56:38.871777 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.871754    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 18:56:38.871848 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.871815    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:38.912323 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.912302    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 18:56:38.913604 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.913590    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 18:56:38.913662 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.913625    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 18:56:38.913662 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.913644    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 18:56:38.913723 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.913677    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 18:56:38.916153 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.916129    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 18:56:38.971097 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.971077    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:38.972139 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.972125    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:38.972201 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.972154    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:38.972201 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.972168    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:38.972201 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.972188    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-246.ec2.internal"
Jul 22 18:56:38.978760 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:38.978726    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-246.ec2.internal"
Jul 22 18:56:38.978760 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.978746    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-246.ec2.internal\": node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:38.999410 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:38.999388    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.014639 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.014617    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"]
Jul 22 18:56:39.014702 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.014690    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:39.015969 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.015955    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:39.016022 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.015984    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:39.016022 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.015999    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:39.017130 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.017118    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:39.017262 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.017247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.017308 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.017278    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:39.018346 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018330    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:39.018396 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018365    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:39.018396 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018380    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:39.018711 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018695    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:39.018769 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018719    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:39.018769 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.018729    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:39.020000 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.019985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.020040 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.020016    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 18:56:39.020682 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.020670    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 18:56:39.020744 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.020694    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 18:56:39.020744 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.020703    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 18:56:39.040824 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.040806    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-246.ec2.internal\" not found" node="ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.045048 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.045034    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-246.ec2.internal\" not found" node="ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.099731 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.099709    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.114078 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.114055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.114152 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.114081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.114152 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.114097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b1dd8c2174ce1853b1e15b0d6ee0318-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"4b1dd8c2174ce1853b1e15b0d6ee0318\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.200642 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.200611    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.214992 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.214970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.215056 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.215004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.215056 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.215025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.215056 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.215041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b1dd8c2174ce1853b1e15b0d6ee0318-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"4b1dd8c2174ce1853b1e15b0d6ee0318\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.215159 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.215060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b1dd8c2174ce1853b1e15b0d6ee0318-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"4b1dd8c2174ce1853b1e15b0d6ee0318\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.215159 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.215078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7502424949a55e9d60a15331712003a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"7502424949a55e9d60a15331712003a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.301380 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.301329    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.344785 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.344767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.349698 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.349112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:39.401457 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.401428    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.501961 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.501927    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.602535 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.602477    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.703007 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.702981    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.749674 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.749640    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 18:56:39.750341 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.749815    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 18:56:39.796528 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.796495    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 18:56:39.804136 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.804107    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.825428 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.825394    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 18:51:39 +0000 UTC" deadline="2028-05-07 21:27:50.168889804 +0000 UTC"
Jul 22 18:56:39.825428 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.825420    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15722h31m10.343472618s"
Jul 22 18:56:39.904903 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:39.904834    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 22 18:56:39.937658 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.937639    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 18:56:39.942626 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:39.942592    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1dd8c2174ce1853b1e15b0d6ee0318.slice/crio-8609c1fc71587e75e2cfdf5edab4748e167d87eeffcd2698036953285c2d5d96 WatchSource:0}: Error finding container 8609c1fc71587e75e2cfdf5edab4748e167d87eeffcd2698036953285c2d5d96: Status 404 returned error can't find the container with id 8609c1fc71587e75e2cfdf5edab4748e167d87eeffcd2698036953285c2d5d96
Jul 22 18:56:39.946519 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:39.946496    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 18:56:40.011802 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.011782    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:40.025114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.025093    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 18:56:40.026256 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.026243    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 22 18:56:40.037106 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.037083    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 18:56:40.052715 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:40.052695    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7502424949a55e9d60a15331712003a6.slice/crio-5d303eb46ed82c0b621f0006fef6f63e04ecb294fdb8abdd607a230d0e3a472f WatchSource:0}: Error finding container 5d303eb46ed82c0b621f0006fef6f63e04ecb294fdb8abdd607a230d0e3a472f: Status 404 returned error can't find the container with id 5d303eb46ed82c0b621f0006fef6f63e04ecb294fdb8abdd607a230d0e3a472f
Jul 22 18:56:40.323820 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.323764    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 18:56:40.792936 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.792605    2578 apiserver.go:52] "Watching apiserver"
Jul 22 18:56:40.799541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.799510    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 18:56:40.800112 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.800084    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-f2grc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw","openshift-dns/node-resolver-fttc4","openshift-image-registry/node-ca-5f7z2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal","openshift-multus/network-metrics-daemon-zrp45","openshift-network-operator/iptables-alerter-4p28g","kube-system/global-pull-secret-syncer-5h2rj","kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9ldxj","openshift-multus/multus-additional-cni-plugins-w46fs","openshift-multus/multus-zt8n7","openshift-network-diagnostics/network-check-target-ht2md","openshift-ovn-kubernetes/ovnkube-node-xfzfk"]
Jul 22 18:56:40.803639 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.802020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.804049 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.804030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.805464 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.805434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.806251 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.806226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.807524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.806653    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 18:56:40.807524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.806818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 18:56:40.807524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.806985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8whx7\""
Jul 22 18:56:40.807524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.807182    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.807524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.807401    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lxdd9\""
Jul 22 18:56:40.808354 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.807923    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.808354 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808125    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 18:56:40.808354 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.808566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 18:56:40.808832 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808814    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.808943 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808905    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mc9d\""
Jul 22 18:56:40.809035 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.808946    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.809035 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.809025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.809197 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.809178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.809868 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.809849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.809973 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.809950    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:40.810749 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.810724    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.810852 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.810753    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.811293 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.811025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 18:56:40.811293 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.811085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.811293 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.811128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5ldsz\""
Jul 22 18:56:40.811293 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.811183    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:40.811672 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.811652    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.812812 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.812474    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 18:56:40.812812 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.812561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bv2fg\""
Jul 22 18:56:40.812971 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.812954    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 18:56:40.813272 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.813251    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.813385 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.813349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 18:56:40.814026 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.813699    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 18:56:40.815316 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.815271    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 18:56:40.817059 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.817038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:40.817251 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.817160    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:40.819878 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.819857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.821717 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.821540    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.822295 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.822274    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.823298 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:40.823642 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e70d5056-68cc-4459-828c-8991cc528fa1-hosts-file\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.823719 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.823783 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwz5\" (UniqueName: \"kubernetes.io/projected/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-kube-api-access-pnwz5\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.823783 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-binary-copy\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.823783 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.823891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-dbus\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.823891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-systemd-units\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.823891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.823891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.823891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxbsj\" (UniqueName: \"kubernetes.io/projected/3b9d1cbb-b966-48dc-9164-1072e25c865d-kube-api-access-kxbsj\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.824096 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-system-cni-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.824096 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-cnibin\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.824096 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-os-release\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.824230 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.823972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.824262 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-host\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.824326 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-systemd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.824326 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-var-lib-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.824444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.824444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lmr\" (UniqueName: \"kubernetes.io/projected/e70d5056-68cc-4459-828c-8991cc528fa1-kube-api-access-r8lmr\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.824444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-node-log\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.824586 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-bin\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.824638 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-env-overrides\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.824692 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.824692 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gx6v\" (UniqueName: \"kubernetes.io/projected/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-kube-api-access-2gx6v\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.824820 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.824894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70d5056-68cc-4459-828c-8991cc528fa1-tmp-dir\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.824894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.824889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-kubelet\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825136 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-slash\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825246 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-netns\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825246 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-log-socket\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-config\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovn-node-metrics-cert\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b9d1cbb-b966-48dc-9164-1072e25c865d-host-slash\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-kubelet-config\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-etc-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-ovn\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-script-lib\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b9d1cbb-b966-48dc-9164-1072e25c865d-iptables-alerter-script\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.825566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-serviceca\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.825918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tn6d\" (UniqueName: \"kubernetes.io/projected/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-kube-api-access-6tn6d\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.825918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-netd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.825918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.825681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dksxg\" (UniqueName: \"kubernetes.io/projected/cbf4cff1-8c41-4594-8622-eb727b6a04de-kube-api-access-dksxg\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.827713 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.827691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.827875 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.827855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 18:56:40.827954 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.827927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7bcq5\""
Jul 22 18:56:40.828026 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qtrcg\""
Jul 22 18:56:40.828256 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828236    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mhszb\""
Jul 22 18:56:40.828362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 18:56:40.828422 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8fc79\""
Jul 22 18:56:40.828572 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828537    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 18:56:40.828683 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 18:56:40.828758 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828741    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 18:56:40.828832 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.828808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 18:56:40.833198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.833172    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 18:56:40.855106 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.855084    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbzp7"
Jul 22 18:56:40.862494 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.862474    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbzp7"
Jul 22 18:56:40.914142 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.914117    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 18:56:40.922834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.922787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"7502424949a55e9d60a15331712003a6","Type":"ContainerStarted","Data":"5d303eb46ed82c0b621f0006fef6f63e04ecb294fdb8abdd607a230d0e3a472f"}
Jul 22 18:56:40.924238 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.924196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" event={"ID":"4b1dd8c2174ce1853b1e15b0d6ee0318","Type":"ContainerStarted","Data":"8609c1fc71587e75e2cfdf5edab4748e167d87eeffcd2698036953285c2d5d96"}
Jul 22 18:56:40.926527 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-etc-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.926598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-script-lib\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.926598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.926598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cnibin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-multus\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-hostroot\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b9d1cbb-b966-48dc-9164-1072e25c865d-iptables-alerter-script\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-netd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-os-release\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-k8s-cni-cncf-io\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.926726 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dksxg\" (UniqueName: \"kubernetes.io/projected/cbf4cff1-8c41-4594-8622-eb727b6a04de-kube-api-access-dksxg\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e70d5056-68cc-4459-828c-8991cc528fa1-hosts-file\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-etc-tuned\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-tmp\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-kubelet\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-etc-kubernetes\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-socket-dir-parent\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-kubernetes\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-os-release\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.926986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8026137-167f-411c-8dfa-3304c8739514-konnectivity-ca\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:40.927063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lmr\" (UniqueName: \"kubernetes.io/projected/e70d5056-68cc-4459-828c-8991cc528fa1-kube-api-access-r8lmr\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-bin\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8026137-167f-411c-8dfa-3304c8739514-agent-certs\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-system-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70d5056-68cc-4459-828c-8991cc528fa1-tmp-dir\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-kubelet\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-slash\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjh9\" (UniqueName: \"kubernetes.io/projected/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kube-api-access-xpjh9\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-systemd\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-sys\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-netns\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b9d1cbb-b966-48dc-9164-1072e25c865d-host-slash\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-script-lib\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-kubelet-config\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-ovn\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-ovn\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.927859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-modprobe-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-etc-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-os-release\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-netd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b9d1cbb-b966-48dc-9164-1072e25c865d-iptables-alerter-script\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e70d5056-68cc-4459-828c-8991cc528fa1-hosts-file\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.927948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-cni-bin\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-serviceca\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-kubelet\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-slash\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70d5056-68cc-4459-828c-8991cc528fa1-tmp-dir\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b9d1cbb-b966-48dc-9164-1072e25c865d-host-slash\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tn6d\" (UniqueName: \"kubernetes.io/projected/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-kube-api-access-6tn6d\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:40.928700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-daemon-config\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-lib-modules\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-host\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwz5\" (UniqueName: \"kubernetes.io/projected/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-kube-api-access-pnwz5\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-binary-copy\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-serviceca\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-dbus\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-systemd-units\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysconfig\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-kubelet-config\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-conf\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-run\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cni-binary-copy\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.929622 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbsj\" (UniqueName: \"kubernetes.io/projected/3b9d1cbb-b966-48dc-9164-1072e25c865d-kube-api-access-kxbsj\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-system-cni-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-cnibin\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.928973    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.928994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-host\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.929100    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:41.429077934 +0000 UTC m=+2.997422300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-cnibin\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbf4cff1-8c41-4594-8622-eb727b6a04de-system-cni-dir\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-binary-copy\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-host\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-systemd-units\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-systemd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.929975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/255cc3cf-03c9-4f0e-a802-aa20b542aa34-dbus\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-var-lib-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.930483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-run-systemd\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-env-overrides\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-node-log\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gx6v\" (UniqueName: \"kubernetes.io/projected/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-kube-api-access-2gx6v\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-var-lib-kubelet\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-conf-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-multus-certs\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcphx\" (UniqueName: \"kubernetes.io/projected/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-kube-api-access-fcphx\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-netns\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-node-log\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-log-socket\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-log-socket\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-config\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovn-node-metrics-cert\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:40.931367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xkh\" (UniqueName: \"kubernetes.io/projected/8d65bec8-4c97-470d-b818-679c0808d694-kube-api-access-56xkh\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-bin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbf4cff1-8c41-4594-8622-eb727b6a04de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.930855    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.930890    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:56:41.43087917 +0000 UTC m=+2.999223519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.930910    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.931091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovnkube-config\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.931140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-var-lib-openvswitch\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.931179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-env-overrides\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.932178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.931228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-host-run-netns\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.935147 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.935116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-ovn-node-metrics-cert\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.937431 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.937412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lmr\" (UniqueName: \"kubernetes.io/projected/e70d5056-68cc-4459-828c-8991cc528fa1-kube-api-access-r8lmr\") pod \"node-resolver-fttc4\" (UID: \"e70d5056-68cc-4459-828c-8991cc528fa1\") " pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:40.937606 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.937552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dksxg\" (UniqueName: \"kubernetes.io/projected/cbf4cff1-8c41-4594-8622-eb727b6a04de-kube-api-access-dksxg\") pod \"multus-additional-cni-plugins-w46fs\" (UID: \"cbf4cff1-8c41-4594-8622-eb727b6a04de\") " pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:40.940098 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.940077    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:40.940394 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.940105    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:40.940394 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.940127    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:40.940394 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:40.940198    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:41.440180829 +0000 UTC m=+3.008525187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:40.942261 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.942237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwz5\" (UniqueName: \"kubernetes.io/projected/8443dbef-c373-41c5-b9ac-a5a13ebd3f0f-kube-api-access-pnwz5\") pod \"ovnkube-node-xfzfk\" (UID: \"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:40.942748 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.942724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxbsj\" (UniqueName: \"kubernetes.io/projected/3b9d1cbb-b966-48dc-9164-1072e25c865d-kube-api-access-kxbsj\") pod \"iptables-alerter-4p28g\" (UID: \"3b9d1cbb-b966-48dc-9164-1072e25c865d\") " pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:40.942870 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.942777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gx6v\" (UniqueName: \"kubernetes.io/projected/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-kube-api-access-2gx6v\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:40.943205 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:40.943185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tn6d\" (UniqueName: \"kubernetes.io/projected/38c11dbb-50be-4fc7-ab02-ac97b3be44d6-kube-api-access-6tn6d\") pod \"node-ca-5f7z2\" (UID: \"38c11dbb-50be-4fc7-ab02-ac97b3be44d6\") " pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:41.031122 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031122 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031331 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysconfig\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031331 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-conf\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031331 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-run\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031331 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031331 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cni-binary-copy\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-var-lib-kubelet\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-conf\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-conf-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-conf-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-run\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-multus-certs\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-var-lib-kubelet\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysctl-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcphx\" (UniqueName: \"kubernetes.io/projected/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-kube-api-access-fcphx\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-multus-certs\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-sysconfig\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xkh\" (UniqueName: \"kubernetes.io/projected/8d65bec8-4c97-470d-b818-679c0808d694-kube-api-access-56xkh\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-bin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.031598 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cnibin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-bin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-multus\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-cni-multus\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cnibin\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-hostroot\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-os-release\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-k8s-cni-cncf-io\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-etc-tuned\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-tmp\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-hostroot\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-cni-binary-copy\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-kubelet\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-k8s-cni-cncf-io\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-os-release\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.032213 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-var-lib-kubelet\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-etc-kubernetes\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-etc-kubernetes\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-socket-dir-parent\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.031999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-kubernetes\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8026137-167f-411c-8dfa-3304c8739514-konnectivity-ca\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8026137-167f-411c-8dfa-3304c8739514-agent-certs\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-socket-dir-parent\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-system-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjh9\" (UniqueName: \"kubernetes.io/projected/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kube-api-access-xpjh9\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-systemd\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.033368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-kubernetes\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-system-cni-dir\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-sys\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-netns\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-modprobe-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-daemon-config\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-lib-modules\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-host\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-host\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-modprobe-d\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-etc-systemd\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-lib-modules\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-host-run-netns\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d65bec8-4c97-470d-b818-679c0808d694-sys\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.032917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8026137-167f-411c-8dfa-3304c8739514-konnectivity-ca\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.033145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-multus-daemon-config\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.034276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-etc-tuned\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.034365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.034367    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 18:56:41.035081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.034850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d65bec8-4c97-470d-b818-679c0808d694-tmp\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.038770 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.038749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8026137-167f-411c-8dfa-3304c8739514-agent-certs\") pod \"konnectivity-agent-f2grc\" (UID: \"f8026137-167f-411c-8dfa-3304c8739514\") " pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:41.043075 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.043018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xkh\" (UniqueName: \"kubernetes.io/projected/8d65bec8-4c97-470d-b818-679c0808d694-kube-api-access-56xkh\") pod \"tuned-9ldxj\" (UID: \"8d65bec8-4c97-470d-b818-679c0808d694\") " pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.043329 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.043215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcphx\" (UniqueName: \"kubernetes.io/projected/e3295bb0-66ba-48f0-9d6c-a12ebebcc17f-kube-api-access-fcphx\") pod \"multus-zt8n7\" (UID: \"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f\") " pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.043329 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.043250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjh9\" (UniqueName: \"kubernetes.io/projected/bf913aff-a9fa-4fd2-9ade-eef0683e6bc0-kube-api-access-xpjh9\") pod \"aws-ebs-csi-driver-node-xfszw\" (UID: \"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.121432 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.121407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p28g"
Jul 22 18:56:41.137364 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.137337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w46fs"
Jul 22 18:56:41.147317 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.147291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fttc4"
Jul 22 18:56:41.153200 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.153181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f7z2"
Jul 22 18:56:41.161398 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.161379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:56:41.170584 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.170564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw"
Jul 22 18:56:41.178404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.178384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ldxj"
Jul 22 18:56:41.186220 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.186182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:56:41.194036 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.194018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt8n7"
Jul 22 18:56:41.435929 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.435854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:41.435929 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.435909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:41.436150 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.436036    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:41.436150 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.436037    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:41.436150 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.436094    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:56:42.436078967 +0000 UTC m=+4.004423316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:41.436150 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.436113    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:42.436103378 +0000 UTC m=+4.004447731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:41.536360 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.536323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:41.536553 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.536531    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:41.536606 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.536565    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:41.536606 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.536579    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:41.536696 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.536638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:42.53662026 +0000 UTC m=+4.104964611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:41.865670 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.865578    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:51:41 +0000 UTC" deadline="2028-04-10 23:38:54.748569748 +0000 UTC"
Jul 22 18:56:41.865670 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.865639    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15076h42m12.88293463s"
Jul 22 18:56:41.914081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:41.914052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:41.914211 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:41.914187    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:42.040610 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:56:42.040411    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8443dbef_c373_41c5_b9ac_a5a13ebd3f0f.slice/crio-51481cdb56264e739c082161aac5cda80e2f74beff01e55fd9e15b9ad9263945 WatchSource:0}: Error finding container 51481cdb56264e739c082161aac5cda80e2f74beff01e55fd9e15b9ad9263945: Status 404 returned error can't find the container with id 51481cdb56264e739c082161aac5cda80e2f74beff01e55fd9e15b9ad9263945
Jul 22 18:56:42.442674 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.442640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:42.442800 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.442708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:42.442864 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.442840    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:42.442864 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.442847    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:42.442940 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.442923    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:44.442906919 +0000 UTC m=+6.011251269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:42.442990 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.442942    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:56:44.442933728 +0000 UTC m=+6.011278079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:42.543063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.543024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:42.543231 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.543217    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:42.543325 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.543255    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:42.543325 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.543271    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:42.543438 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.543329    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:44.543310256 +0000 UTC m=+6.111654622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:42.866540 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.866440    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:51:41 +0000 UTC" deadline="2028-04-18 16:43:56.6962347 +0000 UTC"
Jul 22 18:56:42.866540 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.866483    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15261h47m13.829757151s"
Jul 22 18:56:42.917102 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.917061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:42.917270 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.917202    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:42.917653 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.917628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:42.917775 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:42.917749    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:42.945556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.945522    2578 generic.go:356] "Generic (PLEG): container finished" podID="7502424949a55e9d60a15331712003a6" containerID="6d9dd5e9b5834b5000ad067dc4e5a2d10478f7d73e392efb90836a9754e56035" exitCode=0
Jul 22 18:56:42.946157 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.946128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"7502424949a55e9d60a15331712003a6","Type":"ContainerDied","Data":"6d9dd5e9b5834b5000ad067dc4e5a2d10478f7d73e392efb90836a9754e56035"}
Jul 22 18:56:42.976503 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.975889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" event={"ID":"4b1dd8c2174ce1853b1e15b0d6ee0318","Type":"ContainerStarted","Data":"76c6669af8db73fee0ebde0fbc973211f001f4aa069aa0c382192a4a616d9569"}
Jul 22 18:56:42.989827 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.989797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw" event={"ID":"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0","Type":"ContainerStarted","Data":"dceba1aa4795f8751fa832713fb984a74a690ed87be640706c32bda59ee7c6ac"}
Jul 22 18:56:42.995738 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:42.995709    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt8n7" event={"ID":"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f","Type":"ContainerStarted","Data":"a8dd7e773b0ac2b112f7d0f75aaa00436d2c6a57cb398654164ddf98f4634f22"}
Jul 22 18:56:43.000639 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.000611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2grc" event={"ID":"f8026137-167f-411c-8dfa-3304c8739514","Type":"ContainerStarted","Data":"b448ace08e82814b4e93678ff44a0d52fac5b7773a40dc6f0b42fff720b5c82b"}
Jul 22 18:56:43.022896 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.022847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p28g" event={"ID":"3b9d1cbb-b966-48dc-9164-1072e25c865d","Type":"ContainerStarted","Data":"a628635aadf3b29fc16f7e487fe11fe645dcaebb263383ec06fd4be253ac7474"}
Jul 22 18:56:43.040491 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.039971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerStarted","Data":"71b1ca73ec77bb3576a74aec2941b51727d38adc1ba84e5da0c102892078dea9"}
Jul 22 18:56:43.049209 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.049180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fttc4" event={"ID":"e70d5056-68cc-4459-828c-8991cc528fa1","Type":"ContainerStarted","Data":"e9cec4343646d6e24fd43420b75c038e9be79ad71016c73c84f3489fe77013fc"}
Jul 22 18:56:43.062633 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.062606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ldxj" event={"ID":"8d65bec8-4c97-470d-b818-679c0808d694","Type":"ContainerStarted","Data":"62a1d0f4fa2fe6d7f927e582076b69c13263f16baf7f4014a79a1dbafafbdc0a"}
Jul 22 18:56:43.067078 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.067003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f7z2" event={"ID":"38c11dbb-50be-4fc7-ab02-ac97b3be44d6","Type":"ContainerStarted","Data":"fe9a614ec0fc16a4c2b679b81ac5a68b8395fd76a1d3767dfafa1fd6d5a15016"}
Jul 22 18:56:43.084751 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.084724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"51481cdb56264e739c082161aac5cda80e2f74beff01e55fd9e15b9ad9263945"}
Jul 22 18:56:43.914713 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:43.914677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:43.915210 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:43.914843    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:44.116929 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.116868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"7502424949a55e9d60a15331712003a6","Type":"ContainerStarted","Data":"7dfadbb2b1610f8dec28aa2cbc10013fef642fe25de61a2799590b1a488b4278"}
Jul 22 18:56:44.132569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.132510    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" podStartSLOduration=4.132489914 podStartE2EDuration="4.132489914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:44.131777676 +0000 UTC m=+5.700122051" watchObservedRunningTime="2026-07-22 18:56:44.132489914 +0000 UTC m=+5.700834290"
Jul 22 18:56:44.132814 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.132761    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" podStartSLOduration=4.132747598 podStartE2EDuration="4.132747598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:42.991727081 +0000 UTC m=+4.560071457" watchObservedRunningTime="2026-07-22 18:56:44.132747598 +0000 UTC m=+5.701091975"
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.458958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.459050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.459181    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.459267    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:48.459230816 +0000 UTC m=+10.027575172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.459676    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:44.459763 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.459730    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:56:48.459713453 +0000 UTC m=+10.028057810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:44.559851 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.559774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:44.560035 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.559938    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:44.560035 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.559959    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:44.560035 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.559975    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:44.560035 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.560030    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:48.560011301 +0000 UTC m=+10.128355655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:44.914902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.914868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:44.915701 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.915437    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:44.915701 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:44.915504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:44.915701 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:44.915652    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:45.914635 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:45.914598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:45.914836 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:45.914741    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:46.914334 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:46.914302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:46.914810 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:46.914437    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:46.914810 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:46.914802    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:46.915077 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:46.914900    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:47.914351 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:47.914315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:47.914823 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:47.914444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:48.492774 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:48.492734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:48.492951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:48.492796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:48.492951 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.492934    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:48.493048 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.492990    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:56:56.492972863 +0000 UTC m=+18.061317223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:48.493110 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.493048    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:48.493110 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.493077    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:56.493067395 +0000 UTC m=+18.061411747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:48.593531 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:48.593491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:48.593696 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.593673    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:48.593752 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.593701    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:48.593752 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.593714    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:48.593865 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.593779    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:56:56.593759685 +0000 UTC m=+18.162104037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:48.914777 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:48.914746    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:48.915271 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.914824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:48.915271 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:48.914896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:48.915271 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:48.914967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:49.914387 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:49.914283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:49.914541 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:49.914432    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:50.914454 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:50.914422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:50.914822 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:50.914434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:50.914822 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:50.914553    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:50.914822 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:50.914606    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:51.914682 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:51.914221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:51.914682 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:51.914347    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:52.914358 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:52.914332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:52.914518 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:52.914332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:52.914518 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:52.914445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:52.914518 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:52.914502    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:53.914344 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:53.914317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:53.914744 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:53.914419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:54.914382 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:54.914345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:54.914771 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:54.914482    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:54.914771 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:54.914533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:54.914771 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:54.914636    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:55.914416 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:55.914385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:55.914961 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:55.914518    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:56.571198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:56.571165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:56.571397 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:56.571251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:56.571397 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.571319    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:56.571397 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.571331    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:56.571397 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.571388    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:57:12.571366039 +0000 UTC m=+34.139710393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:56:56.571631 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.571410    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:12.571401288 +0000 UTC m=+34.139745640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:56:56.672182 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:56.672151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:56.672340 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.672304    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:56:56.672340 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.672319    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:56:56.672340 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.672327    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:56.672441 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.672375    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:12.672362167 +0000 UTC m=+34.240706516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:56:56.914239 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:56.914195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:56.914414 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.914334    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:56.914637 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:56.914199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:56.914913 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:56.914702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:57.913821 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:57.913788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:57.913994 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:57.913915    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:56:58.915081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:58.915050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:56:58.915512 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:58.915164    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:56:58.915512 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:58.915269    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:56:58.915512 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:58.915395    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:56:59.914827 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:56:59.914797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:56:59.914976 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:56:59.914893    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:00.914677 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:00.914648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:00.915276 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:00.914684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:00.915276 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:00.914776    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:00.915276 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:00.914907    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:01.914749 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:01.914422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:01.915419 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:01.914857    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:02.157142 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.157115    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="2513852553cc4f247cab0f49f28d0b670457788eac7a9b0f82d8773d250623fb" exitCode=0
Jul 22 18:57:02.157326 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.157194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"2513852553cc4f247cab0f49f28d0b670457788eac7a9b0f82d8773d250623fb"}
Jul 22 18:57:02.159348 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.159314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fttc4" event={"ID":"e70d5056-68cc-4459-828c-8991cc528fa1","Type":"ContainerStarted","Data":"0c970f6d24f8e62d960bb26f1ab86e13201a650d96d557ff612a6b5b82c97bdd"}
Jul 22 18:57:02.160744 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.160721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ldxj" event={"ID":"8d65bec8-4c97-470d-b818-679c0808d694","Type":"ContainerStarted","Data":"897b0b468b1c6249935b0d3b4099f495af60946741167094af8a68dd101eeb5a"}
Jul 22 18:57:02.162114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.162090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f7z2" event={"ID":"38c11dbb-50be-4fc7-ab02-ac97b3be44d6","Type":"ContainerStarted","Data":"8f0a05761475fb63190b782ab3d0cabb9b0f6ae78969f42aa5ffcf9d0791780e"}
Jul 22 18:57:02.164738 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"eaebc683b03d87e1ee81aa2fc9e123d4fc1e42fd23680cd726a353b263632e7f"}
Jul 22 18:57:02.164824 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"ab766ad8b68f85f726eda39699772ece8f9f39f66b4681efb06bf5083d8517c3"}
Jul 22 18:57:02.164824 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"3a4d75e9458bbd890fb25381bd280e1ad88fe2435d55a4e520be73bc398d1fb4"}
Jul 22 18:57:02.164894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"ebd853e3ae33867ce90a03365617f5f4f274d754ee33acbf587b732341a58394"}
Jul 22 18:57:02.164894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"a26138b99c5ab531b48749b57d6abbc506a1da691bb826371bce986f509ace0f"}
Jul 22 18:57:02.164956 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.164918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"c218e5b7279bd56afd5f26e91e8a19a9a874a041b6a8995fd19e63363070dffc"}
Jul 22 18:57:02.166009 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.165993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw" event={"ID":"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0","Type":"ContainerStarted","Data":"15477695c479a4525d716cf68f14a78dd0be528b06ed95bbdae3b898a6c00d42"}
Jul 22 18:57:02.167115 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.167097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt8n7" event={"ID":"e3295bb0-66ba-48f0-9d6c-a12ebebcc17f","Type":"ContainerStarted","Data":"10a28f54dd528026ff3340af2bc82ad92af50275f7fff63c63c35bb9492d8d4a"}
Jul 22 18:57:02.169877 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.169856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2grc" event={"ID":"f8026137-167f-411c-8dfa-3304c8739514","Type":"ContainerStarted","Data":"90e339e436244566b387641a083b1ddc149b0cfe99156f03d62e85a067983532"}
Jul 22 18:57:02.224544 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.224499    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9ldxj" podStartSLOduration=4.075707132 podStartE2EDuration="23.224486943s" totalImagesPullingTime="19.148779811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:02.205466604 +0000 UTC m=+23.773810975" watchObservedRunningTime="2026-07-22 18:57:02.224486943 +0000 UTC m=+23.792831313"
Jul 22 18:57:02.225002 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.224962    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f2grc" podStartSLOduration=4.076180134 podStartE2EDuration="23.224953383s" totalImagesPullingTime="19.148773249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:02.224640973 +0000 UTC m=+23.792985334" watchObservedRunningTime="2026-07-22 18:57:02.224953383 +0000 UTC m=+23.793297753"
Jul 22 18:57:02.257817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.257771    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zt8n7" podStartSLOduration=4.058315056 podStartE2EDuration="23.257756607s" totalImagesPullingTime="19.199441551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:02.242553799 +0000 UTC m=+23.810898171" watchObservedRunningTime="2026-07-22 18:57:02.257756607 +0000 UTC m=+23.826100983"
Jul 22 18:57:02.258198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.258155    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fttc4" podStartSLOduration=4.085248612 podStartE2EDuration="23.258145171s" totalImagesPullingTime="19.172896559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:02.257418801 +0000 UTC m=+23.825763172" watchObservedRunningTime="2026-07-22 18:57:02.258145171 +0000 UTC m=+23.826489542"
Jul 22 18:57:02.272764 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.272719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5f7z2" podStartSLOduration=4.107837036 podStartE2EDuration="23.272701338s" totalImagesPullingTime="19.164864302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:02.272027998 +0000 UTC m=+23.840372348" watchObservedRunningTime="2026-07-22 18:57:02.272701338 +0000 UTC m=+23.841045710"
Jul 22 18:57:02.725821 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.725676    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 18:57:02.887471 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.887347    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T18:57:02.725815834Z","UUID":"1ed8266d-92f3-4bc5-b0c8-0d55996267d0","Handler":null,"Name":"","Endpoint":""}
Jul 22 18:57:02.888946 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.888923    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 18:57:02.889074 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.888970    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 18:57:02.914381 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.914355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:02.914510 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:02.914360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:02.914510 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:02.914448    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:02.914621 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:02.914532    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:03.174252 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:03.174155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p28g" event={"ID":"3b9d1cbb-b966-48dc-9164-1072e25c865d","Type":"ContainerStarted","Data":"6e691021c113ba06293486719e67830397da5a73faaf9f29e4a6d06fad78b961"}
Jul 22 18:57:03.176188 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:03.176157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw" event={"ID":"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0","Type":"ContainerStarted","Data":"f842fe1bdbdd1e76f43f31f380c282265d6913c23e026ab69daae914366f6ea5"}
Jul 22 18:57:03.191862 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:03.191822    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4p28g" podStartSLOduration=5.024172458 podStartE2EDuration="24.191808002s" totalImagesPullingTime="19.167635544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:03.191290023 +0000 UTC m=+24.759634395" watchObservedRunningTime="2026-07-22 18:57:03.191808002 +0000 UTC m=+24.760152557"
Jul 22 18:57:03.914716 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:03.914692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:03.914857 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:03.914826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:04.182574 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.182538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"708d0208d949528b0c746e212a0c209102f9d547d92a56532ffb69de7339c95d"}
Jul 22 18:57:04.184780 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.184753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw" event={"ID":"bf913aff-a9fa-4fd2-9ade-eef0683e6bc0","Type":"ContainerStarted","Data":"8a9b4464ca12fdaca33c17bdab5a8bfefe2c545c55f541aef7e7cdffc4c54a63"}
Jul 22 18:57:04.203241 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.203183    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfszw" podStartSLOduration=3.80368021 podStartE2EDuration="25.203166701s" totalImagesPullingTime="21.399486491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:04.202936242 +0000 UTC m=+25.771280612" watchObservedRunningTime="2026-07-22 18:57:04.203166701 +0000 UTC m=+25.771511073"
Jul 22 18:57:04.590927 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.590847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:57:04.591690 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.591674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:57:04.914008 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.913983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:04.914170 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:04.914014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:04.914170 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:04.914107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:04.914314 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:04.914268    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:05.187130 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:05.186910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:57:05.187793 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:05.187777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f2grc"
Jul 22 18:57:05.914559 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:05.914525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:05.914729 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:05.914632    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:06.917746 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:06.917581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:06.918155 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:06.917638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:06.918155 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:06.917826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:06.918155 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:06.917893    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:07.195289 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.195223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" event={"ID":"8443dbef-c373-41c5-b9ac-a5a13ebd3f0f","Type":"ContainerStarted","Data":"100043d2849ecdbb09b9ac431215374be0c66dd15b478873ad4f3576d77109a4"}
Jul 22 18:57:07.195480 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.195454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:07.197305 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.197282    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="c3cb1a50dd3167d35f07860d469bd8e01a3625ea2fab3f2966a0e0988746a45f" exitCode=0
Jul 22 18:57:07.197396 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.197335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"c3cb1a50dd3167d35f07860d469bd8e01a3625ea2fab3f2966a0e0988746a45f"}
Jul 22 18:57:07.211993 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.211976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:07.221075 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.221039    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk" podStartSLOduration=8.985019745 podStartE2EDuration="28.221027697s" totalImagesPullingTime="19.236007952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:07.220708117 +0000 UTC m=+28.789052487" watchObservedRunningTime="2026-07-22 18:57:07.221027697 +0000 UTC m=+28.789372068"
Jul 22 18:57:07.914175 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:07.914146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:07.914431 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:07.914290    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:08.200230 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.200146    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:08.200552 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.200233    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:08.215564 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.215543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:08.478275 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.478061    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ht2md"]
Jul 22 18:57:08.478368 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.478325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:08.478422 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:08.478402    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:08.481518 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.481493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5h2rj"]
Jul 22 18:57:08.481613 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.481604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:08.481722 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:08.481697    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:08.482430 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.482405    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrp45"]
Jul 22 18:57:08.482527 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:08.482514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:08.482654 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:08.482633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:09.206520 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:09.206486    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="3c887ca2d7f22784263c670d757a51301a17ba72422849b77b68a7d24e4b9a82" exitCode=0
Jul 22 18:57:09.207003 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:09.206564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"3c887ca2d7f22784263c670d757a51301a17ba72422849b77b68a7d24e4b9a82"}
Jul 22 18:57:09.914723 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:09.914691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:09.914877 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:09.914810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:09.914877 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:09.914821    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:09.914877 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:09.914843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:09.914999 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:09.914951    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:09.915057 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:09.915034    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:11.213013 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:11.212981    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="77adef097b3f6f3af9ce4a855b6b832f7b9a5020aeef0b20c5965229ab6809c1" exitCode=0
Jul 22 18:57:11.213692 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:11.213028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"77adef097b3f6f3af9ce4a855b6b832f7b9a5020aeef0b20c5965229ab6809c1"}
Jul 22 18:57:11.913871 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:11.913843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:11.914041 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:11.913841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:11.914041 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:11.913955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:11.914041 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:11.913843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:11.914195 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:11.914014    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:11.914195 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:11.914093    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:12.603007 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:12.602971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:12.603438 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:12.603026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:12.603438 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.603128    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 18:57:12.603438 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.603155    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:57:12.603438 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.603226    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret podName:255cc3cf-03c9-4f0e-a802-aa20b542aa34 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:44.603185552 +0000 UTC m=+66.171529911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret") pod "global-pull-secret-syncer-5h2rj" (UID: "255cc3cf-03c9-4f0e-a802-aa20b542aa34") : object "kube-system"/"original-pull-secret" not registered
Jul 22 18:57:12.603438 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.603252    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs podName:faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb nodeName:}" failed. No retries permitted until 2026-07-22 18:57:44.603239277 +0000 UTC m=+66.171583632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs") pod "network-metrics-daemon-zrp45" (UID: "faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 18:57:12.703935 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:12.703908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:12.704109 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.704062    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 18:57:12.704109 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.704103    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 18:57:12.704243 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.704115    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkj8n for pod openshift-network-diagnostics/network-check-target-ht2md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:57:12.704243 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:12.704176    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n podName:60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:44.704156913 +0000 UTC m=+66.272501278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkj8n" (UniqueName: "kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n") pod "network-check-target-ht2md" (UID: "60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 18:57:13.914078 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:13.913838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:13.914514 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:13.913885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:13.914514 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:13.914180    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ht2md" podUID="60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8"
Jul 22 18:57:13.914514 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:13.913885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:13.914514 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:13.914289    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5h2rj" podUID="255cc3cf-03c9-4f0e-a802-aa20b542aa34"
Jul 22 18:57:13.914514 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:13.914369    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrp45" podUID="faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb"
Jul 22 18:57:14.306951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.306921    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeReady"
Jul 22 18:57:14.307130 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.307084    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 18:57:14.358049 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.358011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z8gwq"]
Jul 22 18:57:14.360486 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.360464    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d5849"]
Jul 22 18:57:14.360628 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.360602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.362085 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.362066    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:57:14.362190 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.362154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.363752 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.363729    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cc98d\""
Jul 22 18:57:14.363834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.363818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 18:57:14.363946 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.363738    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 18:57:14.367163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.364485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.367942 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.367918    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 18:57:14.369072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.368053    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bx5gq\""
Jul 22 18:57:14.369072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.368100    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 18:57:14.369072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.368138    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 18:57:14.369072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.368262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dm4b7\""
Jul 22 18:57:14.369072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.368923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 18:57:14.370427 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.370407    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 18:57:14.370928 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.370891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 18:57:14.374090 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.374069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 18:57:14.375958 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.375942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8gwq"]
Jul 22 18:57:14.376455 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.376437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5849"]
Jul 22 18:57:14.394676 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.394655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:57:14.516076 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgq45\" (UniqueName: \"kubernetes.io/projected/c89d952e-0451-4ac0-916b-af5497ccdb80-kube-api-access-vgq45\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.516269 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/893f3df3-d326-424b-aa96-b6f2387f4785-cert\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.516269 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516269 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.516269 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c89d952e-0451-4ac0-916b-af5497ccdb80-config-volume\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz76r\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48mcq\" (UniqueName: \"kubernetes.io/projected/893f3df3-d326-424b-aa96-b6f2387f4785-kube-api-access-48mcq\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516439 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.516658 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89d952e-0451-4ac0-916b-af5497ccdb80-tmp-dir\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.516658 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.516488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.605028 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.604952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"]
Jul 22 18:57:14.607454 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.607432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.609838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.609819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 18:57:14.609985 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.609968    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-55nr7\""
Jul 22 18:57:14.610267 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.610246    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 18:57:14.616995 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.616972    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"]
Jul 22 18:57:14.617175 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.617278 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c89d952e-0451-4ac0-916b-af5497ccdb80-config-volume\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.617278 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz76r\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48mcq\" (UniqueName: \"kubernetes.io/projected/893f3df3-d326-424b-aa96-b6f2387f4785-kube-api-access-48mcq\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.617372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89d952e-0451-4ac0-916b-af5497ccdb80-tmp-dir\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.617554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgq45\" (UniqueName: \"kubernetes.io/projected/c89d952e-0451-4ac0-916b-af5497ccdb80-kube-api-access-vgq45\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.617732 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/893f3df3-d326-424b-aa96-b6f2387f4785-cert\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.617732 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.617594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.617732 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.617629    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:14.617732 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.617694    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:15.11767529 +0000 UTC m=+36.686019647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:14.618233 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.618197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c89d952e-0451-4ac0-916b-af5497ccdb80-config-volume\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.618852 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.618831    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:14.618852 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.618852    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:14.619013 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.618854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.619013 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.618903    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:15.118886991 +0000 UTC m=+36.687231341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:14.619155 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.619108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.619742 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.619577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89d952e-0451-4ac0-916b-af5497ccdb80-tmp-dir\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.620194 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.620173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.622770 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.622747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.622855 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.622756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.624448 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.624426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/893f3df3-d326-424b-aa96-b6f2387f4785-cert\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.631137 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.631095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.631978 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.631957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz76r\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:14.632161 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.632141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48mcq\" (UniqueName: \"kubernetes.io/projected/893f3df3-d326-424b-aa96-b6f2387f4785-kube-api-access-48mcq\") pod \"ingress-canary-d5849\" (UID: \"893f3df3-d326-424b-aa96-b6f2387f4785\") " pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.632250 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.632163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgq45\" (UniqueName: \"kubernetes.io/projected/c89d952e-0451-4ac0-916b-af5497ccdb80-kube-api-access-vgq45\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:14.685365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.685338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d5849"
Jul 22 18:57:14.718554 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.718535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.718673 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.718566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.819295 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.819260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.819447 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.819319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.819447 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.819429    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:14.819553 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:14.819498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:15.319476643 +0000 UTC m=+36.887820996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:14.820028 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.819994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:14.852189 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.852145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:14.939081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:14.939051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:15.121103 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.121053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:15.121299 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.121160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:15.121299 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.121184    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:15.121299 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.121224    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:15.121299 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.121288    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:16.121267735 +0000 UTC m=+37.689612108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:15.121513 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.121308    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:15.121513 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.121361    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:16.121346291 +0000 UTC m=+37.689690641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:15.231240 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.231176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerStarted","Data":"1d959b4355fc40167a33b23a893c02cd0baecbfbae7d0896dd595bdc3674b9d7"}
Jul 22 18:57:15.231380 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.231288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d5849"]
Jul 22 18:57:15.238088 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:15.238062    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893f3df3_d326_424b_aa96_b6f2387f4785.slice/crio-5145bd2a7eaede88e509b38c0ef024b4cdcb85b8a5189a94d62172b5f33c0530 WatchSource:0}: Error finding container 5145bd2a7eaede88e509b38c0ef024b4cdcb85b8a5189a94d62172b5f33c0530: Status 404 returned error can't find the container with id 5145bd2a7eaede88e509b38c0ef024b4cdcb85b8a5189a94d62172b5f33c0530
Jul 22 18:57:15.322130 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.322102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:15.322283 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.322265    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:15.322341 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:15.322332    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:16.322317065 +0000 UTC m=+37.890661414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:15.914033 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.913843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:15.914198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.913853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:15.914298 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.913853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.916720    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.916731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5knzw\""
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.916793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8nmg\""
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.916731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.917040    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 18:57:15.917144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:15.917045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 18:57:16.127128 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.127098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.127198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.127284    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.127300    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.127314    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.127371    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:18.127349489 +0000 UTC m=+39.695693852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:16.127530 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.127393    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:18.127379707 +0000 UTC m=+39.695724056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:16.234450 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.234379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5849" event={"ID":"893f3df3-d326-424b-aa96-b6f2387f4785","Type":"ContainerStarted","Data":"5145bd2a7eaede88e509b38c0ef024b4cdcb85b8a5189a94d62172b5f33c0530"}
Jul 22 18:57:16.237573 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.237536    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="1d959b4355fc40167a33b23a893c02cd0baecbfbae7d0896dd595bdc3674b9d7" exitCode=0
Jul 22 18:57:16.237573 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.237566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"1d959b4355fc40167a33b23a893c02cd0baecbfbae7d0896dd595bdc3674b9d7"}
Jul 22 18:57:16.329245 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:16.329202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:16.329348 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.329332    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:16.329503 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:16.329483    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:18.329461158 +0000 UTC m=+39.897805526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:17.243731 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:17.243694    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4cff1-8c41-4594-8622-eb727b6a04de" containerID="630b32b3389335df5d9402ca22f299229151173aebf808121326f7db918e4cd0" exitCode=0
Jul 22 18:57:17.244273 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:17.243774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerDied","Data":"630b32b3389335df5d9402ca22f299229151173aebf808121326f7db918e4cd0"}
Jul 22 18:57:17.960520 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:17.960489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.058293 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.058240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.142977 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.142954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:18.143082 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.143004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:18.143143 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.143100    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:18.143190 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.143162    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:22.143146997 +0000 UTC m=+43.711491346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:18.143190 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.143169    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:18.143190 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.143186    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:18.143358 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.143264    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:22.143245985 +0000 UTC m=+43.711590350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:18.146520 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.146497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.246962 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.246934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.250502 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.250472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w46fs" event={"ID":"cbf4cff1-8c41-4594-8622-eb727b6a04de","Type":"ContainerStarted","Data":"7ee4ea3a8471e5f6d829a06dd3a2dcad38c46fc7f2c5efb7954530074ffccb73"}
Jul 22 18:57:18.251930 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.251906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d5849" event={"ID":"893f3df3-d326-424b-aa96-b6f2387f4785","Type":"ContainerStarted","Data":"0e301b0c3d4b4708904e52800e0bab368155fcd6adc327945d0f4d65d4e9482b"}
Jul 22 18:57:18.275237 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.275157    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w46fs" podStartSLOduration=9.878434728 podStartE2EDuration="39.275140309s" totalImagesPullingTime="29.396705581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:18.27376051 +0000 UTC m=+39.842104894" watchObservedRunningTime="2026-07-22 18:57:18.275140309 +0000 UTC m=+39.843484681"
Jul 22 18:57:18.290732 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.290693    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d5849" podStartSLOduration=1.445072814 podStartE2EDuration="4.290679871s" totalImagesPullingTime="2.845607057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:18.289960578 +0000 UTC m=+39.858304950" watchObservedRunningTime="2026-07-22 18:57:18.290679871 +0000 UTC m=+39.859024225"
Jul 22 18:57:18.344692 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.344609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:18.344852 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.344827    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:18.344914 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:18.344903    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:22.344883265 +0000 UTC m=+43.913227616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:18.359544 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.359520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.460592 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.460564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.560888 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.560861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.672644 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.672615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.745237 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.745201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.894076 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.894054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:18.952113 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:18.952051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:19.292535 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:19.292468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:19.359565 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:19.359540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:21.424391 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:21.424339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:21.483017 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:21.482989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:22.080511 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:22.080481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:22.138770 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:22.138746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:22.172872 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:22.172850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:22.172940 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:22.172924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:22.173027 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.173012    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:22.173070 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.173034    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:22.173105 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.173083    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:30.173068596 +0000 UTC m=+51.741412945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:22.173105 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.173012    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:22.173190 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.173140    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:30.173128978 +0000 UTC m=+51.741473337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:22.374098 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:22.374032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:22.374228 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.374157    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:22.374269 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:22.374233    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:30.374198106 +0000 UTC m=+51.942542455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:24.022393 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.022361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:24.424947 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.424918    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4cm6x"]
Jul 22 18:57:24.453239 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.453193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cm6x"]
Jul 22 18:57:24.453376 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.453310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.455786 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.455728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wspht\""
Jul 22 18:57:24.455786 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.455775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:24.455935 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.455756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 18:57:24.456568 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.456548    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 18:57:24.456660 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.456574    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 18:57:24.456660 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.456600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 18:57:24.489689 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.489663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.489776 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.489714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22453af-daa6-455c-b426-448d2b619392-data-volume\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.489776 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.489731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfppv\" (UniqueName: \"kubernetes.io/projected/c22453af-daa6-455c-b426-448d2b619392-kube-api-access-vfppv\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.489891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.489872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22453af-daa6-455c-b426-448d2b619392-crio-socket\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.489926 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.489910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.534450 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.534425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:24.590688 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22453af-daa6-455c-b426-448d2b619392-crio-socket\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.590784 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.590845 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:24.590818    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:24.590845 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.590937 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22453af-daa6-455c-b426-448d2b619392-crio-socket\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.590937 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:24.590874    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:25.090856704 +0000 UTC m=+46.659201072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:24.590937 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:24.590895    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 18:57:24.590937 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22453af-daa6-455c-b426-448d2b619392-data-volume\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.591144 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:24.590940    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:25.090927878 +0000 UTC m=+46.659272227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : configmap "kube-rbac-proxy" not found
Jul 22 18:57:24.591144 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.590964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfppv\" (UniqueName: \"kubernetes.io/projected/c22453af-daa6-455c-b426-448d2b619392-kube-api-access-vfppv\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.591248 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.591155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22453af-daa6-455c-b426-448d2b619392-data-volume\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.600810 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.600785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfppv\" (UniqueName: \"kubernetes.io/projected/c22453af-daa6-455c-b426-448d2b619392-kube-api-access-vfppv\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:24.716052 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.715998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:24.817555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.817530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:24.921959 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:24.921937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:25.022814 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:25.022761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:25.095301 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:25.095278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:25.095397 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:25.095316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:25.095456 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:25.095417    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:25.095456 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:25.095426    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 18:57:25.095550 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:25.095488    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:26.095471197 +0000 UTC m=+47.663815565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : configmap "kube-rbac-proxy" not found
Jul 22 18:57:25.095550 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:25.095507    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:26.095497861 +0000 UTC m=+47.663842216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:25.418492 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:25.418470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:25.518405 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:25.518381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:26.100887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:26.100861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:26.101251 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:26.100894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:26.101251 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:26.100991    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 18:57:26.101251 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:26.101003    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:26.101251 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:26.101045    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:28.10102922 +0000 UTC m=+49.669373568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : configmap "kube-rbac-proxy" not found
Jul 22 18:57:26.101251 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:26.101061    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:28.101053991 +0000 UTC m=+49.669398340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:26.612457 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:26.612429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fttc4_e70d5056-68cc-4459-828c-8991cc528fa1/dns-node-resolver/0.log"
Jul 22 18:57:27.057178 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:27.057149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:27.117490 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:27.117460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:27.211498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:27.211474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f7z2_38c11dbb-50be-4fc7-ab02-ac97b3be44d6/node-ca/0.log"
Jul 22 18:57:28.116495 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:28.116460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:28.116495 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:28.116499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:28.116711 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:28.116592    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 18:57:28.116711 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:28.116658    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:28.116778 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:28.116739    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:32.116716357 +0000 UTC m=+53.685060707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:28.116778 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:28.116761    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:32.116750178 +0000 UTC m=+53.685094530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : configmap "kube-rbac-proxy" not found
Jul 22 18:57:28.212937 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:28.212917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5849_893f3df3-d326-424b-aa96-b6f2387f4785/serve-healthcheck-canary/0.log"
Jul 22 18:57:28.299479 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:28.299453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:30.233308 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:30.233271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:30.233353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.233430    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.233451    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d44687cdf-4dspx: secret "image-registry-tls" not found
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.233455    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.233508    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls podName:c89d952e-0451-4ac0-916b-af5497ccdb80 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:46.233491902 +0000 UTC m=+67.801836252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls") pod "dns-default-z8gwq" (UID: "c89d952e-0451-4ac0-916b-af5497ccdb80") : secret "dns-default-metrics-tls" not found
Jul 22 18:57:30.233695 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.233528    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls podName:0245d755-46d1-4b88-83e3-2bb6ef446a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:46.233514353 +0000 UTC m=+67.801858702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls") pod "image-registry-5d44687cdf-4dspx" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57") : secret "image-registry-tls" not found
Jul 22 18:57:30.399636 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:30.399607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:30.434640 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:30.434611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:30.434771 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.434739    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 18:57:30.434829 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:30.434793    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert podName:cc390638-32ec-45c7-94bf-4dc9f2cbf94d nodeName:}" failed. No retries permitted until 2026-07-22 18:57:46.434777782 +0000 UTC m=+68.003122142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-wnhx8" (UID: "cc390638-32ec-45c7-94bf-4dc9f2cbf94d") : secret "networking-console-plugin-cert" not found
Jul 22 18:57:30.852792 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:30.852761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.111894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.111824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.212243 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.212203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.371566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.371513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.454928 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.454907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.556717 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.556698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:31.683715 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:31.683695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:32.147569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:32.147545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:32.147705 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:32.147644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:32.147749 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:32.147736    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:32.147798 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:57:32.147787    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls podName:c22453af-daa6-455c-b426-448d2b619392 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:40.147774888 +0000 UTC m=+61.716119237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cm6x" (UID: "c22453af-daa6-455c-b426-448d2b619392") : secret "insights-runtime-extractor-tls" not found
Jul 22 18:57:32.148127 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:32.148108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22453af-daa6-455c-b426-448d2b619392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:32.361699 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:32.361669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:33.009539 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:33.009510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:33.168840 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:33.168817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:33.413128 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:33.413104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:33.554596 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:33.554566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:34.461346 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:34.461308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:34.561255 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:34.561227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:34.619828 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:34.619798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:34.947493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:34.947464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:35.153397 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:35.153369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:35.354629 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:35.354553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:35.405302 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:35.405276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:35.550287 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:35.550260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:36.549330 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:36.549294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:36.946832 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:36.946804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:37.096095 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:37.096069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:37.196744 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:37.196715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:37.350165 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:37.350076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:37.555271 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:37.555230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:38.552277 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:38.552244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:38.950514 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:38.950485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:39.153472 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:39.153441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:39.254268 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:39.254196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:39.354236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:39.354199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:39.746555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:39.746530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:40.149809 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.149753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:40.211811 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.211782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:40.214456 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.214427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22453af-daa6-455c-b426-448d2b619392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cm6x\" (UID: \"c22453af-daa6-455c-b426-448d2b619392\") " pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:40.231027 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.231003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfzfk"
Jul 22 18:57:40.365337 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.365312    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wspht\""
Jul 22 18:57:40.373452 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.373432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cm6x"
Jul 22 18:57:40.549750 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.549723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cm6x"]
Jul 22 18:57:40.552701 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:40.552675    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22453af_daa6_455c_b426_448d2b619392.slice/crio-e1b17f8a5c50fa1c414f8ce47f5faf183ec2d8c3e36e945a6aa2e5be78d85be3 WatchSource:0}: Error finding container e1b17f8a5c50fa1c414f8ce47f5faf183ec2d8c3e36e945a6aa2e5be78d85be3: Status 404 returned error can't find the container with id e1b17f8a5c50fa1c414f8ce47f5faf183ec2d8c3e36e945a6aa2e5be78d85be3
Jul 22 18:57:40.743424 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:40.743367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:41.149841 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:41.149807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:41.309781 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:41.309742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cm6x" event={"ID":"c22453af-daa6-455c-b426-448d2b619392","Type":"ContainerStarted","Data":"e1b17f8a5c50fa1c414f8ce47f5faf183ec2d8c3e36e945a6aa2e5be78d85be3"}
Jul 22 18:57:41.350231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:41.350136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:41.603607 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:41.603526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:44.643362 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.643297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:44.643739 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.643395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:44.645891 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.645870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 18:57:44.646422 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.646406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 18:57:44.656785 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.656766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/255cc3cf-03c9-4f0e-a802-aa20b542aa34-original-pull-secret\") pod \"global-pull-secret-syncer-5h2rj\" (UID: \"255cc3cf-03c9-4f0e-a802-aa20b542aa34\") " pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:44.656909 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.656765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb-metrics-certs\") pod \"network-metrics-daemon-zrp45\" (UID: \"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb\") " pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:44.725679 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.725651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5h2rj"
Jul 22 18:57:44.740276 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.740252    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5knzw\""
Jul 22 18:57:44.744342 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.744320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:44.746523 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.746500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 18:57:44.748117 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.748101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrp45"
Jul 22 18:57:44.756928 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.756908    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 18:57:44.768358 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:44.768321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkj8n\" (UniqueName: \"kubernetes.io/projected/60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8-kube-api-access-tkj8n\") pod \"network-check-target-ht2md\" (UID: \"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8\") " pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:45.035179 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:45.035100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8nmg\""
Jul 22 18:57:45.043149 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:45.043127    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:45.365125 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:45.365048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrp45"]
Jul 22 18:57:45.369148 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:45.369121    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf36ee6_9fe8_4e43_b2fb_7763dd06bfeb.slice/crio-56b6c4912dd09b88f10339f635d2cc09010698923982d54cd7f9f911b046c2b3 WatchSource:0}: Error finding container 56b6c4912dd09b88f10339f635d2cc09010698923982d54cd7f9f911b046c2b3: Status 404 returned error can't find the container with id 56b6c4912dd09b88f10339f635d2cc09010698923982d54cd7f9f911b046c2b3
Jul 22 18:57:45.589109 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:45.589013    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5h2rj"]
Jul 22 18:57:45.589860 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:45.589830    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ht2md"]
Jul 22 18:57:45.591742 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:45.591719    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255cc3cf_03c9_4f0e_a802_aa20b542aa34.slice/crio-7e5b2f58418eaa80f173ae3b4c6e0992f53f6cf180286f260c2818d792df92ad WatchSource:0}: Error finding container 7e5b2f58418eaa80f173ae3b4c6e0992f53f6cf180286f260c2818d792df92ad: Status 404 returned error can't find the container with id 7e5b2f58418eaa80f173ae3b4c6e0992f53f6cf180286f260c2818d792df92ad
Jul 22 18:57:45.593104 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:45.593078    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a1b5b5_05c2_4bd7_8878_4b7e1c940fc8.slice/crio-fc9b090d3ecf1900b399a3d9ec35293fea9fc753ff797f419c1fdf5a32e28f6a WatchSource:0}: Error finding container fc9b090d3ecf1900b399a3d9ec35293fea9fc753ff797f419c1fdf5a32e28f6a: Status 404 returned error can't find the container with id fc9b090d3ecf1900b399a3d9ec35293fea9fc753ff797f419c1fdf5a32e28f6a
Jul 22 18:57:46.255159 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.254648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:46.255159 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.254726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:46.261227 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.261158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c89d952e-0451-4ac0-916b-af5497ccdb80-metrics-tls\") pod \"dns-default-z8gwq\" (UID: \"c89d952e-0451-4ac0-916b-af5497ccdb80\") " pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:46.262086 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.262062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"image-registry-5d44687cdf-4dspx\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") " pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:46.328006 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.327910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ht2md" event={"ID":"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8","Type":"ContainerStarted","Data":"fc9b090d3ecf1900b399a3d9ec35293fea9fc753ff797f419c1fdf5a32e28f6a"}
Jul 22 18:57:46.329890 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.329814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5h2rj" event={"ID":"255cc3cf-03c9-4f0e-a802-aa20b542aa34","Type":"ContainerStarted","Data":"7e5b2f58418eaa80f173ae3b4c6e0992f53f6cf180286f260c2818d792df92ad"}
Jul 22 18:57:46.332586 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.332513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cm6x" event={"ID":"c22453af-daa6-455c-b426-448d2b619392","Type":"ContainerStarted","Data":"851cef9e663faec64106e4881cd8a372dff56644f15daa140a4f8fa148d1e4ec"}
Jul 22 18:57:46.334549 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.334469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrp45" event={"ID":"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb","Type":"ContainerStarted","Data":"56b6c4912dd09b88f10339f635d2cc09010698923982d54cd7f9f911b046c2b3"}
Jul 22 18:57:46.456898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.456859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:46.460619 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.460571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc390638-32ec-45c7-94bf-4dc9f2cbf94d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wnhx8\" (UID: \"cc390638-32ec-45c7-94bf-4dc9f2cbf94d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:46.479894 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.479695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cc98d\""
Jul 22 18:57:46.488050 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.487957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:46.493316 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.493041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bx5gq\""
Jul 22 18:57:46.501390 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.501194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:46.667629 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.667594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8gwq"]
Jul 22 18:57:46.678915 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:46.678774    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89d952e_0451_4ac0_916b_af5497ccdb80.slice/crio-3cef439aef8a93d39f084c81b053650a0000ba8457338c8946073e95b0e95fac WatchSource:0}: Error finding container 3cef439aef8a93d39f084c81b053650a0000ba8457338c8946073e95b0e95fac: Status 404 returned error can't find the container with id 3cef439aef8a93d39f084c81b053650a0000ba8457338c8946073e95b0e95fac
Jul 22 18:57:46.686054 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.686034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:57:46.692991 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:46.692966    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0245d755_46d1_4b88_83e3_2bb6ef446a57.slice/crio-a4354ddc2c54558aeb922c1508b3bf402624c975dfdebc3435f50b62e786ca8d WatchSource:0}: Error finding container a4354ddc2c54558aeb922c1508b3bf402624c975dfdebc3435f50b62e786ca8d: Status 404 returned error can't find the container with id a4354ddc2c54558aeb922c1508b3bf402624c975dfdebc3435f50b62e786ca8d
Jul 22 18:57:46.720916 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.720894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-55nr7\""
Jul 22 18:57:46.729231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.729182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"
Jul 22 18:57:46.930389 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:46.930363    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8"]
Jul 22 18:57:46.934924 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:46.934895    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc390638_32ec_45c7_94bf_4dc9f2cbf94d.slice/crio-6addb1ff6d5864efeddab865d995a90c5cff875b5e45d0815ef32f619d03214c WatchSource:0}: Error finding container 6addb1ff6d5864efeddab865d995a90c5cff875b5e45d0815ef32f619d03214c: Status 404 returned error can't find the container with id 6addb1ff6d5864efeddab865d995a90c5cff875b5e45d0815ef32f619d03214c
Jul 22 18:57:47.340270 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.340052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrp45" event={"ID":"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb","Type":"ContainerStarted","Data":"a64db82dd18f8bec34810207bd9633216009dde21a27c317c50d91d3af4294ea"}
Jul 22 18:57:47.340270 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.340127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrp45" event={"ID":"faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb","Type":"ContainerStarted","Data":"adf7912a99889d7cb3f2143afe223a49a49dd78918e3ecbfff91e730383afdf5"}
Jul 22 18:57:47.343997 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.343966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8" event={"ID":"cc390638-32ec-45c7-94bf-4dc9f2cbf94d","Type":"ContainerStarted","Data":"6addb1ff6d5864efeddab865d995a90c5cff875b5e45d0815ef32f619d03214c"}
Jul 22 18:57:47.349927 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.349379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" event={"ID":"0245d755-46d1-4b88-83e3-2bb6ef446a57","Type":"ContainerStarted","Data":"bc2ad06c2418f221f504534d108e39ea9d306a890afac9414ee8f43cec7d4396"}
Jul 22 18:57:47.349927 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.349424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" event={"ID":"0245d755-46d1-4b88-83e3-2bb6ef446a57","Type":"ContainerStarted","Data":"a4354ddc2c54558aeb922c1508b3bf402624c975dfdebc3435f50b62e786ca8d"}
Jul 22 18:57:47.349927 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.349882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:57:47.352305 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.352225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwq" event={"ID":"c89d952e-0451-4ac0-916b-af5497ccdb80","Type":"ContainerStarted","Data":"3cef439aef8a93d39f084c81b053650a0000ba8457338c8946073e95b0e95fac"}
Jul 22 18:57:47.379401 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.379107    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" podStartSLOduration=35.379089841 podStartE2EDuration="35.379089841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:47.378691565 +0000 UTC m=+68.947035935" watchObservedRunningTime="2026-07-22 18:57:47.379089841 +0000 UTC m=+68.947434212"
Jul 22 18:57:47.380746 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:47.379906    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zrp45" podStartSLOduration=67.174121812 podStartE2EDuration="1m8.379896635s" totalImagesPullingTime="1.205774823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:47.360526023 +0000 UTC m=+68.928870394" watchObservedRunningTime="2026-07-22 18:57:47.379896635 +0000 UTC m=+68.948241007"
Jul 22 18:57:48.859961 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:48.859914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:48.960685 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:48.960630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:49.109607 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:49.109563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:49.286265 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:49.286239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:49.344497 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:49.344467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:49.902669 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:49.902635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:49.970449 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:49.970419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:50.307649 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:50.307561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:50.361545 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:50.361513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:50.562237 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:50.562147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:50.704168 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:50.704132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.086769 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.086732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.187242 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.187200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.328108 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.328081    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"]
Jul 22 18:57:52.331110 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.331088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.336409 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.336376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 18:57:52.336991 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.336938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 18:57:52.336991 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.336972    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 18:57:52.337928 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.337904    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 18:57:52.348164 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.348141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"]
Jul 22 18:57:52.404823 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.404796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.404985 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.404845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncmbg\" (UniqueName: \"kubernetes.io/projected/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-kube-api-access-ncmbg\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.404985 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.404900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-tmp\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.407488 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.407458    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:57:52.432729 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.432701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6s4jg"]
Jul 22 18:57:52.434728 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.434713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:57:52.437189 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.437166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-chfj2\""
Jul 22 18:57:52.442674 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.442650    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 18:57:52.443086 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.443067    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 18:57:52.453578 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.453556    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6s4jg"]
Jul 22 18:57:52.478423 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.478401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.505279 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.505254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhzg5\" (UniqueName: \"kubernetes.io/projected/fe2cd89f-ad77-4285-9c13-5979e4bc1fbf-kube-api-access-fhzg5\") pod \"downloads-5bc67dcd46-6s4jg\" (UID: \"fe2cd89f-ad77-4285-9c13-5979e4bc1fbf\") " pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:57:52.505385 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.505297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-tmp\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.505385 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.505364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.505472 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.505412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncmbg\" (UniqueName: \"kubernetes.io/projected/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-kube-api-access-ncmbg\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.505695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.505674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-tmp\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.508229 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.508187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.514864 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.514842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncmbg\" (UniqueName: \"kubernetes.io/projected/630e0f5c-98c9-4b2d-b2bd-8d84babc1d28-kube-api-access-ncmbg\") pod \"klusterlet-addon-workmgr-66fd69f4d8-5ms9s\" (UID: \"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.534395 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.534372    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-858fcbcd6c-pwcxm"]
Jul 22 18:57:52.536777 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.536756    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.554297 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.554275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858fcbcd6c-pwcxm"]
Jul 22 18:57:52.572451 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.572423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.606747 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8082043c-8176-472c-a9b5-2718e9a0add4-ca-trust-extracted\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.606747 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-trusted-ca\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.606887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhzg5\" (UniqueName: \"kubernetes.io/projected/fe2cd89f-ad77-4285-9c13-5979e4bc1fbf-kube-api-access-fhzg5\") pod \"downloads-5bc67dcd46-6s4jg\" (UID: \"fe2cd89f-ad77-4285-9c13-5979e4bc1fbf\") " pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:57:52.606887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-image-registry-private-configuration\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.606887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-registry-certificates\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.607052 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-registry-tls\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.607052 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.606979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-bound-sa-token\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.607052 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.607024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stsjz\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-kube-api-access-stsjz\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.607166 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.607061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-installation-pull-secrets\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.615106 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.615079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhzg5\" (UniqueName: \"kubernetes.io/projected/fe2cd89f-ad77-4285-9c13-5979e4bc1fbf-kube-api-access-fhzg5\") pod \"downloads-5bc67dcd46-6s4jg\" (UID: \"fe2cd89f-ad77-4285-9c13-5979e4bc1fbf\") " pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:57:52.641661 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.641639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:57:52.670640 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.670616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.707440 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-registry-certificates\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707542 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-registry-tls\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707542 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-bound-sa-token\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707542 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stsjz\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-kube-api-access-stsjz\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-installation-pull-secrets\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8082043c-8176-472c-a9b5-2718e9a0add4-ca-trust-extracted\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-trusted-ca\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.707872 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.707711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-image-registry-private-configuration\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.708039 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.708015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8082043c-8176-472c-a9b5-2718e9a0add4-ca-trust-extracted\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.708374 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.708353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-registry-certificates\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.708982 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.708955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8082043c-8176-472c-a9b5-2718e9a0add4-trusted-ca\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.710592 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.710565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-registry-tls\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.710682 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.710577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-installation-pull-secrets\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.711877 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.711855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8082043c-8176-472c-a9b5-2718e9a0add4-image-registry-private-configuration\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.716613 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.716590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stsjz\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-kube-api-access-stsjz\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.717011 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.716970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8082043c-8176-472c-a9b5-2718e9a0add4-bound-sa-token\") pod \"image-registry-858fcbcd6c-pwcxm\" (UID: \"8082043c-8176-472c-a9b5-2718e9a0add4\") " pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.745355 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.745328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:57:52.772996 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.772971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:52.848660 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.848635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:52.917964 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:52.917935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:53.009935 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.009907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:53.427340 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.427130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858fcbcd6c-pwcxm"]
Jul 22 18:57:53.435372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.434155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6s4jg"]
Jul 22 18:57:53.440875 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:53.440849    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2cd89f_ad77_4285_9c13_5979e4bc1fbf.slice/crio-dc670c05a4742728c178dfc44d94e2658fcf93a4ceab8fe3e0419703cbc47e59 WatchSource:0}: Error finding container dc670c05a4742728c178dfc44d94e2658fcf93a4ceab8fe3e0419703cbc47e59: Status 404 returned error can't find the container with id dc670c05a4742728c178dfc44d94e2658fcf93a4ceab8fe3e0419703cbc47e59
Jul 22 18:57:53.461999 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.461933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"]
Jul 22 18:57:53.474492 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:53.474456    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630e0f5c_98c9_4b2d_b2bd_8d84babc1d28.slice/crio-bfa9d261ce3b0d06d5d33ae2917409d5020b561f53ad7861ded9a0778f68d425 WatchSource:0}: Error finding container bfa9d261ce3b0d06d5d33ae2917409d5020b561f53ad7861ded9a0778f68d425: Status 404 returned error can't find the container with id bfa9d261ce3b0d06d5d33ae2917409d5020b561f53ad7861ded9a0778f68d425
Jul 22 18:57:53.577880 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.577845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:53.979906 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:53.979870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:54.089524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.083552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:54.393258 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.393110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cm6x" event={"ID":"c22453af-daa6-455c-b426-448d2b619392","Type":"ContainerStarted","Data":"cd8f2552573d16192c8bd49a4fd371b42162c664443fbc01eee66217db4a95f5"}
Jul 22 18:57:54.396710 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.396625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6s4jg" event={"ID":"fe2cd89f-ad77-4285-9c13-5979e4bc1fbf","Type":"ContainerStarted","Data":"dc670c05a4742728c178dfc44d94e2658fcf93a4ceab8fe3e0419703cbc47e59"}
Jul 22 18:57:54.399245 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.399196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8" event={"ID":"cc390638-32ec-45c7-94bf-4dc9f2cbf94d","Type":"ContainerStarted","Data":"e2d4ff733dc32935ca564f5d34c66bf7adfbcd9cc304afaaf6296ef3e43987da"}
Jul 22 18:57:54.407320 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.407239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwq" event={"ID":"c89d952e-0451-4ac0-916b-af5497ccdb80","Type":"ContainerStarted","Data":"a3cd743f7b1784b0f1cae34ece3f50321e28c45926457f733f95ff7c6c7cdbe6"}
Jul 22 18:57:54.407320 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.407288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwq" event={"ID":"c89d952e-0451-4ac0-916b-af5497ccdb80","Type":"ContainerStarted","Data":"41c97177b3fe4d84b46055dba00ecc08dacb0494a5f976eb71da1ff337e50b39"}
Jul 22 18:57:54.407479 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.407367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:57:54.408764 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.408733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s" event={"ID":"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28","Type":"ContainerStarted","Data":"bfa9d261ce3b0d06d5d33ae2917409d5020b561f53ad7861ded9a0778f68d425"}
Jul 22 18:57:54.412508 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.411943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm" event={"ID":"8082043c-8176-472c-a9b5-2718e9a0add4","Type":"ContainerStarted","Data":"1b6a40a39813fdebfdb027a152ff0df8f7f17491402dc07dfc08aba2e08b6a2f"}
Jul 22 18:57:54.412508 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.411981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm" event={"ID":"8082043c-8176-472c-a9b5-2718e9a0add4","Type":"ContainerStarted","Data":"2f951d3221aeb28c6fe66e7a1e534babcaa2ad2ea84a0eec5341c7e37ebcbf4c"}
Jul 22 18:57:54.412508 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.412459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:57:54.414750 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.414441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ht2md" event={"ID":"60a1b5b5-05c2-4bd7-8878-4b7e1c940fc8","Type":"ContainerStarted","Data":"64ccd158c8a4d43401cfa73010ebe62f88033891c921316c3e3a552b85cf7ea8"}
Jul 22 18:57:54.414861 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.414826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:57:54.416717 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.416671    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wnhx8" podStartSLOduration=34.122506414 podStartE2EDuration="40.416655006s" totalImagesPullingTime="6.294148592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:54.415694538 +0000 UTC m=+75.984038910" watchObservedRunningTime="2026-07-22 18:57:54.416655006 +0000 UTC m=+75.984999374"
Jul 22 18:57:54.420919 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.419537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5h2rj" event={"ID":"255cc3cf-03c9-4f0e-a802-aa20b542aa34","Type":"ContainerStarted","Data":"da5069eb9739a44af1895c31081c890e09883ef225e93c47fe0b3d10d7bf310f"}
Jul 22 18:57:54.437165 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.436675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z8gwq" podStartSLOduration=33.885777657 podStartE2EDuration="40.436656231s" totalImagesPullingTime="6.550878574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:54.435417068 +0000 UTC m=+76.003761440" watchObservedRunningTime="2026-07-22 18:57:54.436656231 +0000 UTC m=+76.005000606"
Jul 22 18:57:54.453688 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.452598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ht2md" podStartSLOduration=67.816182944 podStartE2EDuration="1m15.452555049s" totalImagesPullingTime="7.636372105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:54.451743094 +0000 UTC m=+76.020087468" watchObservedRunningTime="2026-07-22 18:57:54.452555049 +0000 UTC m=+76.020899413"
Jul 22 18:57:54.471659 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.471600    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm" podStartSLOduration=2.471585475 podStartE2EDuration="2.471585475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:54.471372572 +0000 UTC m=+76.039716944" watchObservedRunningTime="2026-07-22 18:57:54.471585475 +0000 UTC m=+76.039929828"
Jul 22 18:57:54.908119 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:54.908033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:55.019844 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.019773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:55.083951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.083901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5h2rj" podStartSLOduration=68.42784655 podStartE2EDuration="1m16.083882759s" totalImagesPullingTime="7.656036209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:54.490662994 +0000 UTC m=+76.059007365" watchObservedRunningTime="2026-07-22 18:57:55.083882759 +0000 UTC m=+76.652227132"
Jul 22 18:57:55.084136 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.084038    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"]
Jul 22 18:57:55.089134 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.089108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:57:55.091879 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.091474    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 18:57:55.091879 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.091734    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7f9wr\""
Jul 22 18:57:55.100069 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.100018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"]
Jul 22 18:57:55.106522 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.106457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:55.229804 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.229671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fab65765-ff68-42e6-a486-53714341c818-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q94jf\" (UID: \"fab65765-ff68-42e6-a486-53714341c818\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:57:55.250438 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.250411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:55.330993 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.330955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fab65765-ff68-42e6-a486-53714341c818-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q94jf\" (UID: \"fab65765-ff68-42e6-a486-53714341c818\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:57:55.335363 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.335266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fab65765-ff68-42e6-a486-53714341c818-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q94jf\" (UID: \"fab65765-ff68-42e6-a486-53714341c818\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:57:55.372481 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.372405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:55.402588 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.402350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:57:55.440482 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:55.440399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:57:56.095746 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:56.095684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"]
Jul 22 18:57:57.530597 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.530565    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:57:57.543142 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.543118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.545251 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.545227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:57:57.548133 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.547895    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 18:57:57.548133 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.547947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 18:57:57.549961 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.548900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 18:57:57.549961 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.549126    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 18:57:57.549961 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.549377    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 18:57:57.549961 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.549582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5r47k\""
Jul 22 18:57:57.652236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.652236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.652236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqqtn\" (UniqueName: \"kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.652236 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.652507 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.652507 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.652300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753016 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.752978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753016 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753254 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqqtn\" (UniqueName: \"kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753254 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753254 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753254 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.753959 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.754026 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.753961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.756423 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.756394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.756617 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.756575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.762028 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.762000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqqtn\" (UniqueName: \"kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn\") pod \"console-8d869946-vlqnw\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") " pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:57.859226 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:57.859128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:57:58.124592 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:58.124522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab65765_ff68_42e6_a486_53714341c818.slice/crio-8077bbd685469c77769422dd2e5134bbf52bd9e3e86e8062be26b3a9bedb3972 WatchSource:0}: Error finding container 8077bbd685469c77769422dd2e5134bbf52bd9e3e86e8062be26b3a9bedb3972: Status 404 returned error can't find the container with id 8077bbd685469c77769422dd2e5134bbf52bd9e3e86e8062be26b3a9bedb3972
Jul 22 18:57:58.295995 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:58.295933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:57:58.299764 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:57:58.299735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba672a7a_5a9d_4562_91f5_e5d5a52e20a7.slice/crio-490bde4fe0b11911b773c952cc22f69bc2f7e3d0da4a14b0a6a76604e2e8229e WatchSource:0}: Error finding container 490bde4fe0b11911b773c952cc22f69bc2f7e3d0da4a14b0a6a76604e2e8229e: Status 404 returned error can't find the container with id 490bde4fe0b11911b773c952cc22f69bc2f7e3d0da4a14b0a6a76604e2e8229e
Jul 22 18:57:58.440371 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:58.439917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cm6x" event={"ID":"c22453af-daa6-455c-b426-448d2b619392","Type":"ContainerStarted","Data":"31239d0ad353a1b47b4a69b49dce00f404208a71eb9789817a1e3b781acf34ce"}
Jul 22 18:57:58.441274 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:58.441250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d869946-vlqnw" event={"ID":"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7","Type":"ContainerStarted","Data":"490bde4fe0b11911b773c952cc22f69bc2f7e3d0da4a14b0a6a76604e2e8229e"}
Jul 22 18:57:58.442637 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:58.442604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf" event={"ID":"fab65765-ff68-42e6-a486-53714341c818","Type":"ContainerStarted","Data":"8077bbd685469c77769422dd2e5134bbf52bd9e3e86e8062be26b3a9bedb3972"}
Jul 22 18:57:58.460979 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:57:58.460938    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4cm6x" podStartSLOduration=17.06360481 podStartE2EDuration="34.460924058s" totalImagesPullingTime="17.397319248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:57:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:58.459373502 +0000 UTC m=+80.027717913" watchObservedRunningTime="2026-07-22 18:57:58.460924058 +0000 UTC m=+80.029268428"
Jul 22 18:58:01.463229 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.463159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s" event={"ID":"630e0f5c-98c9-4b2d-b2bd-8d84babc1d28","Type":"ContainerStarted","Data":"3669d6c28451e92525f506a08ab495c5b7bf2bc2ca85a8fbe29ec3198852078b"}
Jul 22 18:58:01.463672 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.463626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:58:01.465567 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.465542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s"
Jul 22 18:58:01.466699 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.466326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf" event={"ID":"fab65765-ff68-42e6-a486-53714341c818","Type":"ContainerStarted","Data":"30be5951fae1412dd75d7a06319cee357dd59093c8c51b5c291e78136d11fa7f"}
Jul 22 18:58:01.466699 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.466379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:58:01.471575 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.471558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf"
Jul 22 18:58:01.479231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.478886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd69f4d8-5ms9s" podStartSLOduration=2.56675576 podStartE2EDuration="9.478870679s" totalImagesPullingTime="6.912114919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:01.477848782 +0000 UTC m=+83.046193157" watchObservedRunningTime="2026-07-22 18:58:01.478870679 +0000 UTC m=+83.047215050"
Jul 22 18:58:01.507284 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:01.507243    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q94jf" podStartSLOduration=4.264615625 podStartE2EDuration="6.507229273s" totalImagesPullingTime="2.242613648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:01.505810545 +0000 UTC m=+83.074154917" watchObservedRunningTime="2026-07-22 18:58:01.507229273 +0000 UTC m=+83.075573638"
Jul 22 18:58:02.109444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.109386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:02.143884 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.143852    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"]
Jul 22 18:58:02.148552 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.148529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.153390 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.153362    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 18:58:02.153502 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.153427    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 18:58:02.154402 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.154381    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 18:58:02.154524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.154481    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 18:58:02.154619 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.154603    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cjsns\""
Jul 22 18:58:02.154793 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.154777    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 18:58:02.159016 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.158988    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"]
Jul 22 18:58:02.210032 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.209998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:02.273415 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.273382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:02.300592 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.300508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.300592 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.300552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-kube-api-access-v8vwr\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.300775 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.300680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.300775 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.300721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.401320 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.401297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.401486 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.401331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.401486 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.401371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.401486 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.401393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-kube-api-access-v8vwr\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.402672 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.402635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.404342 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.404298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.404450 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.404398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.410177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.410155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/d3fb8957-4cbd-4fac-b9e3-d006d81416d8-kube-api-access-v8vwr\") pod \"prometheus-operator-5945b5cfd-lcjw6\" (UID: \"d3fb8957-4cbd-4fac-b9e3-d006d81416d8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.414809 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.414777    2578 patch_prober.go:28] interesting pod/image-registry-5d44687cdf-4dspx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 18:58:02.414905 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.414838    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 18:58:02.460195 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.460165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"
Jul 22 18:58:02.833197 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:02.833144    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6"]
Jul 22 18:58:02.835853 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:58:02.835829    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fb8957_4cbd_4fac_b9e3_d006d81416d8.slice/crio-a38a9d7512438bd8d0aa649bd3411c9772642010bd041dc98ffefc9631392ebe WatchSource:0}: Error finding container a38a9d7512438bd8d0aa649bd3411c9772642010bd041dc98ffefc9631392ebe: Status 404 returned error can't find the container with id a38a9d7512438bd8d0aa649bd3411c9772642010bd041dc98ffefc9631392ebe
Jul 22 18:58:03.476595 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:03.476555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d869946-vlqnw" event={"ID":"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7","Type":"ContainerStarted","Data":"aeb45b00b21b799ad1a60c51b158801d52dcd0b5d910b160ddbf342e880d533a"}
Jul 22 18:58:03.477992 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:03.477959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6" event={"ID":"d3fb8957-4cbd-4fac-b9e3-d006d81416d8","Type":"ContainerStarted","Data":"a38a9d7512438bd8d0aa649bd3411c9772642010bd041dc98ffefc9631392ebe"}
Jul 22 18:58:03.495099 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:03.495042    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d869946-vlqnw" podStartSLOduration=2.039457315 podStartE2EDuration="6.4950244s" totalImagesPullingTime="4.455567085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:03.493947349 +0000 UTC m=+85.062291722" watchObservedRunningTime="2026-07-22 18:58:03.4950244 +0000 UTC m=+85.063368773"
Jul 22 18:58:04.426663 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:04.426628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z8gwq"
Jul 22 18:58:04.882034 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:04.881962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:04.934778 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:04.934745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:05.488722 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.488686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6" event={"ID":"d3fb8957-4cbd-4fac-b9e3-d006d81416d8","Type":"ContainerStarted","Data":"990266476b28ac5749935e9cb90e36be15125808f0bec2456a1f9c4deebc934c"}
Jul 22 18:58:05.489130 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.488741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6" event={"ID":"d3fb8957-4cbd-4fac-b9e3-d006d81416d8","Type":"ContainerStarted","Data":"22757a557801f870ba1a6730357cc23eb6d00a7d6d8174fbd0fd4eb9f39fcb54"}
Jul 22 18:58:05.508800 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.508745    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lcjw6" podStartSLOduration=1.915362244 podStartE2EDuration="3.508726389s" totalImagesPullingTime="1.593364145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:05.507336695 +0000 UTC m=+87.075681065" watchObservedRunningTime="2026-07-22 18:58:05.508726389 +0000 UTC m=+87.077070762"
Jul 22 18:58:05.612509 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.612471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:05.713911 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.713881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:05.769523 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:05.769451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:06.118052 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.117975    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:06.196425 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.196392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:06.196589 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.196525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.204543 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.204519    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 18:58:06.333120 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333120 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98hf\" (UniqueName: \"kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333357 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333357 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333357 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333357 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.333552 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.333376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434531 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434687 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98hf\" (UniqueName: \"kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434687 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434801 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434801 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434801 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.434943 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.434814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.435740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.435717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.435862 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.435784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.436038 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.435994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.436146 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.436057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.437702 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.437683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.438073 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.438054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.443107 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.443086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98hf\" (UniqueName: \"kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf\") pod \"console-696b44bf7-8wgwb\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") " pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:06.508177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:06.508148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:07.083241 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.083194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.181978 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.181945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.286877 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.286841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.394737 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.394707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.489700 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.489660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.525187 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.525152    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4l46z"]
Jul 22 18:58:07.596651 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.596624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.599139 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.599103    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 18:58:07.599793 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.599716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvp2b\""
Jul 22 18:58:07.604192 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.600078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 18:58:07.604192 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.600557    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 18:58:07.606810 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.606785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.678931 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.678865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.745546 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745689 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-sys\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745689 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745799 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-root\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745799 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-textfile\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-tls\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-metrics-client-ca\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.745902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-wtmp\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.746038 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.745917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8k9\" (UniqueName: \"kubernetes.io/projected/2e2c3183-c792-48e3-a4e1-ab24d5432b35-kube-api-access-rw8k9\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.779339 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.779310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.846749 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.846898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-sys\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.846898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.846898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-root\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.846898 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-textfile\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847103 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-tls\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847103 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-metrics-client-ca\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847103 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-wtmp\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847103 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.846996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8k9\" (UniqueName: \"kubernetes.io/projected/2e2c3183-c792-48e3-a4e1-ab24d5432b35-kube-api-access-rw8k9\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847314 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-root\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847314 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-sys\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847462 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-textfile\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847578 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-wtmp\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847878 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-metrics-client-ca\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.847985 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.847929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.849655 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.849637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.850070 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.850048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e2c3183-c792-48e3-a4e1-ab24d5432b35-node-exporter-tls\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.855957 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.855931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8k9\" (UniqueName: \"kubernetes.io/projected/2e2c3183-c792-48e3-a4e1-ab24d5432b35-kube-api-access-rw8k9\") pod \"node-exporter-4l46z\" (UID: \"2e2c3183-c792-48e3-a4e1-ab24d5432b35\") " pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.859704 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.859682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:58:07.859804 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.859778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:58:07.861081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.861060    2578 patch_prober.go:28] interesting pod/console-8d869946-vlqnw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Jul 22 18:58:07.861179 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.861107    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8d869946-vlqnw" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused"
Jul 22 18:58:07.881924 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.881898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:07.908786 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.908763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4l46z"
Jul 22 18:58:07.954281 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:07.954260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:08.120450 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:08.120420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:08.343729 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:08.343650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:08.448155 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:08.448124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:08.551198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:08.551133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:08.645993 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:08.645959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:09.092698 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.092626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:09.507220 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.507176    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"]
Jul 22 18:58:09.628203 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.628162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"]
Jul 22 18:58:09.628609 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.628348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.631370 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631347    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 18:58:09.631514 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631414    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 18:58:09.631834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9iccckk2d8ga8\""
Jul 22 18:58:09.631834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 18:58:09.631834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 18:58:09.632041 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.631917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 18:58:09.632159 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.632145    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8t8sr\""
Jul 22 18:58:09.761986 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.761912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.761986 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.761947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-grpc-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.761988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.762050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.762087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.762155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl94c\" (UniqueName: \"kubernetes.io/projected/f39b968c-c8e5-424c-8cac-2a084c83e267-kube-api-access-nl94c\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762326 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.762174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39b968c-c8e5-424c-8cac-2a084c83e267-metrics-client-ca\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.762326 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.762192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863346 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863566 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-grpc-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863633 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863685 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863733 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863795 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl94c\" (UniqueName: \"kubernetes.io/projected/f39b968c-c8e5-424c-8cac-2a084c83e267-kube-api-access-nl94c\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.863795 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.863758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39b968c-c8e5-424c-8cac-2a084c83e267-metrics-client-ca\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.864561 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.864488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39b968c-c8e5-424c-8cac-2a084c83e267-metrics-client-ca\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.866410 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.866388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.867072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.867051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-grpc-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.867171 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.867150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.867234 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.867168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.867345 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.867326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.867483 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.867454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f39b968c-c8e5-424c-8cac-2a084c83e267-secret-thanos-querier-tls\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.872549 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.872526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl94c\" (UniqueName: \"kubernetes.io/projected/f39b968c-c8e5-424c-8cac-2a084c83e267-kube-api-access-nl94c\") pod \"thanos-querier-dc4f58bf6-cdwdg\" (UID: \"f39b968c-c8e5-424c-8cac-2a084c83e267\") " pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:09.941258 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:09.941234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:10.460372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:10.460345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:10.561237 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:10.561181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:10.661114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:10.661078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:11.131973 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:11.131935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:12.198039 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:58:12.198013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2c3183_c792_48e3_a4e1_ab24d5432b35.slice/crio-02b32dc311ccdcae79b8b23fc369cb9191d1a9d4445a97c1be4b8a5a2dd28fcc WatchSource:0}: Error finding container 02b32dc311ccdcae79b8b23fc369cb9191d1a9d4445a97c1be4b8a5a2dd28fcc: Status 404 returned error can't find the container with id 02b32dc311ccdcae79b8b23fc369cb9191d1a9d4445a97c1be4b8a5a2dd28fcc
Jul 22 18:58:12.272720 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.272656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:12.339698 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.339004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:12.341352 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.341312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:12.357926 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.357908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"]
Jul 22 18:58:12.412484 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.412466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:58:12.465104 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.465040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:12.510196 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:58:12.510171    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081eeb6e_42c0_4e1c_96e4_116ae65bb2a3.slice/crio-172abf359858f6cb7069ae4b7e4acf011151d23a11f9b0e8bc5c5cc6847ad556 WatchSource:0}: Error finding container 172abf359858f6cb7069ae4b7e4acf011151d23a11f9b0e8bc5c5cc6847ad556: Status 404 returned error can't find the container with id 172abf359858f6cb7069ae4b7e4acf011151d23a11f9b0e8bc5c5cc6847ad556
Jul 22 18:58:12.510922 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:58:12.510903    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39b968c_c8e5_424c_8cac_2a084c83e267.slice/crio-f123fb0254bf34eb85bde352c0600a32350921518f0dda6ea8286f36a7a2c758 WatchSource:0}: Error finding container f123fb0254bf34eb85bde352c0600a32350921518f0dda6ea8286f36a7a2c758: Status 404 returned error can't find the container with id f123fb0254bf34eb85bde352c0600a32350921518f0dda6ea8286f36a7a2c758
Jul 22 18:58:12.516500 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.516476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"f123fb0254bf34eb85bde352c0600a32350921518f0dda6ea8286f36a7a2c758"}
Jul 22 18:58:12.517737 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.517715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696b44bf7-8wgwb" event={"ID":"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3","Type":"ContainerStarted","Data":"172abf359858f6cb7069ae4b7e4acf011151d23a11f9b0e8bc5c5cc6847ad556"}
Jul 22 18:58:12.518937 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.518906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l46z" event={"ID":"2e2c3183-c792-48e3-a4e1-ab24d5432b35","Type":"ContainerStarted","Data":"02b32dc311ccdcae79b8b23fc369cb9191d1a9d4445a97c1be4b8a5a2dd28fcc"}
Jul 22 18:58:12.529008 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.528985    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:58:12.853167 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.853096    2578 patch_prober.go:28] interesting pod/image-registry-858fcbcd6c-pwcxm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 18:58:12.853167 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:12.853145    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm" podUID="8082043c-8176-472c-a9b5-2718e9a0add4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 18:58:13.534642 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.534602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6s4jg" event={"ID":"fe2cd89f-ad77-4285-9c13-5979e4bc1fbf","Type":"ContainerStarted","Data":"80c3a110aea2a11c3f4515808619398ab81e897e07d42156ed3fd04d7e76796d"}
Jul 22 18:58:13.540504 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.539852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696b44bf7-8wgwb" event={"ID":"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3","Type":"ContainerStarted","Data":"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"}
Jul 22 18:58:13.541779 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.541648    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:58:13.547819 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.547795    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6s4jg"
Jul 22 18:58:13.574816 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.574787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:13.590848 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.589809    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6s4jg" podStartSLOduration=2.443341123 podStartE2EDuration="21.58978865s" totalImagesPullingTime="19.146447527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:13.569905202 +0000 UTC m=+95.138249588" watchObservedRunningTime="2026-07-22 18:58:13.58978865 +0000 UTC m=+95.158133029"
Jul 22 18:58:13.619177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.617586    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-696b44bf7-8wgwb" podStartSLOduration=7.617564863 podStartE2EDuration="7.617564863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:13.591742711 +0000 UTC m=+95.160087084" watchObservedRunningTime="2026-07-22 18:58:13.617564863 +0000 UTC m=+95.185909234"
Jul 22 18:58:13.648358 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.648258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:13.863557 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.862493    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:58:13.883845 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.881849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:13.885513 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.885305    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbp8l\""
Jul 22 18:58:13.886017 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.885822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 18:58:13.886365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.886342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 18:58:13.886688 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.886614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 18:58:13.888924 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.886847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 18:58:13.889161 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.889142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 18:58:13.891437 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.889620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 18:58:13.891437 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.889750    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 18:58:13.891437 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.889831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 18:58:13.899473 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.898188    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 18:58:13.899473 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.898502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 18:58:13.900229 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.900138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 18:58:13.901350 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.900588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-alg1m63jqkn89\""
Jul 22 18:58:13.901350 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.900779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 18:58:13.901350 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.900977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 18:58:13.911413 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.909917    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 18:58:13.912255 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.912237    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 18:58:13.921242 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.920087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:58:13.922842 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:13.922819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:14.006458 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.006423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.006708 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.006693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.006846 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.006829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.006992 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.006976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ltt\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007377 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007611 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.007859 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.007748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.111407 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.108941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.108992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.111662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.111711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.111757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.114058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.115037 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.115037 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.112565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ltt\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.115037 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.113774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.115037 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.114295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.115037 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.114906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.117810 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.117786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.118737 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.118580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.118845 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.118796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.119562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.119423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.119562 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.119445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.121404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.120458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.121404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.120683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.121404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.120870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.121404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.121062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.121404 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.121367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.124960 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.124941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.127768 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.127743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.128385 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.128308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ltt\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.130093 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.130029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.130093 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.130053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.130450 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.130421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.132538 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.132514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.213448 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.209143    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:14.458695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.458583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:58:14.462947 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:58:14.462913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54888683_6e6b_49e5_aee9_f3c672ec852a.slice/crio-4da0d5ba9aaa31304562eca79e8abcd821ed4fa82e2072234b5b7c249d060643 WatchSource:0}: Error finding container 4da0d5ba9aaa31304562eca79e8abcd821ed4fa82e2072234b5b7c249d060643: Status 404 returned error can't find the container with id 4da0d5ba9aaa31304562eca79e8abcd821ed4fa82e2072234b5b7c249d060643
Jul 22 18:58:14.548162 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.548058    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e2c3183-c792-48e3-a4e1-ab24d5432b35" containerID="59bbb59d8f530ab5066e45b3c3ce4272eb127afc1aecbbba4e148f3977a310ef" exitCode=0
Jul 22 18:58:14.548755 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.548238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l46z" event={"ID":"2e2c3183-c792-48e3-a4e1-ab24d5432b35","Type":"ContainerDied","Data":"59bbb59d8f530ab5066e45b3c3ce4272eb127afc1aecbbba4e148f3977a310ef"}
Jul 22 18:58:14.550125 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:14.550030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"4da0d5ba9aaa31304562eca79e8abcd821ed4fa82e2072234b5b7c249d060643"}
Jul 22 18:58:15.556964 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:15.556921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l46z" event={"ID":"2e2c3183-c792-48e3-a4e1-ab24d5432b35","Type":"ContainerStarted","Data":"81ecc0a3da568cef4a39abd8b2c70b1ef00a0dc13cfe68e6b0f2b40b9e7e04ac"}
Jul 22 18:58:15.557431 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:15.557031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l46z" event={"ID":"2e2c3183-c792-48e3-a4e1-ab24d5432b35","Type":"ContainerStarted","Data":"5fb12ebe6a4aa080c685f01de4d1197a25582dfb8554e7a92a7dfb452aa5013a"}
Jul 22 18:58:15.579670 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:15.579611    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4l46z" podStartSLOduration=7.132132282 podStartE2EDuration="8.579591055s" totalImagesPullingTime="1.314035307s" totalInitContainerRuntime="133.423466ms" isStatefulPod=true podCreationTimestamp="2026-07-22 18:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:15.578541143 +0000 UTC m=+97.146885515" watchObservedRunningTime="2026-07-22 18:58:15.579591055 +0000 UTC m=+97.147935427"
Jul 22 18:58:16.434759 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.434721    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-858fcbcd6c-pwcxm"
Jul 22 18:58:16.508799 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.508543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:16.508799 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.508607    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:16.514081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.514054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:16.563474 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.563440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:16.564919 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.564888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"56c2414162d608dd2f8e33c8d0968eff3f0d43e3b6b7242e40c7ea812b34c1e1"}
Jul 22 18:58:16.565058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.564964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"3a2c787ae9b3f8429660bb6e1b29632ed535a6f569681412d6e1553984cbcf54"}
Jul 22 18:58:16.565058 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.565004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"6068172a0d8d9546b4a5be9b7f9e60761e02238489a6171bd5d32338a3bdda0e"}
Jul 22 18:58:16.569256 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.569231    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:16.664124 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.664071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:16.961921 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:16.961790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:17.016198 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.016173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:17.141367 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.141311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:17.242638 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.242566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:17.431095 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.431052    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerName="registry" containerID="cri-o://bc2ad06c2418f221f504534d108e39ea9d306a890afac9414ee8f43cec7d4396" gracePeriod=30
Jul 22 18:58:17.571572 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.571505    2578 generic.go:356] "Generic (PLEG): container finished" podID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerID="bc2ad06c2418f221f504534d108e39ea9d306a890afac9414ee8f43cec7d4396" exitCode=0
Jul 22 18:58:17.571970 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.571585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" event={"ID":"0245d755-46d1-4b88-83e3-2bb6ef446a57","Type":"ContainerDied","Data":"bc2ad06c2418f221f504534d108e39ea9d306a890afac9414ee8f43cec7d4396"}
Jul 22 18:58:17.573504 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.573479    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e" exitCode=0
Jul 22 18:58:17.573627 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.573567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"}
Jul 22 18:58:17.887382 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.887354    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:58:17.951958 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.951922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952055 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.951982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz76r\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952055 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952055 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952042    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952268 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952268 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952268 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952268 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca\") pod \"0245d755-46d1-4b88-83e3-2bb6ef446a57\" (UID: \"0245d755-46d1-4b88-83e3-2bb6ef446a57\") "
Jul 22 18:58:17.952919 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.952888    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:17.954815 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.954601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:17.954916 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.954804    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:58:17.955412 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.955383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:17.957430 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.957406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:58:17.959042 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.958992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r" (OuterVolumeSpecName: "kube-api-access-fz76r") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "kube-api-access-fz76r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:58:17.959373 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.959332    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:17.966329 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:17.966304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0245d755-46d1-4b88-83e3-2bb6ef446a57" (UID: "0245d755-46d1-4b88-83e3-2bb6ef446a57"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 18:58:18.048661 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.048631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:18.053075 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053046    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz76r\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-kube-api-access-fz76r\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053079    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-certificates\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053095    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-bound-sa-token\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053109    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0245d755-46d1-4b88-83e3-2bb6ef446a57-ca-trust-extracted\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053119    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0245d755-46d1-4b88-83e3-2bb6ef446a57-registry-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053127    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-installation-pull-secrets\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053134    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0245d755-46d1-4b88-83e3-2bb6ef446a57-trusted-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.053191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.053145    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0245d755-46d1-4b88-83e3-2bb6ef446a57-image-registry-private-configuration\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:18.150932 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.150897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:18.586498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.585358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"9d4acb1dca8f08a7fb9aa299acd34051a7713c56cceb1fe83d963ac8d1490ace"}
Jul 22 18:58:18.586498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.585449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"0da82dcb84866b74ddf0d3e386bb5b178996b88e9a471ac1391a21527e0308e6"}
Jul 22 18:58:18.586498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.585494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" event={"ID":"f39b968c-c8e5-424c-8cac-2a084c83e267","Type":"ContainerStarted","Data":"4adf5e7ea7d67b04a9dd72e4d2fa775db617aece95b56eccbe5a97d88481417d"}
Jul 22 18:58:18.588661 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.587071    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:18.589951 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.589923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx" event={"ID":"0245d755-46d1-4b88-83e3-2bb6ef446a57","Type":"ContainerDied","Data":"a4354ddc2c54558aeb922c1508b3bf402624c975dfdebc3435f50b62e786ca8d"}
Jul 22 18:58:18.590056 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.589977    2578 scope.go:117] "RemoveContainer" containerID="bc2ad06c2418f221f504534d108e39ea9d306a890afac9414ee8f43cec7d4396"
Jul 22 18:58:18.590153 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.590129    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d44687cdf-4dspx"
Jul 22 18:58:18.615784 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.614518    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg" podStartSLOduration=4.85638512 podStartE2EDuration="9.614498923s" totalImagesPullingTime="4.758113803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:58:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:18.61342149 +0000 UTC m=+100.181765862" watchObservedRunningTime="2026-07-22 18:58:18.614498923 +0000 UTC m=+100.182843295"
Jul 22 18:58:18.629025 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.629002    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:58:18.634534 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.634455    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d44687cdf-4dspx"]
Jul 22 18:58:18.921833 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:18.921797    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" path="/var/lib/kubelet/pods/0245d755-46d1-4b88-83e3-2bb6ef446a57/volumes"
Jul 22 18:58:20.608187 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:20.607973    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dc4f58bf6-cdwdg"
Jul 22 18:58:22.167192 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.167155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:22.260538 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.260272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:22.570528 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.570496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:22.616736 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"}
Jul 22 18:58:22.616847 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"}
Jul 22 18:58:22.616847 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"}
Jul 22 18:58:22.616847 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"}
Jul 22 18:58:22.616847 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"}
Jul 22 18:58:22.616847 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.616846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerStarted","Data":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"}
Jul 22 18:58:22.646968 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.646925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.018138619 podStartE2EDuration="9.646908702s" totalImagesPullingTime="6.599518208s" totalInitContainerRuntime="29.251875ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:58:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:58:22.644289691 +0000 UTC m=+104.212634062" watchObservedRunningTime="2026-07-22 18:58:22.646908702 +0000 UTC m=+104.215253072"
Jul 22 18:58:22.649328 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:22.649308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:24.210275 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:24.210239    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:58:26.431675 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:26.431647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ht2md"
Jul 22 18:58:27.115032 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:27.115002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:27.176290 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:27.176264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:30.248575 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:30.248546    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:30.364536 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:30.364504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:30.465831 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:30.465801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:30.566506 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:30.566440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:37.092892 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.092854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:37.223820 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.223791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:37.549922 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.549869    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8d869946-vlqnw" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerName="console" containerID="cri-o://aeb45b00b21b799ad1a60c51b158801d52dcd0b5d910b160ddbf342e880d533a" gracePeriod=15
Jul 22 18:58:37.685302 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.685276    2578 generic.go:356] "Generic (PLEG): container finished" podID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerID="aeb45b00b21b799ad1a60c51b158801d52dcd0b5d910b160ddbf342e880d533a" exitCode=0
Jul 22 18:58:37.685415 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.685349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d869946-vlqnw" event={"ID":"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7","Type":"ContainerDied","Data":"aeb45b00b21b799ad1a60c51b158801d52dcd0b5d910b160ddbf342e880d533a"}
Jul 22 18:58:37.842668 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.842646    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:58:37.911776 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.911896 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.911896 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.911896 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.912047 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqqtn\" (UniqueName: \"kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.912047 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.911926    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config\") pod \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\" (UID: \"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7\") "
Jul 22 18:58:37.912231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.912183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:37.912347 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.912313    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:37.912452 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.912364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config" (OuterVolumeSpecName: "console-config") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:37.914202 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.914179    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:37.914300 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.914200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:37.914300 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:37.914228    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn" (OuterVolumeSpecName: "kube-api-access-wqqtn") pod "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" (UID: "ba672a7a-5a9d-4562-91f5-e5d5a52e20a7"). InnerVolumeSpecName "kube-api-access-wqqtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:58:38.012996 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.012971    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.012996 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.012992    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-oauth-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.013114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.013002    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-oauth-serving-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.013114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.013010    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-serving-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.013114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.013018    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqqtn\" (UniqueName: \"kubernetes.io/projected/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-kube-api-access-wqqtn\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.013114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.013026    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7-console-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:38.690556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.690519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d869946-vlqnw" event={"ID":"ba672a7a-5a9d-4562-91f5-e5d5a52e20a7","Type":"ContainerDied","Data":"490bde4fe0b11911b773c952cc22f69bc2f7e3d0da4a14b0a6a76604e2e8229e"}
Jul 22 18:58:38.690556 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.690537    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d869946-vlqnw"
Jul 22 18:58:38.691034 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.690588    2578 scope.go:117] "RemoveContainer" containerID="aeb45b00b21b799ad1a60c51b158801d52dcd0b5d910b160ddbf342e880d533a"
Jul 22 18:58:38.710381 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.710360    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:58:38.714538 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.714516    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8d869946-vlqnw"]
Jul 22 18:58:38.919117 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:38.919094    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" path="/var/lib/kubelet/pods/ba672a7a-5a9d-4562-91f5-e5d5a52e20a7/volumes"
Jul 22 18:58:55.269469 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.269410    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-696b44bf7-8wgwb" podUID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" containerName="console" containerID="cri-o://ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384" gracePeriod=15
Jul 22 18:58:55.536525 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.536470    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:55.650946 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.650922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g98hf\" (UniqueName: \"kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651059 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.650954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651059 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.650974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651059 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.650995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651309 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651182    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle\") pod \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\" (UID: \"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3\") "
Jul 22 18:58:55.651522 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651495    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config" (OuterVolumeSpecName: "console-config") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:55.651738 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651526    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:55.651738 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651648    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:55.651738 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.651723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:58:55.653428 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.653408    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:55.653779 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.653763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf" (OuterVolumeSpecName: "kube-api-access-g98hf") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "kube-api-access-g98hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:58:55.653902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.653885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" (UID: "081eeb6e-42c0-4e1c-96e4-116ae65bb2a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:58:55.751984 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.751960    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g98hf\" (UniqueName: \"kubernetes.io/projected/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-kube-api-access-g98hf\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.751984 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.751981    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-serving-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.752163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.751991    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.752163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.752000    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.752163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.752007    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-console-oauth-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.752163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.752016    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-oauth-serving-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.752163 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.752024    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3-trusted-ca-bundle\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:58:55.756114 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.756086    2578 generic.go:356] "Generic (PLEG): container finished" podID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" containerID="ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384" exitCode=0
Jul 22 18:58:55.756231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.756146    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696b44bf7-8wgwb"
Jul 22 18:58:55.756231 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.756177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696b44bf7-8wgwb" event={"ID":"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3","Type":"ContainerDied","Data":"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"}
Jul 22 18:58:55.756304 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.756264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696b44bf7-8wgwb" event={"ID":"081eeb6e-42c0-4e1c-96e4-116ae65bb2a3","Type":"ContainerDied","Data":"172abf359858f6cb7069ae4b7e4acf011151d23a11f9b0e8bc5c5cc6847ad556"}
Jul 22 18:58:55.756304 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.756290    2578 scope.go:117] "RemoveContainer" containerID="ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"
Jul 22 18:58:55.764804 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.764789    2578 scope.go:117] "RemoveContainer" containerID="ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"
Jul 22 18:58:55.765056 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:58:55.765039    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384\": container with ID starting with ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384 not found: ID does not exist" containerID="ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"
Jul 22 18:58:55.765118 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.765062    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384"} err="failed to get container status \"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384\": rpc error: code = NotFound desc = could not find container \"ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384\": container with ID starting with ca9053c9ceb9f58a2591d87e86ced292f8c52607cb714dd5aa1d60f091536384 not found: ID does not exist"
Jul 22 18:58:55.777558 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.777533    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:55.781731 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:55.781709    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-696b44bf7-8wgwb"]
Jul 22 18:58:56.918904 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:56.918873    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" path="/var/lib/kubelet/pods/081eeb6e-42c0-4e1c-96e4-116ae65bb2a3/volumes"
Jul 22 18:58:57.061885 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:57.061840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:58:57.220684 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:58:57.220617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:14.209591 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:14.209541    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:14.231808 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:14.231777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:14.855276 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:14.855249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:23.624385 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:23.624349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:23.711950 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:23.711919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:32.185714 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.185634    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:32.186730 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186677    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="prometheus" containerID="cri-o://e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715" gracePeriod=600
Jul 22 18:59:32.186896 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186840    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="config-reloader" containerID="cri-o://3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c" gracePeriod=600
Jul 22 18:59:32.187024 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186755    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy" containerID="cri-o://199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887" gracePeriod=600
Jul 22 18:59:32.187024 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186782    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="thanos-sidecar" containerID="cri-o://15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d" gracePeriod=600
Jul 22 18:59:32.187024 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186810    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78" gracePeriod=600
Jul 22 18:59:32.187188 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.186832    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-web" containerID="cri-o://c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf" gracePeriod=600
Jul 22 18:59:32.429834 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.429807    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:32.612498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612481    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612506    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.612740 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612818    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.613131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.612844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.613729 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.613701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.614382 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.613832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 18:59:32.614382 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.614095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615576    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54ltt\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.615665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle\") pod \"54888683-6e6b-49e5-aee9-f3c672ec852a\" (UID: \"54888683-6e6b-49e5-aee9-f3c672ec852a\") "
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616042    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616063    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-db\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616078    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616093    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-metrics-client-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616104    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616114    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config" (OuterVolumeSpecName: "config") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.616664 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:59:32.617525 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616813    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.617525 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.616825    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.617525 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.617388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 18:59:32.617777 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.617753    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.618000 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.617970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.618974 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.618958    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.619072 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.619053    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt" (OuterVolumeSpecName: "kube-api-access-54ltt") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "kube-api-access-54ltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 18:59:32.619741 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.619722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out" (OuterVolumeSpecName: "config-out") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 18:59:32.627538 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.627520    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config" (OuterVolumeSpecName: "web-config") pod "54888683-6e6b-49e5-aee9-f3c672ec852a" (UID: "54888683-6e6b-49e5-aee9-f3c672ec852a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 18:59:32.716710 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716690    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54888683-6e6b-49e5-aee9-f3c672ec852a-config-out\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716710 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716710    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716721    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54ltt\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-kube-api-access-54ltt\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716730    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54888683-6e6b-49e5-aee9-f3c672ec852a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716738    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-grpc-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716746    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54888683-6e6b-49e5-aee9-f3c672ec852a-tls-assets\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716754    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716761    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-web-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716769    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716778    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716787    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716798    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-kube-rbac-proxy\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716806    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-config\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.716817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.716814    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54888683-6e6b-49e5-aee9-f3c672ec852a-secret-metrics-client-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 18:59:32.917655 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917625    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78" exitCode=0
Jul 22 18:59:32.917655 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917650    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887" exitCode=0
Jul 22 18:59:32.917655 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917659    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf" exitCode=0
Jul 22 18:59:32.917887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917666    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d" exitCode=0
Jul 22 18:59:32.917887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917671    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c" exitCode=0
Jul 22 18:59:32.917887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917677    2578 generic.go:356] "Generic (PLEG): container finished" podID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715" exitCode=0
Jul 22 18:59:32.917887 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.917769    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:32.922346 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"}
Jul 22 18:59:32.922453 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"}
Jul 22 18:59:32.922453 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"}
Jul 22 18:59:32.922569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"}
Jul 22 18:59:32.922569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922470    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.922569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"}
Jul 22 18:59:32.922569 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"}
Jul 22 18:59:32.922745 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.922602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54888683-6e6b-49e5-aee9-f3c672ec852a","Type":"ContainerDied","Data":"4da0d5ba9aaa31304562eca79e8abcd821ed4fa82e2072234b5b7c249d060643"}
Jul 22 18:59:32.931170 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.931153    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.940365 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.940349    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.945674 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.945654    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:32.947311 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.947295    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.953873 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.953849    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:32.954946 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.954929    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.961456 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.961441    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.968394 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.968379    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.974866 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.974849    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.975112 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.975094    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.975158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975120    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.975158 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975137    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.975390 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.975373    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.975433 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975396    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.975433 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975413    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.975653 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.975638    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.975699 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975656    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.975699 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975679    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.975910 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.975894    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.975948 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975914    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.975948 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.975930    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.976129 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.976114    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.976177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976132    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.976177 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976151    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.976480 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.976462    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.976547 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976480    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.976547 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976491    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.976716 ip-10-0-129-246 kubenswrapper[2578]: E0722 18:59:32.976700    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.976756 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976719    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.976756 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976732    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.976937 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976920    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.976986 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.976937    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.977126 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977110    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.977162 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977127    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.977328 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977311    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.977372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977328    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.977509 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977484    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.977551 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977511    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.977725 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977706    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.977764 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977727    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.977978 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977962    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.978022 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.977979    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.978222 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978187    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.978305 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978226    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.978490 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978473    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.978538 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978490    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.978714 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978700    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.978714 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978714    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.978908 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978889    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.978959 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.978930    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.979265 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.979196    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.979372 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.979266    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.979565 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.979533    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.979565 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.979559    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.980151 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.980258 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980154    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.980461 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980428    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.980461 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980446    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.980692 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980677    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.980742 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980692    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.980904 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980883    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.980978 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980906    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.981019 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.980990    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:32.981185 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981168    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.981246 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981185    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.981297 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981266    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="config-reloader"
Jul 22 18:59:32.981297 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981278    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="config-reloader"
Jul 22 18:59:32.981297 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981287    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="thanos-sidecar"
Jul 22 18:59:32.981297 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981293    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="thanos-sidecar"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981308    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-web"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981317    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-web"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981328    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" containerName="console"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981348    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" containerName="console"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981357    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="init-config-reloader"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981365    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="init-config-reloader"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981376    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="prometheus"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981382    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="prometheus"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981388    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerName="registry"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981395    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerName="registry"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981404    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerName="console"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981413    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerName="console"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981423    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-thanos"
Jul 22 18:59:32.981444 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981430    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-thanos"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981450    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981466    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981525    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981540    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="081eeb6e-42c0-4e1c-96e4-116ae65bb2a3" containerName="console"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981550    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba672a7a-5a9d-4562-91f5-e5d5a52e20a7" containerName="console"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981555    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="thanos-sidecar"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981562    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="prometheus"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981567    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="config-reloader"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981572    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-web"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981577    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981582    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" containerName="kube-rbac-proxy-thanos"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981588    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0245d755-46d1-4b88-83e3-2bb6ef446a57" containerName="registry"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981754    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.981853 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.981775    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.982330 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982016    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.982330 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982031    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.982330 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982268    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.982330 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982299    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.982544 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982516    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.982591 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982548    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.982772 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982752    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.982842 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.982785    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.983063 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983046    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.983131 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983065    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.983287 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.983333 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983288    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.983526 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983501    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.983629 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983527    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.983771 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983743    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.983771 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983762    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.983990 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983968    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.983990 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.983989    2578 scope.go:117] "RemoveContainer" containerID="c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"
Jul 22 18:59:32.984252 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984233    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78"} err="failed to get container status \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": rpc error: code = NotFound desc = could not find container \"c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78\": container with ID starting with c3928947fe87e40b264de4fa84b2bc9587f7ce17a7a8be3ad06cae3cbf085b78 not found: ID does not exist"
Jul 22 18:59:32.984301 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984252    2578 scope.go:117] "RemoveContainer" containerID="199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"
Jul 22 18:59:32.984494 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984469    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887"} err="failed to get container status \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": rpc error: code = NotFound desc = could not find container \"199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887\": container with ID starting with 199f79a1ecbc01d797e8045b5e8d696629b5120f267a8a6f2715508ecfd17887 not found: ID does not exist"
Jul 22 18:59:32.984494 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984486    2578 scope.go:117] "RemoveContainer" containerID="c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"
Jul 22 18:59:32.984695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984677    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf"} err="failed to get container status \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": rpc error: code = NotFound desc = could not find container \"c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf\": container with ID starting with c621656079773e7b800435eabe1fcadd576cd349d371d113bbbc03e61dbc95cf not found: ID does not exist"
Jul 22 18:59:32.984695 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984696    2578 scope.go:117] "RemoveContainer" containerID="15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"
Jul 22 18:59:32.984918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984896    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d"} err="failed to get container status \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": rpc error: code = NotFound desc = could not find container \"15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d\": container with ID starting with 15ce3b6da00ba7f989420f01866117092de9bd20da61ad01abc4da1d7309af6d not found: ID does not exist"
Jul 22 18:59:32.984918 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.984915    2578 scope.go:117] "RemoveContainer" containerID="3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"
Jul 22 18:59:32.985136 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985110    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c"} err="failed to get container status \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": rpc error: code = NotFound desc = could not find container \"3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c\": container with ID starting with 3a27cd5e93746fac71142bbd458b6f687d6efc6e1873e1e7c6bf08d6b31d583c not found: ID does not exist"
Jul 22 18:59:32.985136 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985132    2578 scope.go:117] "RemoveContainer" containerID="e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"
Jul 22 18:59:32.985412 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985391    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715"} err="failed to get container status \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": rpc error: code = NotFound desc = could not find container \"e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715\": container with ID starting with e853aa6f1a2e3b7f9ee484a78d4180bf1dbb1ae9f0153bb04216d8755a260715 not found: ID does not exist"
Jul 22 18:59:32.985412 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985413    2578 scope.go:117] "RemoveContainer" containerID="bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"
Jul 22 18:59:32.985573 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:32.985722 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.985698    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e"} err="failed to get container status \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": rpc error: code = NotFound desc = could not find container \"bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e\": container with ID starting with bb142d4715cb4eff42f215047b436631ab56d8d41a93510becb6a950a2d8ae9e not found: ID does not exist"
Jul 22 18:59:32.988167 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.988148    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 18:59:32.988280 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.988239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 18:59:32.988628 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.988613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 18:59:32.988711 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.988698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbp8l\""
Jul 22 18:59:32.988839 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.988825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 18:59:32.989081 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989067    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 18:59:32.989162 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989098    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 18:59:32.989238 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 18:59:32.989383 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989366    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-alg1m63jqkn89\""
Jul 22 18:59:32.989383 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 18:59:32.989531 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 18:59:32.989674 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 18:59:32.989765 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989699    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 18:59:32.989765 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.989718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 18:59:32.991599 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.991581    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 18:59:32.993487 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:32.993466    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 18:59:33.000838 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.000819    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 18:59:33.004274 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.004255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:33.120033 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120127 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config-out\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120127 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-web-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120127 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120369 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120369 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120369 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120369 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120541 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzchg\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-kube-api-access-bzchg\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.120727 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.120716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221304 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzchg\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-kube-api-access-bzchg\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.221754 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config-out\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-web-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.222001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.222028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.222493 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.222431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.223120 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.223095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.223191 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.221968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.225555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.224374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.225555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.224695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.225555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.225016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.225555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.225501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.225817 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.225593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226071 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226149 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226471 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226555 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226845 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config-out\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.226993 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.226967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.227548 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.227525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.228001 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.227969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.228087 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.228061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1753bfed-91f1-41c4-b951-77ff69fd7d7e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.228498 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.228477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-web-config\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.228581 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.228528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1753bfed-91f1-41c4-b951-77ff69fd7d7e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.233125 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.233093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzchg\" (UniqueName: \"kubernetes.io/projected/1753bfed-91f1-41c4-b951-77ff69fd7d7e-kube-api-access-bzchg\") pod \"prometheus-k8s-0\" (UID: \"1753bfed-91f1-41c4-b951-77ff69fd7d7e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.295503 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.295470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:33.428759 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.428729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 18:59:33.430461 ip-10-0-129-246 kubenswrapper[2578]: W0722 18:59:33.430438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1753bfed_91f1_41c4_b951_77ff69fd7d7e.slice/crio-24806ef8e89bb4cf12eab286804204ccec61cb9f7b926126cf554ff9b278bb2b WatchSource:0}: Error finding container 24806ef8e89bb4cf12eab286804204ccec61cb9f7b926126cf554ff9b278bb2b: Status 404 returned error can't find the container with id 24806ef8e89bb4cf12eab286804204ccec61cb9f7b926126cf554ff9b278bb2b
Jul 22 18:59:33.927227 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.927174    2578 generic.go:356] "Generic (PLEG): container finished" podID="1753bfed-91f1-41c4-b951-77ff69fd7d7e" containerID="cb3dd417c14b50c0ce7d2a29e51ac596d5fdc508d56300015f5d5632ac55b42c" exitCode=0
Jul 22 18:59:33.927374 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.927265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerDied","Data":"cb3dd417c14b50c0ce7d2a29e51ac596d5fdc508d56300015f5d5632ac55b42c"}
Jul 22 18:59:33.927374 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:33.927358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"24806ef8e89bb4cf12eab286804204ccec61cb9f7b926126cf554ff9b278bb2b"}
Jul 22 18:59:34.920557 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.920520    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54888683-6e6b-49e5-aee9-f3c672ec852a" path="/var/lib/kubelet/pods/54888683-6e6b-49e5-aee9-f3c672ec852a/volumes"
Jul 22 18:59:34.935902 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.935867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"da8477bfc6720d64ef51fe426d794d1bd9375791a5821455c09964a72b69b972"}
Jul 22 18:59:34.936077 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.935940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"ed7c5829f4be9fd3ada608462fe556b287e78284c527ae4c3aafb18625f80aee"}
Jul 22 18:59:34.936077 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.935984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"7adcb0637f96c549ba45fec7a7abd3a1d4c60df385c89b353227838b74c78d1e"}
Jul 22 18:59:34.936077 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.936014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"88423d0661a33813a6c12fa9da9f7721286159e7ce9138fd6ececa5b839732c0"}
Jul 22 18:59:34.936077 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.936043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"9dbdc183d68b87d4312694b08d26198834208852e128bd0d7f76003e539d054a"}
Jul 22 18:59:34.936234 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.936083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1753bfed-91f1-41c4-b951-77ff69fd7d7e","Type":"ContainerStarted","Data":"46c472bc4d5aed791ac876028cbfcad95c0ddcd5a6d275bc7d19f6cc909355f8"}
Jul 22 18:59:34.965039 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:34.964998    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9485173099999997 podStartE2EDuration="2.964984328s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.467018ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:59:34.96368005 +0000 UTC m=+176.532024420" watchObservedRunningTime="2026-07-22 18:59:34.964984328 +0000 UTC m=+176.533328699"
Jul 22 18:59:35.619461 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:35.619430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:35.674157 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:35.674135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:38.296490 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:38.296444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 18:59:43.925919 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:43.925887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:44.008524 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:44.008494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:52.087128 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:52.087086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:52.187625 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:52.187593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:54.734318 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:54.734281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:54.799621 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:54.799584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 18:59:54.867826 ip-10-0-129-246 kubenswrapper[2578]: I0722 18:59:54.867800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:00:33.295814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:00:33.295778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 19:00:33.313971 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:00:33.313944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 19:00:34.169714 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:00:34.169689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 19:00:39.242706 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:00:39.242673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:00:39.323869 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:00:39.323841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:06.345123 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:06.345041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:07.229931 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:07.229901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:11.190378 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:11.190341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:11.308804 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:11.308777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:11.420800 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:11.420773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:12.973977 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:12.973942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:13.034075 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:13.034043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:14.291052 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:14.291020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:14.711431 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:14.711347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:21.503537 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:21.503504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:22.604894 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:22.604861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:22.727973 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:22.727945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:23.861323 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:23.861237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:24.026715 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:24.026662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:31.679437 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:31.679404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:31.777817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:31.777790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:33.760841 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:33.760802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:38.838490 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:38.838457    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 19:01:46.091517 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.091478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:46.125249 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.125201    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"]
Jul 22 19:01:46.127314 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.127299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.130651 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.130628    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 19:01:46.131581 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.131564    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 19:01:46.131682 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.131641    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 19:01:46.131682 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.131660    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 19:01:46.131987 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.131973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s4dgc\""
Jul 22 19:01:46.135609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.135590    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 19:01:46.144888 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.144868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"]
Jul 22 19:01:46.168400 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.168377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqj96\" (UniqueName: \"kubernetes.io/projected/55742fef-6f94-476b-b3e7-423447a6119c-kube-api-access-dqj96\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.168503 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.168404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-metrics-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.168503 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.168444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55742fef-6f94-476b-b3e7-423447a6119c-manager-config\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.168608 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.168493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.269176 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.269151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqj96\" (UniqueName: \"kubernetes.io/projected/55742fef-6f94-476b-b3e7-423447a6119c-kube-api-access-dqj96\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.269296 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.269179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-metrics-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.269455 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.269441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55742fef-6f94-476b-b3e7-423447a6119c-manager-config\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.269522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.269476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.269967 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.269943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55742fef-6f94-476b-b3e7-423447a6119c-manager-config\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.271936 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.271908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-metrics-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.272094 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.272072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55742fef-6f94-476b-b3e7-423447a6119c-cert\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.279018 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.278990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqj96\" (UniqueName: \"kubernetes.io/projected/55742fef-6f94-476b-b3e7-423447a6119c-kube-api-access-dqj96\") pod \"lws-controller-manager-7dd84c44d8-5wnbg\" (UID: \"55742fef-6f94-476b-b3e7-423447a6119c\") " pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.436042 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.436020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:46.575719 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.575696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"]
Jul 22 19:01:46.577773 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:01:46.577749    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55742fef_6f94_476b_b3e7_423447a6119c.slice/crio-165adfb7fb8e214de1fe9ea375b90ce27702fa7e4709ab95c2651f165b6e2855 WatchSource:0}: Error finding container 165adfb7fb8e214de1fe9ea375b90ce27702fa7e4709ab95c2651f165b6e2855: Status 404 returned error can't find the container with id 165adfb7fb8e214de1fe9ea375b90ce27702fa7e4709ab95c2651f165b6e2855
Jul 22 19:01:46.579564 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:46.579549    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 19:01:47.424644 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:47.424598    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg" event={"ID":"55742fef-6f94-476b-b3e7-423447a6119c","Type":"ContainerStarted","Data":"165adfb7fb8e214de1fe9ea375b90ce27702fa7e4709ab95c2651f165b6e2855"}
Jul 22 19:01:49.433963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:49.433928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg" event={"ID":"55742fef-6f94-476b-b3e7-423447a6119c","Type":"ContainerStarted","Data":"f154e407fb0511a44c6382828e8e19ce4cb1f45c0b21734adeac3739844db549"}
Jul 22 19:01:49.434417 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:49.434015    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:01:49.453256 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:49.453196    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg" podStartSLOduration=1.020473613 podStartE2EDuration="3.453184395s" totalImagesPullingTime="2.432710782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:01:49.451406129 +0000 UTC m=+311.019750501" watchObservedRunningTime="2026-07-22 19:01:49.453184395 +0000 UTC m=+311.021528765"
Jul 22 19:01:50.222226 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.222176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:50.395021 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.394991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:50.831498 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.831449    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"]
Jul 22 19:01:50.834037 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.834021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:50.843260 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.843239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 19:01:50.844833 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.844816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 19:01:50.845424 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.845409    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 19:01:50.845492 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.845477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lzcck\""
Jul 22 19:01:50.846689 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.846676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 19:01:50.883821 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.883794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"]
Jul 22 19:01:50.907593 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.907568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26j78\" (UniqueName: \"kubernetes.io/projected/414c559a-c298-4016-a655-5b9747dfc997-kube-api-access-26j78\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:50.907697 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.907612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-tmp\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:50.907697 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.907663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:50.907839 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.907715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:50.907839 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:50.907751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-manifests\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.008804 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.008780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-manifests\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.008911 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.008813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26j78\" (UniqueName: \"kubernetes.io/projected/414c559a-c298-4016-a655-5b9747dfc997-kube-api-access-26j78\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.008911 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.008863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-tmp\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.009024 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.008912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.009186 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.009167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.009279 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.009245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-manifests\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.011285 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.011258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c559a-c298-4016-a655-5b9747dfc997-tmp\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.011536 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.011520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.011578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.011548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c559a-c298-4016-a655-5b9747dfc997-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.016504 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.016484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26j78\" (UniqueName: \"kubernetes.io/projected/414c559a-c298-4016-a655-5b9747dfc997-kube-api-access-26j78\") pod \"opendatahub-operator-controller-manager-cb586fcb5-rdsfb\" (UID: \"414c559a-c298-4016-a655-5b9747dfc997\") " pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.128181 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.128120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:51.144087 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.144064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:51.230072 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.230040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:51.292582 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.292556    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"]
Jul 22 19:01:51.295067 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:01:51.295036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414c559a_c298_4016_a655_5b9747dfc997.slice/crio-922e142a23357131e299ea863f83d8238133aace45281a77c4c58c7115263f41 WatchSource:0}: Error finding container 922e142a23357131e299ea863f83d8238133aace45281a77c4c58c7115263f41: Status 404 returned error can't find the container with id 922e142a23357131e299ea863f83d8238133aace45281a77c4c58c7115263f41
Jul 22 19:01:51.337796 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.337770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:51.415972 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.415947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:51.442062 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.442037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb" event={"ID":"414c559a-c298-4016-a655-5b9747dfc997","Type":"ContainerStarted","Data":"922e142a23357131e299ea863f83d8238133aace45281a77c4c58c7115263f41"}
Jul 22 19:01:51.521860 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:51.521837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:01:54.457278 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:54.457247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb" event={"ID":"414c559a-c298-4016-a655-5b9747dfc997","Type":"ContainerStarted","Data":"487f7d45c4b4563f15889af533f9192829da456ce475859e5f44895688f8efe4"}
Jul 22 19:01:55.462489 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:55.462459    2578 generic.go:356] "Generic (PLEG): container finished" podID="414c559a-c298-4016-a655-5b9747dfc997" containerID="487f7d45c4b4563f15889af533f9192829da456ce475859e5f44895688f8efe4" exitCode=0
Jul 22 19:01:55.462775 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:55.462496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb" event={"ID":"414c559a-c298-4016-a655-5b9747dfc997","Type":"ContainerDied","Data":"487f7d45c4b4563f15889af533f9192829da456ce475859e5f44895688f8efe4"}
Jul 22 19:01:56.468405 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:56.468372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb" event={"ID":"414c559a-c298-4016-a655-5b9747dfc997","Type":"ContainerStarted","Data":"2175767081cb64dd8941353af85d9e09c480091262bfd27a2578812bff8127b4"}
Jul 22 19:01:56.468811 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:56.468467    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:01:56.493002 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:01:56.492949    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb" podStartSLOduration=1.9349803780000001 podStartE2EDuration="6.492931389s" totalImagesPullingTime="3.533989682s" totalInitContainerRuntime="1.023961329s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:01:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:01:56.490932874 +0000 UTC m=+318.059277248" watchObservedRunningTime="2026-07-22 19:01:56.492931389 +0000 UTC m=+318.061275761"
Jul 22 19:02:00.440595 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:00.440565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dd84c44d8-5wnbg"
Jul 22 19:02:07.474231 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:07.474181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cb586fcb5-rdsfb"
Jul 22 19:02:07.800619 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:07.800551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:10.903815 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:10.903783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:11.118562 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:11.118531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:11.629676 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:11.629643    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:11.789248 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:11.789196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:12.021842 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:12.021804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:12.437075 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:12.437044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:12.939756 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:12.939728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:21.195626 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:21.195585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:21.313461 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:21.313406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:21.670413 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:21.670386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:21.851949 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:21.851916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:21.985692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:21.985618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:22.098170 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.098137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"]
Jul 22 19:02:22.106932 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.106913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.111826 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.111805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 19:02:22.111941 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.111829    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 19:02:22.112147 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.112122    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lxs7l\""
Jul 22 19:02:22.113381 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.113260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 19:02:22.114568 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.114553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 19:02:22.131960 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.127627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"]
Jul 22 19:02:22.139641 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.139619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:22.243361 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.243305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.243361 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.243333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tmp\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.243361 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.243354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tsl\" (UniqueName: \"kubernetes.io/projected/a8fe853c-20b7-44d4-94e6-7e61f69761c3-kube-api-access-95tsl\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.344328 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.344296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.344434 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.344332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tmp\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.344434 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.344361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tsl\" (UniqueName: \"kubernetes.io/projected/a8fe853c-20b7-44d4-94e6-7e61f69761c3-kube-api-access-95tsl\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.344548 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:02:22.344448    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 22 19:02:22.344548 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:02:22.344529    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs podName:a8fe853c-20b7-44d4-94e6-7e61f69761c3 nodeName:}" failed. No retries permitted until 2026-07-22 19:02:22.84450895 +0000 UTC m=+344.412853303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs") pod "kube-auth-proxy-69768f7b48-t6vk4" (UID: "a8fe853c-20b7-44d4-94e6-7e61f69761c3") : secret "kube-auth-proxy-tls" not found
Jul 22 19:02:22.346735 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.346715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tmp\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.354951 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.354930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tsl\" (UniqueName: \"kubernetes.io/projected/a8fe853c-20b7-44d4-94e6-7e61f69761c3-kube-api-access-95tsl\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.538533 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.538473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:22.847859 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.847794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:22.850617 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:22.850592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fe853c-20b7-44d4-94e6-7e61f69761c3-tls-certs\") pod \"kube-auth-proxy-69768f7b48-t6vk4\" (UID: \"a8fe853c-20b7-44d4-94e6-7e61f69761c3\") " pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:23.016320 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:23.016294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"
Jul 22 19:02:23.146973 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:23.146896    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4"]
Jul 22 19:02:23.149195 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:02:23.149166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fe853c_20b7_44d4_94e6_7e61f69761c3.slice/crio-6e69a08e336511a8e97d6d78dc579fc1265c28d0b1d2545749f72f5cae59ab72 WatchSource:0}: Error finding container 6e69a08e336511a8e97d6d78dc579fc1265c28d0b1d2545749f72f5cae59ab72: Status 404 returned error can't find the container with id 6e69a08e336511a8e97d6d78dc579fc1265c28d0b1d2545749f72f5cae59ab72
Jul 22 19:02:23.571252 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:23.571223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4" event={"ID":"a8fe853c-20b7-44d4-94e6-7e61f69761c3","Type":"ContainerStarted","Data":"6e69a08e336511a8e97d6d78dc579fc1265c28d0b1d2545749f72f5cae59ab72"}
Jul 22 19:02:24.453236 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:24.453190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:24.593291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:24.593257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:26.208074 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:26.208031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:26.585291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:26.585190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4" event={"ID":"a8fe853c-20b7-44d4-94e6-7e61f69761c3","Type":"ContainerStarted","Data":"bfd2d85208b34fbe9f65c5afc558ef4c69ddd1d9485287ab393f66307507752d"}
Jul 22 19:02:26.602920 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:26.602868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69768f7b48-t6vk4" podStartSLOduration=1.902736271 podStartE2EDuration="4.602851195s" totalImagesPullingTime="2.700114924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:02:26.602515771 +0000 UTC m=+348.170860143" watchObservedRunningTime="2026-07-22 19:02:26.602851195 +0000 UTC m=+348.171195566"
Jul 22 19:02:30.040585 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:30.040486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:30.152033 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:30.152003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:30.505949 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:30.505918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:30.790546 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:30.790448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:02:30.926121 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:02:30.926087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:10.645550 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:10.645506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:10.748843 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:10.748808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:12.264434 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:12.264378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:12.369345 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:12.369302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:12.463726 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:12.463694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:38.340272 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:38.340225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:38.402309 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:38.402279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:41.427568 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:41.427526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:45.014786 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:45.014754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:48.120381 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:48.120348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:49.124320 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:49.124289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:49.241425 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:49.241393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:49.345095 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:49.345067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:49.520571 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:49.520547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:50.405696 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:50.405669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:52.627324 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:52.627280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:53.000813 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:53.000755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:53.359296 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:53.359203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:53.482821 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:53.482792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:56.053896 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.053862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:56.323716 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.323640    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"]
Jul 22 19:03:56.325894 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.325874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.328332 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.328315    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 19:03:56.328514 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.328499    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 19:03:56.328578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.328556    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 19:03:56.328964 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.328945    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 19:03:56.331074 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.331049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7mkgk\""
Jul 22 19:03:56.335481 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.335458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:56.335568 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.335534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"]
Jul 22 19:03:56.435746 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.435726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.435849 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.435752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8d453f-0bac-4a43-bb68-de855528fa7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.435849 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.435771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8rg\" (UniqueName: \"kubernetes.io/projected/fb8d453f-0bac-4a43-bb68-de855528fa7d-kube-api-access-5p8rg\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.536711 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.536685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.536810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.536719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8d453f-0bac-4a43-bb68-de855528fa7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.536810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.536745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8rg\" (UniqueName: \"kubernetes.io/projected/fb8d453f-0bac-4a43-bb68-de855528fa7d-kube-api-access-5p8rg\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.536919 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:03:56.536837    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 19:03:56.536919 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:03:56.536904    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert podName:fb8d453f-0bac-4a43-bb68-de855528fa7d nodeName:}" failed. No retries permitted until 2026-07-22 19:03:57.036887933 +0000 UTC m=+438.605232281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sdq9z" (UID: "fb8d453f-0bac-4a43-bb68-de855528fa7d") : secret "plugin-serving-cert" not found
Jul 22 19:03:56.537328 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.537311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8d453f-0bac-4a43-bb68-de855528fa7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:56.545697 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:56.545673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8rg\" (UniqueName: \"kubernetes.io/projected/fb8d453f-0bac-4a43-bb68-de855528fa7d-kube-api-access-5p8rg\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:57.041136 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:57.041105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:57.041329 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:03:57.041291    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 19:03:57.041407 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:03:57.041363    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert podName:fb8d453f-0bac-4a43-bb68-de855528fa7d nodeName:}" failed. No retries permitted until 2026-07-22 19:03:58.041343131 +0000 UTC m=+439.609687496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sdq9z" (UID: "fb8d453f-0bac-4a43-bb68-de855528fa7d") : secret "plugin-serving-cert" not found
Jul 22 19:03:57.392633 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:57.392583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:57.497446 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:57.497404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:03:58.049139 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:58.049113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:58.051524 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:58.051501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8d453f-0bac-4a43-bb68-de855528fa7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sdq9z\" (UID: \"fb8d453f-0bac-4a43-bb68-de855528fa7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:58.152933 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:58.152910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"
Jul 22 19:03:58.287551 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:58.287519    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z"]
Jul 22 19:03:58.291390 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:03:58.291361    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb8d453f_0bac_4a43_bb68_de855528fa7d.slice/crio-84cc1f397e049e24a56df7844450b440dd9694782436cc0b365e0e404bbaf6c7 WatchSource:0}: Error finding container 84cc1f397e049e24a56df7844450b440dd9694782436cc0b365e0e404bbaf6c7: Status 404 returned error can't find the container with id 84cc1f397e049e24a56df7844450b440dd9694782436cc0b365e0e404bbaf6c7
Jul 22 19:03:58.985997 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:03:58.985963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z" event={"ID":"fb8d453f-0bac-4a43-bb68-de855528fa7d","Type":"ContainerStarted","Data":"84cc1f397e049e24a56df7844450b440dd9694782436cc0b365e0e404bbaf6c7"}
Jul 22 19:04:01.012451 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:01.012409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:01.077041 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:01.077003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:07.262914 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.262878    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"]
Jul 22 19:04:07.277141 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.277114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.280549 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.280452    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwjz4\""
Jul 22 19:04:07.281813 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.281793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"]
Jul 22 19:04:07.325458 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.325430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfszf\" (UniqueName: \"kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.325569 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.325469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.354138 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.354108    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"]
Jul 22 19:04:07.354450 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:07.354425    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mfszf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b"
Jul 22 19:04:07.371049 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.371018    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"]
Jul 22 19:04:07.385443 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.385240    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:04:07.389280 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.389259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.406022 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.405953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:04:07.427885 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.427853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.428029 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.427905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv46c\" (UniqueName: \"kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.428029 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.427959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.428166 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.428083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfszf\" (UniqueName: \"kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.428872 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.428791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:07.433739 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:07.433714    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mfszf for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" not found
Jul 22 19:04:07.433853 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:07.433804    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf podName:fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b nodeName:}" failed. No retries permitted until 2026-07-22 19:04:07.93378225 +0000 UTC m=+449.502126599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mfszf" (UniqueName: "kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf") pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" (UID: "fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" not found
Jul 22 19:04:07.529487 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.529400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv46c\" (UniqueName: \"kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.529487 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.529456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.529866 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.529838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.540267 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.540246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv46c\" (UniqueName: \"kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c\") pod \"kuadrant-operator-controller-manager-86878c769f-fm5rh\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:07.705611 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:07.705575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:08.027859 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.027828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.030626 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:08.030577    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.033355 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.033296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfszf\" (UniqueName: \"kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf\") pod \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.037109 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:08.037091    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mfszf for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" not found
Jul 22 19:04:08.037260 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:08.037160    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf podName:fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b nodeName:}" failed. No retries permitted until 2026-07-22 19:04:09.037144073 +0000 UTC m=+450.605488421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfszf" (UniqueName: "kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf") pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" (UID: "fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-kk9jq" not found
Jul 22 19:04:08.041081 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.041061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.043592 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:08.043559    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.133939 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.133914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume\") pod \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\" (UID: \"fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b\") "
Jul 22 19:04:08.134154 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.134129    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfszf\" (UniqueName: \"kubernetes.io/projected/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-kube-api-access-mfszf\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:04:08.134299 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.134230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" (UID: "fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:04:08.235562 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.235515    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b-extensions-socket-volume\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:04:08.433411 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.433350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:08.551456 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.551427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:08.918229 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:08.918164    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:08.920482 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:08.920452    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" path="/var/lib/kubelet/pods/fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b/volumes"
Jul 22 19:04:09.032348 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:09.032316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:09.037395 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:04:09.037361    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kk9jq\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="fd2695ee-4f35-4d0b-aab1-0c1e05a2d83b" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kk9jq"
Jul 22 19:04:13.205922 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:13.205881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:13.309146 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:13.309117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:15.813913 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:15.813884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:15.911902 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:15.911869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:19.158817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:19.158788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:04:19.171254 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:04:19.171223    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0aa034_1735_487e_ab23_b69eb61d8ec3.slice/crio-6da42fd738cf3b2f341a4e95eed9674ac72436aa9e497e72bcb971e6945c748d WatchSource:0}: Error finding container 6da42fd738cf3b2f341a4e95eed9674ac72436aa9e497e72bcb971e6945c748d: Status 404 returned error can't find the container with id 6da42fd738cf3b2f341a4e95eed9674ac72436aa9e497e72bcb971e6945c748d
Jul 22 19:04:19.292424 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:19.292360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:19.393687 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:19.393666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:20.087106 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:20.087069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" event={"ID":"8d0aa034-1735-487e-ab23-b69eb61d8ec3","Type":"ContainerStarted","Data":"6da42fd738cf3b2f341a4e95eed9674ac72436aa9e497e72bcb971e6945c748d"}
Jul 22 19:04:20.088607 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:20.088579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z" event={"ID":"fb8d453f-0bac-4a43-bb68-de855528fa7d","Type":"ContainerStarted","Data":"9a70fb6aeeb10e3d7e78375f62d8d85ed68de5fd55d55561692f97fc8c703705"}
Jul 22 19:04:20.110697 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:20.110532    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sdq9z" podStartSLOduration=3.296694727 podStartE2EDuration="24.110511891s" totalImagesPullingTime="20.813817164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:20.108821952 +0000 UTC m=+461.677166327" watchObservedRunningTime="2026-07-22 19:04:20.110511891 +0000 UTC m=+461.678856262"
Jul 22 19:04:22.019963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:22.019932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:22.117034 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:22.117008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:25.114970 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:25.114930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" event={"ID":"8d0aa034-1735-487e-ab23-b69eb61d8ec3","Type":"ContainerStarted","Data":"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"}
Jul 22 19:04:25.115439 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:25.115007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:25.136445 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:25.136390    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" podStartSLOduration=13.264527815 podStartE2EDuration="18.136374889s" totalImagesPullingTime="4.871847074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:25.134377895 +0000 UTC m=+466.702722267" watchObservedRunningTime="2026-07-22 19:04:25.136374889 +0000 UTC m=+466.704719260"
Jul 22 19:04:26.305468 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:26.305430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:26.407686 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:26.407657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:31.097868 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:31.097828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:31.280501 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:31.280465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:33.711254 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:33.711172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:33.812612 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:33.812575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:36.122222 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:36.122189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:04:37.321280 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:37.321251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:37.432352 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:37.432322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:42.396824 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:42.396784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:45.722512 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:45.722480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:45.820203 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:45.820165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:48.826035 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:48.826003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:48.892219 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:48.892185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:50.518016 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:50.517953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:50.618475 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:50.618446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:52.597677 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:52.597641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:52.866543 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:52.866468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:54.945529 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:54.945495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:55.069155 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.069120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:55.442333 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.442301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:55.760075 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.760003    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:04:55.821627 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.821602    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:04:55.821787 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.821690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:04:55.827002 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.826977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5bxpc\""
Jul 22 19:04:55.908473 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.908445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9p6\" (UniqueName: \"kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6\") pod \"authorino-58cd955675-7xsbm\" (UID: \"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c\") " pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:04:55.940736 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.940706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:04:55.944120 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.944102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:04:55.950669 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:55.950645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:04:56.009582 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.009561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9p6\" (UniqueName: \"kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6\") pod \"authorino-58cd955675-7xsbm\" (UID: \"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c\") " pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:04:56.018159 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.018110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9p6\" (UniqueName: \"kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6\") pod \"authorino-58cd955675-7xsbm\" (UID: \"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c\") " pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:04:56.081963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.081938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:56.109950 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.109925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnq8s\" (UniqueName: \"kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s\") pod \"authorino-75d556bd77-nvcm7\" (UID: \"1c4219c5-beaa-470a-bd90-2913c5cf6f01\") " pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:04:56.130726 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.130705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:04:56.182778 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.182748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:04:56.211046 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.211017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnq8s\" (UniqueName: \"kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s\") pod \"authorino-75d556bd77-nvcm7\" (UID: \"1c4219c5-beaa-470a-bd90-2913c5cf6f01\") " pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:04:56.226254 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.226229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnq8s\" (UniqueName: \"kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s\") pod \"authorino-75d556bd77-nvcm7\" (UID: \"1c4219c5-beaa-470a-bd90-2913c5cf6f01\") " pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:04:56.252922 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.252898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:04:56.265153 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.265119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:04:56.268274 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:04:56.268222    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fe9487a_1d6e_49ca_80c1_1bdac4bde98c.slice/crio-4e108b257845050ef83297b5d0c7a86862654f24b34d90e81c79f674fee84974 WatchSource:0}: Error finding container 4e108b257845050ef83297b5d0c7a86862654f24b34d90e81c79f674fee84974: Status 404 returned error can't find the container with id 4e108b257845050ef83297b5d0c7a86862654f24b34d90e81c79f674fee84974
Jul 22 19:04:56.387181 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:56.387152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:04:56.388945 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:04:56.388914    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c4219c5_beaa_470a_bd90_2913c5cf6f01.slice/crio-03976f7bf8850d85e14ebe78a17cab3cd41096364fe635080439645546e4550b WatchSource:0}: Error finding container 03976f7bf8850d85e14ebe78a17cab3cd41096364fe635080439645546e4550b: Status 404 returned error can't find the container with id 03976f7bf8850d85e14ebe78a17cab3cd41096364fe635080439645546e4550b
Jul 22 19:04:57.257696 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:57.257654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7xsbm" event={"ID":"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c","Type":"ContainerStarted","Data":"4e108b257845050ef83297b5d0c7a86862654f24b34d90e81c79f674fee84974"}
Jul 22 19:04:57.259461 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:04:57.259415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nvcm7" event={"ID":"1c4219c5-beaa-470a-bd90-2913c5cf6f01","Type":"ContainerStarted","Data":"03976f7bf8850d85e14ebe78a17cab3cd41096364fe635080439645546e4550b"}
Jul 22 19:05:00.279189 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:00.279155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7xsbm" event={"ID":"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c","Type":"ContainerStarted","Data":"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"}
Jul 22 19:05:00.280713 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:00.280686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nvcm7" event={"ID":"1c4219c5-beaa-470a-bd90-2913c5cf6f01","Type":"ContainerStarted","Data":"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"}
Jul 22 19:05:00.293626 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:00.293553    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7xsbm" podStartSLOduration=1.506537706 podStartE2EDuration="5.293538903s" totalImagesPullingTime="3.787001197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:00.292489466 +0000 UTC m=+501.860833837" watchObservedRunningTime="2026-07-22 19:05:00.293538903 +0000 UTC m=+501.861883274"
Jul 22 19:05:00.306498 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:00.306458    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nvcm7" podStartSLOduration=1.651920734 podStartE2EDuration="5.306448119s" totalImagesPullingTime="3.654527385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:00.305012619 +0000 UTC m=+501.873356994" watchObservedRunningTime="2026-07-22 19:05:00.306448119 +0000 UTC m=+501.874792490"
Jul 22 19:05:00.329934 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:00.329912    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:05:02.290320 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:02.290273    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7xsbm" podUID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" containerName="authorino" containerID="cri-o://6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be" gracePeriod=30
Jul 22 19:05:02.536446 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:02.536418    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:05:02.571653 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:02.571601    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x9p6\" (UniqueName: \"kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6\") pod \"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c\" (UID: \"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c\") "
Jul 22 19:05:02.573835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:02.573816    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6" (OuterVolumeSpecName: "kube-api-access-4x9p6") pod "9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" (UID: "9fe9487a-1d6e-49ca-80c1-1bdac4bde98c"). InnerVolumeSpecName "kube-api-access-4x9p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:05:02.672092 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:02.672068    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x9p6\" (UniqueName: \"kubernetes.io/projected/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c-kube-api-access-4x9p6\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:05:03.297037 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.296952    2578 generic.go:356] "Generic (PLEG): container finished" podID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" containerID="6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be" exitCode=0
Jul 22 19:05:03.297037 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.297019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7xsbm" event={"ID":"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c","Type":"ContainerDied","Data":"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"}
Jul 22 19:05:03.297037 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.297026    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7xsbm"
Jul 22 19:05:03.297586 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.297055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7xsbm" event={"ID":"9fe9487a-1d6e-49ca-80c1-1bdac4bde98c","Type":"ContainerDied","Data":"4e108b257845050ef83297b5d0c7a86862654f24b34d90e81c79f674fee84974"}
Jul 22 19:05:03.297586 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.297077    2578 scope.go:117] "RemoveContainer" containerID="6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"
Jul 22 19:05:03.306492 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.306469    2578 scope.go:117] "RemoveContainer" containerID="6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"
Jul 22 19:05:03.306817 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:05:03.306792    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be\": container with ID starting with 6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be not found: ID does not exist" containerID="6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"
Jul 22 19:05:03.306890 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.306827    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be"} err="failed to get container status \"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be\": rpc error: code = NotFound desc = could not find container \"6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be\": container with ID starting with 6855087f9f6f4268db5e6fe27fc4999b5966f36e8297a177e05413c3710ba4be not found: ID does not exist"
Jul 22 19:05:03.313032 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.313005    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:05:03.321808 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:03.321779    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7xsbm"]
Jul 22 19:05:04.919714 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:04.919676    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" path="/var/lib/kubelet/pods/9fe9487a-1d6e-49ca-80c1-1bdac4bde98c/volumes"
Jul 22 19:05:08.106834 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:08.106796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:08.164586 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:08.164551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:10.790404 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:10.790374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:10.894569 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:10.894538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:11.335299 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:11.335273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:16.369744 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:16.369708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:23.739146 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.739105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:23.963817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.963787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:23.964173 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.964155    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" containerName="authorino"
Jul 22 19:05:23.964287 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.964176    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" containerName="authorino"
Jul 22 19:05:23.964346 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.964311    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe9487a-1d6e-49ca-80c1-1bdac4bde98c" containerName="authorino"
Jul 22 19:05:23.966862 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.966841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:23.975170 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:23.975142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:24.027886 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.027823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwml\" (UniqueName: \"kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml\") pod \"authorino-5d4b67c446-xj24h\" (UID: \"120380a2-9d9c-4a1b-822d-a817542b5379\") " pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:24.128213 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.128192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwml\" (UniqueName: \"kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml\") pod \"authorino-5d4b67c446-xj24h\" (UID: \"120380a2-9d9c-4a1b-822d-a817542b5379\") " pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:24.136579 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.136555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwml\" (UniqueName: \"kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml\") pod \"authorino-5d4b67c446-xj24h\" (UID: \"120380a2-9d9c-4a1b-822d-a817542b5379\") " pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:24.190742 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.190720    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:24.190928 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.190916    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:24.315442 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.315420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:24.317572 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:05:24.317546    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod120380a2_9d9c_4a1b_822d_a817542b5379.slice/crio-68e1b27ec51cc06f1c0bb1ad85e36937fed14adf960ed773822233f778337b7c WatchSource:0}: Error finding container 68e1b27ec51cc06f1c0bb1ad85e36937fed14adf960ed773822233f778337b7c: Status 404 returned error can't find the container with id 68e1b27ec51cc06f1c0bb1ad85e36937fed14adf960ed773822233f778337b7c
Jul 22 19:05:24.387986 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.387956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:24.388257 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:24.388233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xj24h" event={"ID":"120380a2-9d9c-4a1b-822d-a817542b5379","Type":"ContainerStarted","Data":"68e1b27ec51cc06f1c0bb1ad85e36937fed14adf960ed773822233f778337b7c"}
Jul 22 19:05:25.394600 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.394556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xj24h" event={"ID":"120380a2-9d9c-4a1b-822d-a817542b5379","Type":"ContainerStarted","Data":"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"}
Jul 22 19:05:25.395004 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.394682    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xj24h" podUID="120380a2-9d9c-4a1b-822d-a817542b5379" containerName="authorino" containerID="cri-o://55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc" gracePeriod=30
Jul 22 19:05:25.409483 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.409328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xj24h" podStartSLOduration=1.981621801 podStartE2EDuration="2.409311048s" totalImagesPullingTime="427.689247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:25.409089117 +0000 UTC m=+526.977433488" watchObservedRunningTime="2026-07-22 19:05:25.409311048 +0000 UTC m=+526.977655419"
Jul 22 19:05:25.653658 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.653605    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:25.740565 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.740541    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grwml\" (UniqueName: \"kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml\") pod \"120380a2-9d9c-4a1b-822d-a817542b5379\" (UID: \"120380a2-9d9c-4a1b-822d-a817542b5379\") "
Jul 22 19:05:25.742627 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.742594    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml" (OuterVolumeSpecName: "kube-api-access-grwml") pod "120380a2-9d9c-4a1b-822d-a817542b5379" (UID: "120380a2-9d9c-4a1b-822d-a817542b5379"). InnerVolumeSpecName "kube-api-access-grwml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:05:25.841414 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:25.841391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwml\" (UniqueName: \"kubernetes.io/projected/120380a2-9d9c-4a1b-822d-a817542b5379-kube-api-access-grwml\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:05:26.400410 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.400379    2578 generic.go:356] "Generic (PLEG): container finished" podID="120380a2-9d9c-4a1b-822d-a817542b5379" containerID="55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc" exitCode=0
Jul 22 19:05:26.400819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.400416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xj24h" event={"ID":"120380a2-9d9c-4a1b-822d-a817542b5379","Type":"ContainerDied","Data":"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"}
Jul 22 19:05:26.400819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.400424    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xj24h"
Jul 22 19:05:26.400819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.400444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xj24h" event={"ID":"120380a2-9d9c-4a1b-822d-a817542b5379","Type":"ContainerDied","Data":"68e1b27ec51cc06f1c0bb1ad85e36937fed14adf960ed773822233f778337b7c"}
Jul 22 19:05:26.400819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.400461    2578 scope.go:117] "RemoveContainer" containerID="55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"
Jul 22 19:05:26.409190 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.409169    2578 scope.go:117] "RemoveContainer" containerID="55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"
Jul 22 19:05:26.409476 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:05:26.409455    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc\": container with ID starting with 55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc not found: ID does not exist" containerID="55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"
Jul 22 19:05:26.409532 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.409486    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc"} err="failed to get container status \"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc\": rpc error: code = NotFound desc = could not find container \"55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc\": container with ID starting with 55358487541f9073bee00b0656e807bf48c7532af0addf4a482cd36d41ac4fbc not found: ID does not exist"
Jul 22 19:05:26.420960 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.420936    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:26.425246 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.425227    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xj24h"]
Jul 22 19:05:26.920100 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:26.920060    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120380a2-9d9c-4a1b-822d-a817542b5379" path="/var/lib/kubelet/pods/120380a2-9d9c-4a1b-822d-a817542b5379/volumes"
Jul 22 19:05:28.897597 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:28.897559    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:05:28.897984 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:28.897752    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nvcm7" podUID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" containerName="authorino" containerID="cri-o://c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb" gracePeriod=30
Jul 22 19:05:29.140800 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.140776    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:05:29.270077 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.270007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnq8s\" (UniqueName: \"kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s\") pod \"1c4219c5-beaa-470a-bd90-2913c5cf6f01\" (UID: \"1c4219c5-beaa-470a-bd90-2913c5cf6f01\") "
Jul 22 19:05:29.272047 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.272024    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s" (OuterVolumeSpecName: "kube-api-access-jnq8s") pod "1c4219c5-beaa-470a-bd90-2913c5cf6f01" (UID: "1c4219c5-beaa-470a-bd90-2913c5cf6f01"). InnerVolumeSpecName "kube-api-access-jnq8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:05:29.370674 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.370650    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnq8s\" (UniqueName: \"kubernetes.io/projected/1c4219c5-beaa-470a-bd90-2913c5cf6f01-kube-api-access-jnq8s\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:05:29.414711 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.414649    2578 generic.go:356] "Generic (PLEG): container finished" podID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" containerID="c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb" exitCode=0
Jul 22 19:05:29.414711 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.414688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nvcm7"
Jul 22 19:05:29.414825 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.414685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nvcm7" event={"ID":"1c4219c5-beaa-470a-bd90-2913c5cf6f01","Type":"ContainerDied","Data":"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"}
Jul 22 19:05:29.414864 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.414830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nvcm7" event={"ID":"1c4219c5-beaa-470a-bd90-2913c5cf6f01","Type":"ContainerDied","Data":"03976f7bf8850d85e14ebe78a17cab3cd41096364fe635080439645546e4550b"}
Jul 22 19:05:29.414864 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.414848    2578 scope.go:117] "RemoveContainer" containerID="c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"
Jul 22 19:05:29.425803 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.424579    2578 scope.go:117] "RemoveContainer" containerID="c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"
Jul 22 19:05:29.425803 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:05:29.424918    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb\": container with ID starting with c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb not found: ID does not exist" containerID="c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"
Jul 22 19:05:29.425803 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.424949    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb"} err="failed to get container status \"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb\": rpc error: code = NotFound desc = could not find container \"c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb\": container with ID starting with c466c21a86dbd49d1b92a26495c42aae3d660573d84976eb8ca7a3113ab11bbb not found: ID does not exist"
Jul 22 19:05:29.438764 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.438743    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:05:29.442292 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:29.442272    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nvcm7"]
Jul 22 19:05:30.919802 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:30.919749    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" path="/var/lib/kubelet/pods/1c4219c5-beaa-470a-bd90-2913c5cf6f01/volumes"
Jul 22 19:05:33.486508 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:33.486472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:33.653452 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:33.653399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:33.749435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:33.749336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:33.823768 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:33.823698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:36.985933 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:36.985887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:05:37.084914 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:05:37.084881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:09.682696 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:09.682641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:09.781366 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:09.781341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:10.185899 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.185875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:10.316636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.316609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:10.708885 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.708853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:10.819959 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.819932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:10.967668 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967601    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-524m4"]
Jul 22 19:06:10.967902 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967890    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" containerName="authorino"
Jul 22 19:06:10.967943 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967904    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" containerName="authorino"
Jul 22 19:06:10.967943 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967917    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120380a2-9d9c-4a1b-822d-a817542b5379" containerName="authorino"
Jul 22 19:06:10.967943 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967923    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="120380a2-9d9c-4a1b-822d-a817542b5379" containerName="authorino"
Jul 22 19:06:10.968038 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967980    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="120380a2-9d9c-4a1b-822d-a817542b5379" containerName="authorino"
Jul 22 19:06:10.968038 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.967992    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4219c5-beaa-470a-bd90-2913c5cf6f01" containerName="authorino"
Jul 22 19:06:10.969892 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.969876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:10.972139 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.972112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 19:06:10.972292 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.972170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hsqpg\""
Jul 22 19:06:10.981274 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:10.981253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-524m4"]
Jul 22 19:06:11.080773 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.080746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmtn\" (UniqueName: \"kubernetes.io/projected/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-kube-api-access-hsmtn\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.080907 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.080790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.181296 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.181267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmtn\" (UniqueName: \"kubernetes.io/projected/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-kube-api-access-hsmtn\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.181407 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.181312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.181914 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.181897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.189145 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.189117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmtn\" (UniqueName: \"kubernetes.io/projected/8ed29aed-8dce-4c0e-9442-425f6d45ea6c-kube-api-access-hsmtn\") pod \"payload-processing-5bf47cd988-524m4\" (UID: \"8ed29aed-8dce-4c0e-9442-425f6d45ea6c\") " pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.280186 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.280116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:11.411465 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.411438    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-524m4"]
Jul 22 19:06:11.414253 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:06:11.414228    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed29aed_8dce_4c0e_9442_425f6d45ea6c.slice/crio-b9aef884c793e7b322d7b208d1ef21eb57ec49ef112a3c3d1e286af9f700f68b WatchSource:0}: Error finding container b9aef884c793e7b322d7b208d1ef21eb57ec49ef112a3c3d1e286af9f700f68b: Status 404 returned error can't find the container with id b9aef884c793e7b322d7b208d1ef21eb57ec49ef112a3c3d1e286af9f700f68b
Jul 22 19:06:11.597073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:11.596996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-524m4" event={"ID":"8ed29aed-8dce-4c0e-9442-425f6d45ea6c","Type":"ContainerStarted","Data":"b9aef884c793e7b322d7b208d1ef21eb57ec49ef112a3c3d1e286af9f700f68b"}
Jul 22 19:06:13.607293 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:13.607257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-524m4" event={"ID":"8ed29aed-8dce-4c0e-9442-425f6d45ea6c","Type":"ContainerStarted","Data":"459f676d9687a292109839743cf5a7d97223b438ecd7575c48da35e5e44dafeb"}
Jul 22 19:06:13.607685 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:13.607351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:13.625530 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:13.625486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-524m4" podStartSLOduration=1.637110384 podStartE2EDuration="3.625472739s" totalImagesPullingTime="1.988362355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:06:13.624811814 +0000 UTC m=+575.193156186" watchObservedRunningTime="2026-07-22 19:06:13.625472739 +0000 UTC m=+575.193817110"
Jul 22 19:06:20.719878 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:20.719843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:21.094488 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:21.094360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:24.615450 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:24.615413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-524m4"
Jul 22 19:06:29.490454 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:29.490410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:45.227041 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:45.227005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:46.530113 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:46.530022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:46.584874 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:46.584843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:48.646352 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.646319    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"]
Jul 22 19:06:48.649534 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.649514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.652748 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.652725    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 19:06:48.652854 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.652725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qbfdn\""
Jul 22 19:06:48.652854 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.652830    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 19:06:48.652963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.652728    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 19:06:48.659123 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.659099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"]
Jul 22 19:06:48.671059 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.671031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:06:48.769274 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.769378 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vlm\" (UniqueName: \"kubernetes.io/projected/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-kube-api-access-z4vlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.769378 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.769452 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.769452 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.769452 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.769442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870117 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vlm\" (UniqueName: \"kubernetes.io/projected/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-kube-api-access-z4vlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870601 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870659 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.870703 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.870669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.872636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.872621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.872872 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.872856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.878356 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.878338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vlm\" (UniqueName: \"kubernetes.io/projected/2df1cd02-73c7-4e69-a26d-5eb1c5880cc5-kube-api-access-z4vlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4v6r\" (UID: \"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:48.960765 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:48.960709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:49.093700 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:49.093680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"]
Jul 22 19:06:49.096004 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:06:49.095974    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df1cd02_73c7_4e69_a26d_5eb1c5880cc5.slice/crio-025ef28b1464a6a42caffb07e4a2598363bac39c8d5b756a32696b64e0f5fe3f WatchSource:0}: Error finding container 025ef28b1464a6a42caffb07e4a2598363bac39c8d5b756a32696b64e0f5fe3f: Status 404 returned error can't find the container with id 025ef28b1464a6a42caffb07e4a2598363bac39c8d5b756a32696b64e0f5fe3f
Jul 22 19:06:49.097385 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:49.097365    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 19:06:49.766444 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:49.766407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r" event={"ID":"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5","Type":"ContainerStarted","Data":"025ef28b1464a6a42caffb07e4a2598363bac39c8d5b756a32696b64e0f5fe3f"}
Jul 22 19:06:50.772369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:50.772333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r" event={"ID":"2df1cd02-73c7-4e69-a26d-5eb1c5880cc5","Type":"ContainerStarted","Data":"044ee64ad6a8f02481dd5e913b39c54d40039b2196dbc3b5ebe3ac089e2caf6a"}
Jul 22 19:06:50.791064 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:50.791013    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r" podStartSLOduration=1.775600527 podStartE2EDuration="2.79099825s" totalImagesPullingTime="1.015397723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:06:50.789054145 +0000 UTC m=+612.357398516" watchObservedRunningTime="2026-07-22 19:06:50.79099825 +0000 UTC m=+612.359342620"
Jul 22 19:06:58.961150 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:58.961113    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:58.961676 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:58.961178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:58.973552 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:58.973513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:06:59.822303 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:06:59.822273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4v6r"
Jul 22 19:07:01.580054 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:01.580027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:13.635099 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.635063    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"]
Jul 22 19:07:13.639448 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.639421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.641851 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.641832    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 19:07:13.649854 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.649820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"]
Jul 22 19:07:13.679766 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.679739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:13.763040 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.763143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.763143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zs8\" (UniqueName: \"kubernetes.io/projected/e78062a6-aefc-46cc-98d7-0f1a8124a23a-kube-api-access-h9zs8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.763259 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.763259 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.763259 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.763255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864093 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864093 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864291 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zs8\" (UniqueName: \"kubernetes.io/projected/e78062a6-aefc-46cc-98d7-0f1a8124a23a-kube-api-access-h9zs8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864616 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864716 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.864716 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.864659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.867058 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.867035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78062a6-aefc-46cc-98d7-0f1a8124a23a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.867220 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.867188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78062a6-aefc-46cc-98d7-0f1a8124a23a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.873187 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.873167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zs8\" (UniqueName: \"kubernetes.io/projected/e78062a6-aefc-46cc-98d7-0f1a8124a23a-kube-api-access-h9zs8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h5k8j\" (UID: \"e78062a6-aefc-46cc-98d7-0f1a8124a23a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:13.952308 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:13.952252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:14.081302 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:14.081277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"]
Jul 22 19:07:14.083012 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:07:14.082985    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78062a6_aefc_46cc_98d7_0f1a8124a23a.slice/crio-f78b06ebe8dacd15a23ba2d76fe7ea1921361f17f4ca1cb6f5b65724376696e3 WatchSource:0}: Error finding container f78b06ebe8dacd15a23ba2d76fe7ea1921361f17f4ca1cb6f5b65724376696e3: Status 404 returned error can't find the container with id f78b06ebe8dacd15a23ba2d76fe7ea1921361f17f4ca1cb6f5b65724376696e3
Jul 22 19:07:14.878270 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:14.878230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j" event={"ID":"e78062a6-aefc-46cc-98d7-0f1a8124a23a","Type":"ContainerStarted","Data":"9bdbbe753e5d2a5a269a1680f95190a613f163e2fe92b8c97dfbcd1fd084fc94"}
Jul 22 19:07:14.878713 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:14.878301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j" event={"ID":"e78062a6-aefc-46cc-98d7-0f1a8124a23a","Type":"ContainerStarted","Data":"f78b06ebe8dacd15a23ba2d76fe7ea1921361f17f4ca1cb6f5b65724376696e3"}
Jul 22 19:07:14.900192 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:14.900145    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j" podStartSLOduration=1.716585334 podStartE2EDuration="1.900130934s" totalImagesPullingTime="183.5456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:07:14.898198858 +0000 UTC m=+636.466543228" watchObservedRunningTime="2026-07-22 19:07:14.900130934 +0000 UTC m=+636.468475284"
Jul 22 19:07:21.846031 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.845999    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"]
Jul 22 19:07:21.852042 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.852020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.854495 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.854477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 19:07:21.859965 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.859712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"]
Jul 22 19:07:21.926403 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.926522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.926522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.926522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5xb6\" (UniqueName: \"kubernetes.io/projected/d0622e10-7f89-447b-86be-0ce64b8e1c2e-kube-api-access-t5xb6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.926627 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:21.926627 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:21.926561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027130 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027130 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027298 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027298 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027298 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027298 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5xb6\" (UniqueName: \"kubernetes.io/projected/d0622e10-7f89-447b-86be-0ce64b8e1c2e-kube-api-access-t5xb6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027647 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027724 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.027724 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.027681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.029631 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.029614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0622e10-7f89-447b-86be-0ce64b8e1c2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.029910 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.029890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0622e10-7f89-447b-86be-0ce64b8e1c2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.035957 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.035937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5xb6\" (UniqueName: \"kubernetes.io/projected/d0622e10-7f89-447b-86be-0ce64b8e1c2e-kube-api-access-t5xb6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb\" (UID: \"d0622e10-7f89-447b-86be-0ce64b8e1c2e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.162983 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.162959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:22.193700 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.193676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:22.302145 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.302117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"]
Jul 22 19:07:22.303659 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:07:22.303637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0622e10_7f89_447b_86be_0ce64b8e1c2e.slice/crio-866852aed3ae662d5453ffa6ae1e9ee66afefc14442b49d6803eb4e994889fcd WatchSource:0}: Error finding container 866852aed3ae662d5453ffa6ae1e9ee66afefc14442b49d6803eb4e994889fcd: Status 404 returned error can't find the container with id 866852aed3ae662d5453ffa6ae1e9ee66afefc14442b49d6803eb4e994889fcd
Jul 22 19:07:22.920091 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.920058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb" event={"ID":"d0622e10-7f89-447b-86be-0ce64b8e1c2e","Type":"ContainerStarted","Data":"acef5124814542503158f088c9dea920ba5e09865e4b670e3763051310284a00"}
Jul 22 19:07:22.920465 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.920102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb" event={"ID":"d0622e10-7f89-447b-86be-0ce64b8e1c2e","Type":"ContainerStarted","Data":"866852aed3ae662d5453ffa6ae1e9ee66afefc14442b49d6803eb4e994889fcd"}
Jul 22 19:07:22.935376 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:22.935336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb" podStartSLOduration=1.7568768289999999 podStartE2EDuration="1.935320817s" totalImagesPullingTime="178.443988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:07:22.933651536 +0000 UTC m=+644.501995910" watchObservedRunningTime="2026-07-22 19:07:22.935320817 +0000 UTC m=+644.503665188"
Jul 22 19:07:23.953095 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:23.953053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:23.953569 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:23.953143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:23.965835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:23.965813    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:24.936331 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:24.936305    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h5k8j"
Jul 22 19:07:32.163689 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:32.163654    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:32.164063 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:32.163704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:32.180282 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:32.180258    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:32.967438 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:32.967413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb"
Jul 22 19:07:46.904331 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:46.904294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:46.959270 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:46.959236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:53.383724 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:53.383678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:07:53.437771 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:07:53.437742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:08:16.274447 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:08:16.274414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:08:16.362195 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:08:16.362167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:08:17.449732 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:08:17.449694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:08:17.549258 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:08:17.549227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:09:07.287601 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:09:07.287563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:09:07.343482 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:09:07.343443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:10:23.649562 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:10:23.649528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:10:24.927930 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:10:24.927890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:03.541592 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:03.541552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:03.637312 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:03.637281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:03.743230 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:03.743185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:09.493056 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:09.493023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:09.557561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:09.557536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:09.649158 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:09.649127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:09.749033 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:09.748970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:09.849275 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:09.849245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:16.875086 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:16.875046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:16.976372 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:16.976342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:19.730534 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:19.730500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:47.965395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:47.965353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:11:48.096491 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:11:48.096465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:12:47.863130 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:12:47.863089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:12:49.662165 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:12:49.662128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:13:31.036955 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:13:31.036837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:13:31.108436 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:13:31.108394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:13:39.792338 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:13:39.792295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:15:11.453052 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:11.453006    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:15:11.453624 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:11.453268    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" podUID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" containerName="manager" containerID="cri-o://e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6" gracePeriod=10
Jul 22 19:15:15.312771 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.312740    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:15:15.467829 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.467794    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv46c\" (UniqueName: \"kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c\") pod \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") "
Jul 22 19:15:15.468010 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.467970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume\") pod \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\" (UID: \"8d0aa034-1735-487e-ab23-b69eb61d8ec3\") "
Jul 22 19:15:15.468394 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.468371    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d0aa034-1735-487e-ab23-b69eb61d8ec3" (UID: "8d0aa034-1735-487e-ab23-b69eb61d8ec3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:15:15.470190 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.470159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c" (OuterVolumeSpecName: "kube-api-access-fv46c") pod "8d0aa034-1735-487e-ab23-b69eb61d8ec3" (UID: "8d0aa034-1735-487e-ab23-b69eb61d8ec3"). InnerVolumeSpecName "kube-api-access-fv46c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:15:15.568906 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.568862    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d0aa034-1735-487e-ab23-b69eb61d8ec3-extensions-socket-volume\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:15:15.568906 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:15.568896    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv46c\" (UniqueName: \"kubernetes.io/projected/8d0aa034-1735-487e-ab23-b69eb61d8ec3-kube-api-access-fv46c\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:15:16.071553 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.071496    2578 generic.go:356] "Generic (PLEG): container finished" podID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" containerID="e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6" exitCode=0
Jul 22 19:15:16.071802 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.071561    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"
Jul 22 19:15:16.071802 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.071556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" event={"ID":"8d0aa034-1735-487e-ab23-b69eb61d8ec3","Type":"ContainerDied","Data":"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"}
Jul 22 19:15:16.072433 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.071980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh" event={"ID":"8d0aa034-1735-487e-ab23-b69eb61d8ec3","Type":"ContainerDied","Data":"6da42fd738cf3b2f341a4e95eed9674ac72436aa9e497e72bcb971e6945c748d"}
Jul 22 19:15:16.072433 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.072035    2578 scope.go:117] "RemoveContainer" containerID="e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"
Jul 22 19:15:16.084534 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.084513    2578 scope.go:117] "RemoveContainer" containerID="e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"
Jul 22 19:15:16.084905 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:15:16.084885    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6\": container with ID starting with e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6 not found: ID does not exist" containerID="e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"
Jul 22 19:15:16.084958 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.084918    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6"} err="failed to get container status \"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6\": rpc error: code = NotFound desc = could not find container \"e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6\": container with ID starting with e7655bed83a061909ff2ff4e0914b28b0740e63d83fcc4be0d2c50ccac9223a6 not found: ID does not exist"
Jul 22 19:15:16.094868 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.094824    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:15:16.098967 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.098932    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fm5rh"]
Jul 22 19:15:16.924805 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:15:16.924763    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" path="/var/lib/kubelet/pods/8d0aa034-1735-487e-ab23-b69eb61d8ec3/volumes"
Jul 22 19:16:12.598664 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.598624    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"]
Jul 22 19:16:12.599125 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.599088    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" containerName="manager"
Jul 22 19:16:12.599125 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.599102    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" containerName="manager"
Jul 22 19:16:12.599196 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.599171    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0aa034-1735-487e-ab23-b69eb61d8ec3" containerName="manager"
Jul 22 19:16:12.602169 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.602147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.606001 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.605978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwjz4\""
Jul 22 19:16:12.617626 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.617594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"]
Jul 22 19:16:12.699918 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.699880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af7d958-97fd-4a7d-bb06-59f33b603174-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.700159 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.700062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcmmd\" (UniqueName: \"kubernetes.io/projected/7af7d958-97fd-4a7d-bb06-59f33b603174-kube-api-access-lcmmd\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.801330 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.801280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcmmd\" (UniqueName: \"kubernetes.io/projected/7af7d958-97fd-4a7d-bb06-59f33b603174-kube-api-access-lcmmd\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.801330 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.801337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af7d958-97fd-4a7d-bb06-59f33b603174-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.801731 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.801708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af7d958-97fd-4a7d-bb06-59f33b603174-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.816474 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.816439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcmmd\" (UniqueName: \"kubernetes.io/projected/7af7d958-97fd-4a7d-bb06-59f33b603174-kube-api-access-lcmmd\") pod \"kuadrant-operator-controller-manager-86878c769f-5cs79\" (UID: \"7af7d958-97fd-4a7d-bb06-59f33b603174\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:12.913662 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:12.913625    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:13.067917 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:13.067882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"]
Jul 22 19:16:13.072238 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:16:13.072192    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af7d958_97fd_4a7d_bb06_59f33b603174.slice/crio-6b5f60fc7c8988abd013621668849ed729d0d936ee54462f7802036170447a3a WatchSource:0}: Error finding container 6b5f60fc7c8988abd013621668849ed729d0d936ee54462f7802036170447a3a: Status 404 returned error can't find the container with id 6b5f60fc7c8988abd013621668849ed729d0d936ee54462f7802036170447a3a
Jul 22 19:16:13.347974 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:13.347869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79" event={"ID":"7af7d958-97fd-4a7d-bb06-59f33b603174","Type":"ContainerStarted","Data":"eaca206eaa2057e34f7e844cac71677ac775f7f78709e27576edb7ccaebf6cb4"}
Jul 22 19:16:13.347974 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:13.347938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79" event={"ID":"7af7d958-97fd-4a7d-bb06-59f33b603174","Type":"ContainerStarted","Data":"6b5f60fc7c8988abd013621668849ed729d0d936ee54462f7802036170447a3a"}
Jul 22 19:16:13.348182 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:13.348075    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:13.369670 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:13.369614    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79" podStartSLOduration=1.369589985 podStartE2EDuration="1.369589985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:16:13.367627507 +0000 UTC m=+1174.935971877" watchObservedRunningTime="2026-07-22 19:16:13.369589985 +0000 UTC m=+1174.937934357"
Jul 22 19:16:24.355344 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:24.355308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5cs79"
Jul 22 19:16:37.965110 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:37.965069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:16:38.055020 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:16:38.054983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:18:57.141986 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:18:57.141944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:19:26.386273 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:19:26.386193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:19:44.221108 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:19:44.221052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:19:44.273509 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:19:44.273466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:19:48.227665 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:19:48.227628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:19:49.850797 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:19:49.850755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:21:07.722667 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:21:07.722635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:21:12.610599 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:21:12.610564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:05.863751 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:05.863711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:26.558818 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:26.558785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:30.111070 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:30.110974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:30.210650 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:30.210613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:30.623760 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:30.623726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:36.339070 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:36.339030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:36.439470 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:36.439423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:36.604689 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:36.604600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:36.960324 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:36.960290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:37.226874 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:37.226783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:38.964903 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:38.964854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:39.059742 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:39.059705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:39.141683 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:39.141648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:39.337725 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:39.337630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:39.714187 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:39.714156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:23:39.814741 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:23:39.814702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:15.350200 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:15.350164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:19.923804 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:19.923759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:20.156422 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:20.156380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:20.391342 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:20.391301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:20.686990 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:20.686873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:20.786402 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:20.786374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:20.958634 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:20.958543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:21.311248 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:21.311120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:21.571532 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:21.571431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:23.325549 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:23.325517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:23.429132 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:23.429100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:23.503045 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:23.503011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:24.074638 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:24.074608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:24.174842 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:24.174806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:37.956487 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:37.956450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:24:59.055490 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:24:59.055453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:03.549342 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:03.549301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:03.731463 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:03.731432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:04.022867 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:04.022830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:04.351766 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:04.351673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:05.119800 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:05.119767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:05.220638 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:05.220603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:07.401712 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:07.401673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:07.475405 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:07.475373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:07.551118 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:07.551083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:08.134226 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:08.134182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:08.237079 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:08.237045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:08.515949 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:08.515861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:44.002143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:44.002107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:45.922456 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:45.922411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:46.023321 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:46.023286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:48.645272 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:48.645231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:49.985058 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:49.985021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:50.234931 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:50.234897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:50.503374 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:50.503331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:50.857529 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:50.857440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:50.980331 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:50.980293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:53.609860 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:53.609798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:53.710467 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:53.710432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:53.883672 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:53.883641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:54.212855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:54.212756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:54.401190 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:54.401114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:25:54.507985 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:25:54.507881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:29.028685 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:29.028651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:33.700546 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:33.700503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:33.874036 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:33.874006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:34.209871 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:34.209835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:34.756006 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:34.755969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:34.856099 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:34.856055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:34.962678 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:34.962647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:36.701840 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:36.701752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:42.454081 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:42.454039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:42.515852 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:42.515819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:42.619965 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:42.619924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:42.719486 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:42.719396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:42.819392 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:42.819358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:26:43.234375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:26:43.234341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:09.477775 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:09.477735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:16.006759 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:16.006721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:16.204913 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:16.204883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:16.304587 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:16.304493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:32.143067 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:32.143029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:37.964060 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:37.964027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:38.071113 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:38.071077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:38.164565 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:38.164530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:48.712522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:48.712479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:49.509106 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:49.509069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:53.052089 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:53.052031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:53.153496 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:53.153459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:56.146829 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:56.146790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:56.247734 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:56.247700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:56.395782 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:56.395743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:56.491624 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:56.491531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:57.253585 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:57.253551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:57.345423 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:57.345357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:57.445963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:57.445924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:27:59.085098 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:27:59.085058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:05.010105 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:05.010061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:05.112100 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:05.112066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:05.736496 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:05.736460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:11.504827 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:11.504790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:11.657390 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:11.657348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:11.757503 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:11.757414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:11.911086 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:11.911050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:12.094531 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:12.094431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:12.180728 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:12.180694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:14.876629 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:14.876588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:14.958140 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:14.958101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:15.031890 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:15.031857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:15.269970 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:15.269933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:15.621391 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:15.621296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:15.722563 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:15.722522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:19.382682 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:19.382628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:20.090734 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:20.090694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:20.192271 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:20.192228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:20.498794 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:20.498758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:26.382580 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:26.382544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:26.482660 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:26.482620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:37.168854 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:37.168808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:41.830410 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:41.830381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:42.232461 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:42.232426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.100906 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.100873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.204747 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.204646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.337068 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.337036    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.576772 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.576737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.711751 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.711713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.811812 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.811769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:48.924902 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:48.924868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:54.611074 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:54.611028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:54.711651 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:54.711612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:54.812572 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:54.812522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:28:54.932198 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:28:54.932167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:00.862516 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:00.862455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:00.923542 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:00.923505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:07.725586 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:07.725551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:08.051247 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:08.051138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:08.268472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:08.268437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.058661 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.058620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.158549 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.158511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.287791 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.287760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.352188 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.352087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.794722 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.794688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:11.895695 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:11.895660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:15.535855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:15.535822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:27.486830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:27.486792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:28.744524 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:28.744485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:34.943008 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.942904    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:29:34.946993 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.946970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:34.950480 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.950452    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7a0d319a\"/\"kube-root-ca.crt\""
Jul 22 19:29:34.950480 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.950467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7a0d319a\"/\"e2e-lifecycle-model-7a0d319a-kserve-self-signed-certs\""
Jul 22 19:29:34.950683 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.950508    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7a0d319a\"/\"openshift-service-ca.crt\""
Jul 22 19:29:34.950683 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.950518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7a0d319a\"/\"default-dockercfg-m9ms5\""
Jul 22 19:29:34.956019 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.955978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:29:34.972473 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:34.972437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:29:35.008191 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fr4p\" (UniqueName: \"kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.008398 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.008398 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.008398 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.008633 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.008687 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.008651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110175 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fr4p\" (UniqueName: \"kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110849 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110849 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.110959 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.110920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.113260 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.113229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.113509 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.113486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.119179 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.119151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fr4p\" (UniqueName: \"kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p\") pod \"e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") " pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.261559 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.261459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:35.407176 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:35.407142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:29:35.409920 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:29:35.409893    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93f6ecdf_ade6_40e0_a447_3dbcec20623c.slice/crio-855ab5742d28766edbd282f0ad8f74c1b69bed203cfe66d3d71733db4eff3cca WatchSource:0}: Error finding container 855ab5742d28766edbd282f0ad8f74c1b69bed203cfe66d3d71733db4eff3cca: Status 404 returned error can't find the container with id 855ab5742d28766edbd282f0ad8f74c1b69bed203cfe66d3d71733db4eff3cca
Jul 22 19:29:36.080067 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:36.080032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" event={"ID":"93f6ecdf-ade6-40e0-a447-3dbcec20623c","Type":"ContainerStarted","Data":"53672404eef71f393e0b38a977adce281135836d9677ec7b4db866c9ea3587da"}
Jul 22 19:29:36.080067 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:36.080073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" event={"ID":"93f6ecdf-ade6-40e0-a447-3dbcec20623c","Type":"ContainerStarted","Data":"855ab5742d28766edbd282f0ad8f74c1b69bed203cfe66d3d71733db4eff3cca"}
Jul 22 19:29:36.097832 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:36.097778    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" podStartSLOduration=2.097760019 podStartE2EDuration="2.097760019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:29:36.096489315 +0000 UTC m=+1977.664833695" watchObservedRunningTime="2026-07-22 19:29:36.097760019 +0000 UTC m=+1977.666104390"
Jul 22 19:29:45.261845 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:45.261799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:45.262313 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:45.261867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:45.274957 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:45.274928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:29:46.137401 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:29:46.137367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:30:09.391187 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:09.391128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:14.019977 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:14.019942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:16.243839 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:16.243803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:21.116738 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:21.116699    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:30:21.178153 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:21.178114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:36.138154 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.138080    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" podUID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" containerName="main" containerID="cri-o://53672404eef71f393e0b38a977adce281135836d9677ec7b4db866c9ea3587da" gracePeriod=45
Jul 22 19:30:36.357840 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.357806    2578 generic.go:356] "Generic (PLEG): container finished" podID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" containerID="53672404eef71f393e0b38a977adce281135836d9677ec7b4db866c9ea3587da" exitCode=0
Jul 22 19:30:36.358014 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.357884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" event={"ID":"93f6ecdf-ade6-40e0-a447-3dbcec20623c","Type":"ContainerDied","Data":"53672404eef71f393e0b38a977adce281135836d9677ec7b4db866c9ea3587da"}
Jul 22 19:30:36.394109 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.394039    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:30:36.484919 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.484870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fr4p\" (UniqueName: \"kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.484919 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.484919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.485192 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.484982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.485192 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.485192 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485094    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.485192 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm\") pod \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\" (UID: \"93f6ecdf-ade6-40e0-a447-3dbcec20623c\") "
Jul 22 19:30:36.485429 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485276    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:30:36.485429 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache" (OuterVolumeSpecName: "model-cache") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:30:36.485429 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home" (OuterVolumeSpecName: "home") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:30:36.485540 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485517    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:36.485540 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485536    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:36.485609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.485548    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:36.487451 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.487424    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:30:36.487535 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.487456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm" (OuterVolumeSpecName: "dshm") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:30:36.487574 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.487536    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p" (OuterVolumeSpecName: "kube-api-access-4fr4p") pod "93f6ecdf-ade6-40e0-a447-3dbcec20623c" (UID: "93f6ecdf-ade6-40e0-a447-3dbcec20623c"). InnerVolumeSpecName "kube-api-access-4fr4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:30:36.585993 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.585948    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6ecdf-ade6-40e0-a447-3dbcec20623c-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:36.585993 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.585979    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f6ecdf-ade6-40e0-a447-3dbcec20623c-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:36.585993 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:36.585989    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fr4p\" (UniqueName: \"kubernetes.io/projected/93f6ecdf-ade6-40e0-a447-3dbcec20623c-kube-api-access-4fr4p\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:30:37.364891 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:37.364793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8" event={"ID":"93f6ecdf-ade6-40e0-a447-3dbcec20623c","Type":"ContainerDied","Data":"855ab5742d28766edbd282f0ad8f74c1b69bed203cfe66d3d71733db4eff3cca"}
Jul 22 19:30:37.364891 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:37.364822    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"
Jul 22 19:30:37.364891 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:37.364844    2578 scope.go:117] "RemoveContainer" containerID="53672404eef71f393e0b38a977adce281135836d9677ec7b4db866c9ea3587da"
Jul 22 19:30:37.380730 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:37.380693    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:30:37.385254 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:37.385220    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7a0d319a/e2e-lifecycle-model-7a0d319a-kserve-6f5cf4b7b7-dl4l8"]
Jul 22 19:30:38.920454 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:38.920421    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" path="/var/lib/kubelet/pods/93f6ecdf-ade6-40e0-a447-3dbcec20623c/volumes"
Jul 22 19:30:46.633812 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:46.633776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:46.734817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:46.734785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:57.436161 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:57.436126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:30:58.253237 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:30:58.253172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:03.960711 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:03.960622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:04.061518 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:04.061483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:04.118347 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:04.118276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:04.315599 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:04.315504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:05.360748 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:05.360703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:05.461025 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:05.460994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:05.564277 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:05.564241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:06.333679 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:06.333647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:06.418585 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:06.418553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:07.817676 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:07.817639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:13.682780 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:13.682744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:13.744497 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:13.744434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:14.338059 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:14.338006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:20.373124 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:20.373086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:20.473734 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:20.473698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:20.573475 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:20.573444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:31.067273 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:31.067227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:32.024129 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:32.024080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:42.811426 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:42.811352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:52.392225 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:52.392165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:58.230045 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:58.230013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:58.330492 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:58.330448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:58.676601 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:58.676569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:58.944524 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:58.944424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:31:59.494564 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:31:59.494529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:01.825382 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:01.825347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:01.906867 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:01.906829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:01.977665 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:01.977620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:02.085843 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:02.085746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:02.504702 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:02.504668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:02.604817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:02.604783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:06.321731 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:06.321695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:06.694401 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:06.694358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:07.005545 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:07.005449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:07.824034 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:07.823995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:09.911387 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:09.911350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:10.004650 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:10.004618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:10.568300 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:10.568254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:10.667852 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:10.667821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:14.437502 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:14.437468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:23.243512 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:23.243472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:23.345450 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:23.345420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:32.255165 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:32.255071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:32.356522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:32.356479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:34.142257 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.142223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:32:34.142749 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.142606    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" containerName="main"
Jul 22 19:32:34.142749 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.142618    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" containerName="main"
Jul 22 19:32:34.142749 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.142679    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f6ecdf-ade6-40e0-a447-3dbcec20623c" containerName="main"
Jul 22 19:32:34.145393 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.145372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.148782 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.148750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-735d50\"/\"openshift-service-ca.crt\""
Jul 22 19:32:34.148946 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.148782    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-735d50\"/\"default-dockercfg-77k6q\""
Jul 22 19:32:34.148946 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.148750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-735d50\"/\"kube-root-ca.crt\""
Jul 22 19:32:34.148946 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.148860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-735d50\"/\"test-model-735d50-kserve-self-signed-certs\""
Jul 22 19:32:34.154133 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.154090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:32:34.179909 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.179871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:32:34.260111 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.260375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.260375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.260375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thxv8\" (UniqueName: \"kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.260375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.260375 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.260310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.360819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.360778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.360819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.360831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361111 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.360891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361111 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.360938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361111 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.360972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361111 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.361000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thxv8\" (UniqueName: \"kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361354 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.361287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361354 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.361291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.361354 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.361343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.363442 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.363420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.363705 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.363688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.369951 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.369920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thxv8\" (UniqueName: \"kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8\") pod \"test-model-735d50-kserve-7c644c49b9-ssdws\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") " pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.456820 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.456718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:34.599169 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.599053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:32:34.601635 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:32:34.601597    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3e78146_da8d_4ae9_be31_70cd0252f58b.slice/crio-9d76209e7807721494b7bbeea36fb67ac8183a4c03cdabe8ad3babcc97e1f04d WatchSource:0}: Error finding container 9d76209e7807721494b7bbeea36fb67ac8183a4c03cdabe8ad3babcc97e1f04d: Status 404 returned error can't find the container with id 9d76209e7807721494b7bbeea36fb67ac8183a4c03cdabe8ad3babcc97e1f04d
Jul 22 19:32:34.919770 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.919737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" event={"ID":"d3e78146-da8d-4ae9-be31-70cd0252f58b","Type":"ContainerStarted","Data":"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"}
Jul 22 19:32:34.919942 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.919783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" event={"ID":"d3e78146-da8d-4ae9-be31-70cd0252f58b","Type":"ContainerStarted","Data":"9d76209e7807721494b7bbeea36fb67ac8183a4c03cdabe8ad3babcc97e1f04d"}
Jul 22 19:32:34.934343 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:34.934291    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" podStartSLOduration=0.93427252 podStartE2EDuration="934.27252ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:32:34.933232548 +0000 UTC m=+2156.501576944" watchObservedRunningTime="2026-07-22 19:32:34.93427252 +0000 UTC m=+2156.502616891"
Jul 22 19:32:44.457623 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:44.457581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:44.458028 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:44.457654    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:44.470318 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:44.470286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:32:44.975176 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:32:44.975143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:33:00.165167 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:00.165096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:33:50.039750 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:50.039705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:33:50.059623 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:50.059575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:33:51.215360 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:51.215324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:33:51.750943 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:51.750903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:33:52.027587 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:33:52.027467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:01.511040 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:01.510905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:05.061020 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.060977    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" podUID="d3e78146-da8d-4ae9-be31-70cd0252f58b" containerName="main" containerID="cri-o://9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8" gracePeriod=45
Jul 22 19:34:05.306303 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.306273    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:34:05.342472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.342368    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3e78146-da8d-4ae9-be31-70cd0252f58b" containerID="9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8" exitCode=0
Jul 22 19:34:05.342472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.342406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" event={"ID":"d3e78146-da8d-4ae9-be31-70cd0252f58b","Type":"ContainerDied","Data":"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"}
Jul 22 19:34:05.342472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.342415    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"
Jul 22 19:34:05.342472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.342439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws" event={"ID":"d3e78146-da8d-4ae9-be31-70cd0252f58b","Type":"ContainerDied","Data":"9d76209e7807721494b7bbeea36fb67ac8183a4c03cdabe8ad3babcc97e1f04d"}
Jul 22 19:34:05.342830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.342459    2578 scope.go:117] "RemoveContainer" containerID="9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"
Jul 22 19:34:05.351161 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.351134    2578 scope.go:117] "RemoveContainer" containerID="9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"
Jul 22 19:34:05.351525 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:34:05.351493    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8\": container with ID starting with 9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8 not found: ID does not exist" containerID="9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"
Jul 22 19:34:05.351624 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.351532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8"} err="failed to get container status \"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8\": rpc error: code = NotFound desc = could not find container \"9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8\": container with ID starting with 9f8e603a8592d45406fbaf5ee796f7ca8985c58f9cde8643cb902aaec44cded8 not found: ID does not exist"
Jul 22 19:34:05.418349 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418359    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thxv8\" (UniqueName: \"kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418497    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm\") pod \"d3e78146-da8d-4ae9-be31-70cd0252f58b\" (UID: \"d3e78146-da8d-4ae9-be31-70cd0252f58b\") "
Jul 22 19:34:05.418830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418645    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:34:05.418830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home" (OuterVolumeSpecName: "home") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:34:05.418830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418779    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:34:05.418980 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418909    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.418980 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418922    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.418980 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.418931    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.420932 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.420901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm" (OuterVolumeSpecName: "dshm") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:34:05.421063 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.420956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:34:05.421117 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.421075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8" (OuterVolumeSpecName: "kube-api-access-thxv8") pod "d3e78146-da8d-4ae9-be31-70cd0252f58b" (UID: "d3e78146-da8d-4ae9-be31-70cd0252f58b"). InnerVolumeSpecName "kube-api-access-thxv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:34:05.519881 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.519841    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thxv8\" (UniqueName: \"kubernetes.io/projected/d3e78146-da8d-4ae9-be31-70cd0252f58b-kube-api-access-thxv8\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.519881 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.519876    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e78146-da8d-4ae9-be31-70cd0252f58b-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.519881 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.519887    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e78146-da8d-4ae9-be31-70cd0252f58b-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:34:05.663387 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.663347    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:34:05.666859 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:05.666834    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-735d50/test-model-735d50-kserve-7c644c49b9-ssdws"]
Jul 22 19:34:06.183874 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:06.183827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:06.555685 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:06.555592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:06.920108 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:06.920060    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3e78146-da8d-4ae9-be31-70cd0252f58b" path="/var/lib/kubelet/pods/d3e78146-da8d-4ae9-be31-70cd0252f58b/volumes"
Jul 22 19:34:12.297053 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:12.297018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:12.397817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:12.397777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:12.513509 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:12.513477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:12.722771 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:12.722732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:13.484790 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:13.484750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:13.586845 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:13.586805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:23.248365 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:23.248331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:27.922437 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:27.922396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:28.288529 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:28.288428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:34.114600 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:34.114559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:35.546557 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:35.546514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:38.498392 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:38.498349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:38.580506 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:38.580471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:38.651396 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:38.651363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:39.044249 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:39.044187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:39.142089 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:39.142050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:39.243003 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:39.242972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:42.996584 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:42.996553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:43.471353 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:43.471323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:43.803901 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:43.803800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:44.095577 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:44.095490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:46.635923 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:46.635886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:46.728542 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:46.728508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:46.792731 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:46.792699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:47.087157 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:47.087063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:47.388704 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:47.388670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:47.489797 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:47.489758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:52.209547 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:52.209511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:59.505635 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:59.505595    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:34:59.636533 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:34:59.636498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:08.122312 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:08.122270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:08.222534 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:08.222494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:09.766570 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:09.766529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:09.868835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:09.868796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:15.018618 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:15.018580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:19.087115 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:19.087081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:19.445867 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:19.445835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:25.312406 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:25.312358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:25.472554 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:25.472512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:25.571458 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:25.571356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:25.786760 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:25.786727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:26.386679 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:26.386645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:26.490382 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:26.490353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:39.400807 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:39.400718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:39.448800 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:39.448769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:41.205515 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:41.205483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:41.459944 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:41.459852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:45.973453 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:45.973411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:46.419401 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:46.419369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:47.354119 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:47.354084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:47.454243 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:47.454190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:51.926840 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:51.926807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:51.990049 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:51.990012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:52.197024 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:52.196929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:52.428754 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:52.428717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:52.751133 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:52.751100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:53.072117 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:53.072018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:53.441258 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:53.441216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:55.902522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:55.902482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:55.998860 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:55.998830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:56.069357 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:56.069323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:56.203621 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:56.203532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:56.510859 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:56.510776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:35:56.613723 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:35:56.613692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:00.386297 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:00.386260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:00.702154 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:00.702064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:01.002005 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:01.001905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:01.413803 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:01.413767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:06.013342 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:06.013306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:06.069347 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:06.069315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:08.417341 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:08.417303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:17.249707 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:17.249658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:17.350634 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:17.350592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:24.289088 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:24.289048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:25.668490 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:25.668448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:25.769807 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:25.769779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:37.347501 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.347457    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:36:37.348011 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.347994    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e78146-da8d-4ae9-be31-70cd0252f58b" containerName="main"
Jul 22 19:36:37.348060 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.348014    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e78146-da8d-4ae9-be31-70cd0252f58b" containerName="main"
Jul 22 19:36:37.348108 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.348097    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e78146-da8d-4ae9-be31-70cd0252f58b" containerName="main"
Jul 22 19:36:37.351460 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.351438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.355012 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.354974    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"kube-root-ca.crt\""
Jul 22 19:36:37.355139 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.355039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"openshift-service-ca.crt\""
Jul 22 19:36:37.355139 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.355044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"default-dockercfg-ch9n6\""
Jul 22 19:36:37.355139 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.355044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"auth-test-model-938311-kserve-self-signed-certs\""
Jul 22 19:36:37.359154 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.358893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:36:37.378374 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.378342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:36:37.435387 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbst\" (UniqueName: \"kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.435387 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.435603 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.435603 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.435603 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.435700 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.435623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.536891 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.536858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537097 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.536911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537097 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.536952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537097 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.536975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537097 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.536999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbst\" (UniqueName: \"kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537097 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.537024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537405 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.537381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537465 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.537418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.537465 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.537440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.539475 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.539454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.539643 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.539627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.545417 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.545390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbst\" (UniqueName: \"kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst\") pod \"auth-test-model-938311-kserve-984667f5f-zs4l2\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") " pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.661618 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.661580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:37.806782 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:37.806678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:36:37.809610 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:36:37.809582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod517076ea_f067_4252_b41d_c49de8495123.slice/crio-e78ac4cb98b503564f17a43d5d119306e96e7694b6df82b92d78f51cae7eecb0 WatchSource:0}: Error finding container e78ac4cb98b503564f17a43d5d119306e96e7694b6df82b92d78f51cae7eecb0: Status 404 returned error can't find the container with id e78ac4cb98b503564f17a43d5d119306e96e7694b6df82b92d78f51cae7eecb0
Jul 22 19:36:38.058522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:38.058425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" event={"ID":"517076ea-f067-4252-b41d-c49de8495123","Type":"ContainerStarted","Data":"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"}
Jul 22 19:36:38.058522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:38.058471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" event={"ID":"517076ea-f067-4252-b41d-c49de8495123","Type":"ContainerStarted","Data":"e78ac4cb98b503564f17a43d5d119306e96e7694b6df82b92d78f51cae7eecb0"}
Jul 22 19:36:38.078083 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:38.078017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" podStartSLOduration=1.077999536 podStartE2EDuration="1.077999536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:36:38.075732833 +0000 UTC m=+2399.644077203" watchObservedRunningTime="2026-07-22 19:36:38.077999536 +0000 UTC m=+2399.646343907"
Jul 22 19:36:47.662578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:47.662531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:47.662578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:47.662592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:47.675603 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:47.675573    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:36:48.116603 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:36:48.116515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:37:08.757479 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.757390    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:37:08.760816 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.760796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.763395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.763373    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"openshift-service-ca.crt\""
Jul 22 19:37:08.764348 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.764327    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"kube-root-ca.crt\""
Jul 22 19:37:08.764421 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.764343    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"auth-test-model-4addf8-kserve-self-signed-certs\""
Jul 22 19:37:08.764421 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.764336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"default-dockercfg-xvs67\""
Jul 22 19:37:08.769958 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.769934    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:37:08.832174 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.832395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.832395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.832395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.832395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpr6p\" (UniqueName: \"kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.832395 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.832379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.849569 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.849539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:37:08.933564 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.933564 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.933855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpr6p\" (UniqueName: \"kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.933855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.933855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.933855 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.933688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.934144 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.934123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.934189 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.934124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.934262 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.934178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.936270 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.936244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.936453 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.936433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:08.942641 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:08.942615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpr6p\" (UniqueName: \"kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p\") pod \"auth-test-model-4addf8-kserve-79b874665f-sn9p9\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") " pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:09.071372 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:09.071270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:09.217247 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:09.217197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:37:09.221183 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:37:09.221153    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b1d9ea4_108c_43dc_b98f_8d2a4bf8c501.slice/crio-71ea64111a77564e69e0daab323088c1a926b041876cc4c8c239e56f55855f18 WatchSource:0}: Error finding container 71ea64111a77564e69e0daab323088c1a926b041876cc4c8c239e56f55855f18: Status 404 returned error can't find the container with id 71ea64111a77564e69e0daab323088c1a926b041876cc4c8c239e56f55855f18
Jul 22 19:37:10.206229 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:10.206176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" event={"ID":"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501","Type":"ContainerStarted","Data":"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"}
Jul 22 19:37:10.206699 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:10.206238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" event={"ID":"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501","Type":"ContainerStarted","Data":"71ea64111a77564e69e0daab323088c1a926b041876cc4c8c239e56f55855f18"}
Jul 22 19:37:19.072496 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:19.072457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:19.072995 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:19.072509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:19.085538 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:19.085508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:37:19.103310 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:19.103250    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" podStartSLOduration=11.103231137 podStartE2EDuration="11.103231137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:37:10.223054668 +0000 UTC m=+2431.791399050" watchObservedRunningTime="2026-07-22 19:37:19.103231137 +0000 UTC m=+2440.671575508"
Jul 22 19:37:19.266522 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:37:19.266492    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:39:19.839528 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:19.839495    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:39:19.889989 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:19.889945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:39:20.822125 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:20.822090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:39:20.839503 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:20.839457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:39:30.846579 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:30.846541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:39:34.860077 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:34.860023    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" podUID="517076ea-f067-4252-b41d-c49de8495123" containerName="main" containerID="cri-o://3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576" gracePeriod=45
Jul 22 19:39:35.122390 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.122321    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:39:35.240126 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240428 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240152    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240428 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240241    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240428 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240428 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240428 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240389    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvbst\" (UniqueName: \"kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst\") pod \"517076ea-f067-4252-b41d-c49de8495123\" (UID: \"517076ea-f067-4252-b41d-c49de8495123\") "
Jul 22 19:39:35.240703 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240543    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:35.240703 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240604    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home" (OuterVolumeSpecName: "home") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:35.240703 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240608    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache" (OuterVolumeSpecName: "model-cache") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:35.240844 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240793    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.240844 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240808    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.240844 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.240817    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.242780 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.242750    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst" (OuterVolumeSpecName: "kube-api-access-bvbst") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "kube-api-access-bvbst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:39:35.242987 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.242965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm" (OuterVolumeSpecName: "dshm") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:35.243031 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.242965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "517076ea-f067-4252-b41d-c49de8495123" (UID: "517076ea-f067-4252-b41d-c49de8495123"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:39:35.341784 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.341734    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvbst\" (UniqueName: \"kubernetes.io/projected/517076ea-f067-4252-b41d-c49de8495123-kube-api-access-bvbst\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.341784 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.341772    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517076ea-f067-4252-b41d-c49de8495123-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.341784 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.341785    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517076ea-f067-4252-b41d-c49de8495123-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:35.843679 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.843614    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" podUID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" containerName="main" containerID="cri-o://002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1" gracePeriod=45
Jul 22 19:39:35.894101 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.894065    2578 generic.go:356] "Generic (PLEG): container finished" podID="517076ea-f067-4252-b41d-c49de8495123" containerID="3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576" exitCode=0
Jul 22 19:39:35.894632 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.894122    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"
Jul 22 19:39:35.894632 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.894143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" event={"ID":"517076ea-f067-4252-b41d-c49de8495123","Type":"ContainerDied","Data":"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"}
Jul 22 19:39:35.894632 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.894177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2" event={"ID":"517076ea-f067-4252-b41d-c49de8495123","Type":"ContainerDied","Data":"e78ac4cb98b503564f17a43d5d119306e96e7694b6df82b92d78f51cae7eecb0"}
Jul 22 19:39:35.894632 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.894194    2578 scope.go:117] "RemoveContainer" containerID="3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"
Jul 22 19:39:35.923307 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.923259    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:39:35.926561 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.926535    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-938311/auth-test-model-938311-kserve-984667f5f-zs4l2"]
Jul 22 19:39:35.954460 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.954440    2578 scope.go:117] "RemoveContainer" containerID="3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"
Jul 22 19:39:35.954826 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:39:35.954798    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576\": container with ID starting with 3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576 not found: ID does not exist" containerID="3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"
Jul 22 19:39:35.954905 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:35.954844    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576"} err="failed to get container status \"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576\": rpc error: code = NotFound desc = could not find container \"3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576\": container with ID starting with 3e2eb809a52549db9b4ee423927f03c7dcc87c70e540382260cbe6a9e77f8576 not found: ID does not exist"
Jul 22 19:39:36.100201 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.100137    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:39:36.149687 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.149687 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149689    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.149908 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.149908 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpr6p\" (UniqueName: \"kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.149908 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.149908 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm\") pod \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\" (UID: \"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501\") "
Jul 22 19:39:36.150093 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.149972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home" (OuterVolumeSpecName: "home") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:36.150158 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.150126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:36.150158 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.150134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:36.150303 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.150241    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.150303 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.150255    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.150303 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.150266    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.152200 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.152170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:39:36.152344 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.152245    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p" (OuterVolumeSpecName: "kube-api-access-xpr6p") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "kube-api-access-xpr6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:39:36.152344 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.152261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm" (OuterVolumeSpecName: "dshm") pod "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" (UID: "1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:39:36.250835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.250793    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.250835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.250824    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.250835 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.250835    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpr6p\" (UniqueName: \"kubernetes.io/projected/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501-kube-api-access-xpr6p\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:39:36.899795 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.899759    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" containerID="002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1" exitCode=0
Jul 22 19:39:36.900294 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.899805    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"
Jul 22 19:39:36.900294 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.899855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" event={"ID":"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501","Type":"ContainerDied","Data":"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"}
Jul 22 19:39:36.900294 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.899898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9" event={"ID":"1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501","Type":"ContainerDied","Data":"71ea64111a77564e69e0daab323088c1a926b041876cc4c8c239e56f55855f18"}
Jul 22 19:39:36.900294 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.899923    2578 scope.go:117] "RemoveContainer" containerID="002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"
Jul 22 19:39:36.909635 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.909620    2578 scope.go:117] "RemoveContainer" containerID="002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"
Jul 22 19:39:36.909887 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:39:36.909867    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1\": container with ID starting with 002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1 not found: ID does not exist" containerID="002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"
Jul 22 19:39:36.909927 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.909895    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1"} err="failed to get container status \"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1\": rpc error: code = NotFound desc = could not find container \"002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1\": container with ID starting with 002dba327c8d08ef2ed74d468e10a4d7eb2c520e55f29fd15b989f508f785bf1 not found: ID does not exist"
Jul 22 19:39:36.925870 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.925834    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="517076ea-f067-4252-b41d-c49de8495123" path="/var/lib/kubelet/pods/517076ea-f067-4252-b41d-c49de8495123/volumes"
Jul 22 19:39:36.926106 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.926092    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:39:36.927075 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:36.927058    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/auth-test-model-4addf8-kserve-79b874665f-sn9p9"]
Jul 22 19:39:38.920021 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:38.919981    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" path="/var/lib/kubelet/pods/1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501/volumes"
Jul 22 19:39:53.251919 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.251872    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:39:53.252449 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252417    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517076ea-f067-4252-b41d-c49de8495123" containerName="main"
Jul 22 19:39:53.252449 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252436    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="517076ea-f067-4252-b41d-c49de8495123" containerName="main"
Jul 22 19:39:53.252578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252468    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" containerName="main"
Jul 22 19:39:53.252578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252477    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" containerName="main"
Jul 22 19:39:53.252578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252563    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="517076ea-f067-4252-b41d-c49de8495123" containerName="main"
Jul 22 19:39:53.252578 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.252576    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b1d9ea4-108c-43dc-b98f-8d2a4bf8c501" containerName="main"
Jul 22 19:39:53.255523 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.255498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.259409 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.259383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"kube-root-ca.crt\""
Jul 22 19:39:53.259409 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.259394    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"openshift-service-ca.crt\""
Jul 22 19:39:53.259636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.259468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"default-dockercfg-xvs67\""
Jul 22 19:39:53.259636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.259530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4addf8\"/\"sub-test-model-4addf8-kserve-self-signed-certs\""
Jul 22 19:39:53.265751 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.265722    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:39:53.315325 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.315511 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.315511 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.315511 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.315642 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.315642 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.315535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhwm\" (UniqueName: \"kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416588 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.416814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.416710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhwm\" (UniqueName: \"kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.417083 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.417037    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.417126 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.417075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.417179 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.417160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.419170 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.419146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.419472 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.419450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.425442 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.425409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhwm\" (UniqueName: \"kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm\") pod \"sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") " pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.566813 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.566716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:39:53.647374 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.647326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:39:53.711373 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.711352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:39:53.713934 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:39:53.713906    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod922e7ad7_ba32_4c02_8f7d_97e97c12bc88.slice/crio-922f289c4479e7237b1b93ef47391e92ec8f4f482c5158180e53fcab85d431b4 WatchSource:0}: Error finding container 922f289c4479e7237b1b93ef47391e92ec8f4f482c5158180e53fcab85d431b4: Status 404 returned error can't find the container with id 922f289c4479e7237b1b93ef47391e92ec8f4f482c5158180e53fcab85d431b4
Jul 22 19:39:53.985710 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.985674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" event={"ID":"922e7ad7-ba32-4c02-8f7d-97e97c12bc88","Type":"ContainerStarted","Data":"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"}
Jul 22 19:39:53.985710 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:53.985717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" event={"ID":"922e7ad7-ba32-4c02-8f7d-97e97c12bc88","Type":"ContainerStarted","Data":"922f289c4479e7237b1b93ef47391e92ec8f4f482c5158180e53fcab85d431b4"}
Jul 22 19:39:54.027616 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:39:54.027447    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" podStartSLOduration=1.027424198 podStartE2EDuration="1.027424198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:39:54.02686538 +0000 UTC m=+2595.595209751" watchObservedRunningTime="2026-07-22 19:39:54.027424198 +0000 UTC m=+2595.595768572"
Jul 22 19:40:03.567053 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:03.566939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:40:03.567053 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:03.566995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:40:03.580194 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:03.580164    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:40:04.046219 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:04.046171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:40:45.069444 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:45.069405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:45.920250 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:45.920198    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:40:45.939927 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:45.939881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:48.162371 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:48.162310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:48.272790 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:48.272751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:56.248817 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.248783    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:40:56.252450 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.252424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.255902 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.255879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"default-dockercfg-ch9n6\""
Jul 22 19:40:56.256048 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.255879    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"kube-root-ca.crt\""
Jul 22 19:40:56.256385 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.256368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"openshift-service-ca.crt\""
Jul 22 19:40:56.256481 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.256374    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-938311\"/\"rate-test-model-938311-kserve-self-signed-certs\""
Jul 22 19:40:56.261569 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.261542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:40:56.272480 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.272447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:56.314506 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.314692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.314692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8bq\" (UniqueName: \"kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.314692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.314692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.314692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.314672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415396 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415396 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8bq\" (UniqueName: \"kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415681 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415681 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415861 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.415941 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.415922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.416056 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.416034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.418051 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.418028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.418311 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.418291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.423768 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.423740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8bq\" (UniqueName: \"kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq\") pod \"rate-test-model-938311-kserve-7bdf549bff-t2pb9\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") " pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.564033 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.563918    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:40:56.707013 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:56.706985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:40:56.709955 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:40:56.709915    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a99c5d_b45a_48c3_8e44_9f83fa3ebfdd.slice/crio-061bc0b9661628b0841043ed2308f3daf03ce17bf0e60172292fbeaeee06d864 WatchSource:0}: Error finding container 061bc0b9661628b0841043ed2308f3daf03ce17bf0e60172292fbeaeee06d864: Status 404 returned error can't find the container with id 061bc0b9661628b0841043ed2308f3daf03ce17bf0e60172292fbeaeee06d864
Jul 22 19:40:57.285068 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.285024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:57.286081 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.286047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" event={"ID":"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd","Type":"ContainerStarted","Data":"d935753947a541c8b0bf2cdffd4cd8b83546e8eee3c581d0e8cd758b043b348b"}
Jul 22 19:40:57.286227 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.286102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" event={"ID":"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd","Type":"ContainerStarted","Data":"061bc0b9661628b0841043ed2308f3daf03ce17bf0e60172292fbeaeee06d864"}
Jul 22 19:40:57.303327 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.303271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" podStartSLOduration=1.303200838 podStartE2EDuration="1.303200838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:40:57.301815609 +0000 UTC m=+2658.870159981" watchObservedRunningTime="2026-07-22 19:40:57.303200838 +0000 UTC m=+2658.871545208"
Jul 22 19:40:57.386001 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.385960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:40:57.485326 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:40:57.485288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:41:00.941447 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:00.941406    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" podUID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" containerName="main" containerID="cri-o://43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992" gracePeriod=45
Jul 22 19:41:01.194128 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.194051    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:41:01.259848 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.259848 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.260137 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259884    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnhwm\" (UniqueName: \"kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.260137 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.260137 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.260137 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.259984    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir\") pod \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\" (UID: \"922e7ad7-ba32-4c02-8f7d-97e97c12bc88\") "
Jul 22 19:41:01.260349 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.260188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home" (OuterVolumeSpecName: "home") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:41:01.260349 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.260234    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache" (OuterVolumeSpecName: "model-cache") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:41:01.260424 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.260378    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:41:01.262362 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.262337    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm" (OuterVolumeSpecName: "dshm") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:41:01.262362 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.262343    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:41:01.262517 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.262401    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm" (OuterVolumeSpecName: "kube-api-access-qnhwm") pod "922e7ad7-ba32-4c02-8f7d-97e97c12bc88" (UID: "922e7ad7-ba32-4c02-8f7d-97e97c12bc88"). InnerVolumeSpecName "kube-api-access-qnhwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:41:01.311918 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.311885    2578 generic.go:356] "Generic (PLEG): container finished" podID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" containerID="43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992" exitCode=0
Jul 22 19:41:01.312143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.311938    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"
Jul 22 19:41:01.312143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.311944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" event={"ID":"922e7ad7-ba32-4c02-8f7d-97e97c12bc88","Type":"ContainerDied","Data":"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"}
Jul 22 19:41:01.312143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.311985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6" event={"ID":"922e7ad7-ba32-4c02-8f7d-97e97c12bc88","Type":"ContainerDied","Data":"922f289c4479e7237b1b93ef47391e92ec8f4f482c5158180e53fcab85d431b4"}
Jul 22 19:41:01.312143 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.312007    2578 scope.go:117] "RemoveContainer" containerID="43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"
Jul 22 19:41:01.321411 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.321386    2578 scope.go:117] "RemoveContainer" containerID="43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"
Jul 22 19:41:01.321754 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:41:01.321732    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992\": container with ID starting with 43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992 not found: ID does not exist" containerID="43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"
Jul 22 19:41:01.321800 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.321765    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992"} err="failed to get container status \"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992\": rpc error: code = NotFound desc = could not find container \"43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992\": container with ID starting with 43d5ff190b99e7e338c614baeca07c13d06ae0385c7e22e32576f0c0d5267992 not found: ID does not exist"
Jul 22 19:41:01.332948 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.332916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:41:01.335503 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.335474    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4addf8/sub-test-model-4addf8-kserve-74cbbd7db5-zqwk6"]
Jul 22 19:41:01.361199 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361170    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:01.361199 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361198    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:01.361369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361229    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:01.361369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361240    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnhwm\" (UniqueName: \"kubernetes.io/projected/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-kube-api-access-qnhwm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:01.361369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361251    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:01.361369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:01.361259    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922e7ad7-ba32-4c02-8f7d-97e97c12bc88-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:41:02.920461 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:02.920420    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" path="/var/lib/kubelet/pods/922e7ad7-ba32-4c02-8f7d-97e97c12bc88/volumes"
Jul 22 19:41:06.564609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:06.564575    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:41:06.564609 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:06.564621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:41:06.577612 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:06.577576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:41:07.351202 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:07.351167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:41:18.076487 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:18.076445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:41:18.178269 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:18.178199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:41:21.968918 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:21.968877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:41:26.407876 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:26.407840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:41:26.506995 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:41:26.506958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:06.465499 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:06.465463    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:42:06.483695 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:06.483656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:07.339564 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:07.339529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:08.314519 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.314487    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134186897840"]
Jul 22 19:42:08.314896 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.314813    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" containerName="main"
Jul 22 19:42:08.314896 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.314823    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" containerName="main"
Jul 22 19:42:08.314896 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.314893    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="922e7ad7-ba32-4c02-8f7d-97e97c12bc88" containerName="main"
Jul 22 19:42:08.318033 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.318013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:08.320301 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.320279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5bm2z\""
Jul 22 19:42:08.323645 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.323619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186897840"]
Jul 22 19:42:08.485707 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.485663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gpbq\" (UniqueName: \"kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq\") pod \"test-curl-7435-140134186897840\" (UID: \"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a\") " pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:08.586963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.586862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gpbq\" (UniqueName: \"kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq\") pod \"test-curl-7435-140134186897840\" (UID: \"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a\") " pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:08.596887 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.596850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gpbq\" (UniqueName: \"kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq\") pod \"test-curl-7435-140134186897840\" (UID: \"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a\") " pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:08.628352 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.628320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:08.793641 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.793605    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186897840"]
Jul 22 19:42:08.801113 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:08.801082    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc09a2c1f_c713_4b0d_8b50_1ab2b5e3a04a.slice/crio-d9ef46a66f83eda54158973d154ed795e63ba1257b69b9d80d262c42c77bd8ae WatchSource:0}: Error finding container d9ef46a66f83eda54158973d154ed795e63ba1257b69b9d80d262c42c77bd8ae: Status 404 returned error can't find the container with id d9ef46a66f83eda54158973d154ed795e63ba1257b69b9d80d262c42c77bd8ae
Jul 22 19:42:08.802588 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:08.802569    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 19:42:09.635457 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:09.635414    2578 generic.go:356] "Generic (PLEG): container finished" podID="c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" containerID="192edf36f34bc2679f659bae5488f97e2010d71f25d76e81bf4ababfc016cb55" exitCode=0
Jul 22 19:42:09.635848 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:09.635475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186897840" event={"ID":"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a","Type":"ContainerDied","Data":"192edf36f34bc2679f659bae5488f97e2010d71f25d76e81bf4ababfc016cb55"}
Jul 22 19:42:09.635848 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:09.635510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186897840" event={"ID":"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a","Type":"ContainerStarted","Data":"d9ef46a66f83eda54158973d154ed795e63ba1257b69b9d80d262c42c77bd8ae"}
Jul 22 19:42:10.778374 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.778349    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:10.798092 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.798062    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134186897840_c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a/test-curl-7435-140134186897840/0.log"
Jul 22 19:42:10.821525 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.821476    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134186897840"]
Jul 22 19:42:10.826124 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.826079    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134186897840"]
Jul 22 19:42:10.907966 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.907870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gpbq\" (UniqueName: \"kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq\") pod \"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a\" (UID: \"c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a\") "
Jul 22 19:42:10.910435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.910406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq" (OuterVolumeSpecName: "kube-api-access-6gpbq") pod "c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" (UID: "c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a"). InnerVolumeSpecName "kube-api-access-6gpbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:10.920391 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.920357    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" path="/var/lib/kubelet/pods/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a/volumes"
Jul 22 19:42:10.953732 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.953694    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134187033136"]
Jul 22 19:42:10.954130 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.954110    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" containerName="test-curl-7435-140134186897840"
Jul 22 19:42:10.954242 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.954134    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" containerName="test-curl-7435-140134186897840"
Jul 22 19:42:10.954310 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.954284    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a" containerName="test-curl-7435-140134186897840"
Jul 22 19:42:10.957345 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.957320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:10.961479 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:10.961450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134187033136"]
Jul 22 19:42:11.009129 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.009091    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gpbq\" (UniqueName: \"kubernetes.io/projected/c09a2c1f-c713-4b0d-8b50-1ab2b5e3a04a-kube-api-access-6gpbq\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:11.110125 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.110088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z528q\" (UniqueName: \"kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q\") pod \"test-curl-7435-140134187033136\" (UID: \"cfac825d-87f0-4652-a87c-7b2645434575\") " pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:11.211283 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.211113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z528q\" (UniqueName: \"kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q\") pod \"test-curl-7435-140134187033136\" (UID: \"cfac825d-87f0-4652-a87c-7b2645434575\") " pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:11.219459 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.219430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z528q\" (UniqueName: \"kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q\") pod \"test-curl-7435-140134187033136\" (UID: \"cfac825d-87f0-4652-a87c-7b2645434575\") " pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:11.268657 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.268618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:11.408048 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.408010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134187033136"]
Jul 22 19:42:11.411149 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:11.411124    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfac825d_87f0_4652_a87c_7b2645434575.slice/crio-074dc6eafdf5f7653cca99c42df6d8bf16608de9cb34b30474994612d4d77090 WatchSource:0}: Error finding container 074dc6eafdf5f7653cca99c42df6d8bf16608de9cb34b30474994612d4d77090: Status 404 returned error can't find the container with id 074dc6eafdf5f7653cca99c42df6d8bf16608de9cb34b30474994612d4d77090
Jul 22 19:42:11.646364 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.646340    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186897840"
Jul 22 19:42:11.646364 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.646359    2578 scope.go:117] "RemoveContainer" containerID="192edf36f34bc2679f659bae5488f97e2010d71f25d76e81bf4ababfc016cb55"
Jul 22 19:42:11.647732 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:11.647636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134187033136" event={"ID":"cfac825d-87f0-4652-a87c-7b2645434575","Type":"ContainerStarted","Data":"074dc6eafdf5f7653cca99c42df6d8bf16608de9cb34b30474994612d4d77090"}
Jul 22 19:42:12.654347 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:12.654309    2578 generic.go:356] "Generic (PLEG): container finished" podID="cfac825d-87f0-4652-a87c-7b2645434575" containerID="ce73ded94685f55f37698722c197fbe5cf2a80a11759daa82b974317f3253ef8" exitCode=0
Jul 22 19:42:12.654764 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:12.654354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134187033136" event={"ID":"cfac825d-87f0-4652-a87c-7b2645434575","Type":"ContainerDied","Data":"ce73ded94685f55f37698722c197fbe5cf2a80a11759daa82b974317f3253ef8"}
Jul 22 19:42:13.800108 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.800077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:13.819824 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.819790    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134187033136_cfac825d-87f0-4652-a87c-7b2645434575/test-curl-7435-140134187033136/0.log"
Jul 22 19:42:13.841867 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.841835    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134187033136"]
Jul 22 19:42:13.848374 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.848342    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134187033136"]
Jul 22 19:42:13.937240 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.937115    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z528q\" (UniqueName: \"kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q\") pod \"cfac825d-87f0-4652-a87c-7b2645434575\" (UID: \"cfac825d-87f0-4652-a87c-7b2645434575\") "
Jul 22 19:42:13.939442 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:13.939402    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q" (OuterVolumeSpecName: "kube-api-access-z528q") pod "cfac825d-87f0-4652-a87c-7b2645434575" (UID: "cfac825d-87f0-4652-a87c-7b2645434575"). InnerVolumeSpecName "kube-api-access-z528q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:14.004587 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.004547    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:14.004928 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.004914    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfac825d-87f0-4652-a87c-7b2645434575" containerName="test-curl-7435-140134187033136"
Jul 22 19:42:14.004974 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.004929    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfac825d-87f0-4652-a87c-7b2645434575" containerName="test-curl-7435-140134187033136"
Jul 22 19:42:14.005007 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.005001    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfac825d-87f0-4652-a87c-7b2645434575" containerName="test-curl-7435-140134187033136"
Jul 22 19:42:14.008069 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.008051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:14.015874 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.015786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:14.038325 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.038286    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z528q\" (UniqueName: \"kubernetes.io/projected/cfac825d-87f0-4652-a87c-7b2645434575-kube-api-access-z528q\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:14.139288 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.139250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvb8z\" (UniqueName: \"kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z\") pod \"test-curl-7435-140134186996768\" (UID: \"71dcee18-2908-46d8-9fc7-eba3d68a1185\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:14.240689 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.240591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvb8z\" (UniqueName: \"kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z\") pod \"test-curl-7435-140134186996768\" (UID: \"71dcee18-2908-46d8-9fc7-eba3d68a1185\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:14.248767 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.248742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvb8z\" (UniqueName: \"kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z\") pod \"test-curl-7435-140134186996768\" (UID: \"71dcee18-2908-46d8-9fc7-eba3d68a1185\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:14.319009 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.318966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:14.462094 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.462061    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:14.465882 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:14.465848    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71dcee18_2908_46d8_9fc7_eba3d68a1185.slice/crio-7e9ef6485de8f3f52a56d38919e748fc78346066e66c166b131aa6cea79131df WatchSource:0}: Error finding container 7e9ef6485de8f3f52a56d38919e748fc78346066e66c166b131aa6cea79131df: Status 404 returned error can't find the container with id 7e9ef6485de8f3f52a56d38919e748fc78346066e66c166b131aa6cea79131df
Jul 22 19:42:14.665408 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.665364    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:14.665408 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.665401    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="074dc6eafdf5f7653cca99c42df6d8bf16608de9cb34b30474994612d4d77090"
Jul 22 19:42:14.673116 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.673072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186996768" event={"ID":"71dcee18-2908-46d8-9fc7-eba3d68a1185","Type":"ContainerStarted","Data":"7e9ef6485de8f3f52a56d38919e748fc78346066e66c166b131aa6cea79131df"}
Jul 22 19:42:14.679115 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:42:14.679082    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7435-140134187033136\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="cfac825d-87f0-4652-a87c-7b2645434575" pod="opendatahub/test-curl-7435-140134187033136"
Jul 22 19:42:14.919789 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:14.919743    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfac825d-87f0-4652-a87c-7b2645434575" path="/var/lib/kubelet/pods/cfac825d-87f0-4652-a87c-7b2645434575/volumes"
Jul 22 19:42:15.679810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:15.679774    2578 generic.go:356] "Generic (PLEG): container finished" podID="71dcee18-2908-46d8-9fc7-eba3d68a1185" containerID="864536d2dac0f00330e04db38a420bd5ce5bf16a40ba8760042f0fc2ff6e7c1c" exitCode=0
Jul 22 19:42:15.680012 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:15.679828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186996768" event={"ID":"71dcee18-2908-46d8-9fc7-eba3d68a1185","Type":"ContainerDied","Data":"864536d2dac0f00330e04db38a420bd5ce5bf16a40ba8760042f0fc2ff6e7c1c"}
Jul 22 19:42:16.826596 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.826557    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:16.844759 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.844728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134186996768_71dcee18-2908-46d8-9fc7-eba3d68a1185/test-curl-7435-140134186996768/0.log"
Jul 22 19:42:16.866773 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.866721    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:16.869011 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.868983    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:16.966832 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.966734    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvb8z\" (UniqueName: \"kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z\") pod \"71dcee18-2908-46d8-9fc7-eba3d68a1185\" (UID: \"71dcee18-2908-46d8-9fc7-eba3d68a1185\") "
Jul 22 19:42:16.969124 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.969095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z" (OuterVolumeSpecName: "kube-api-access-mvb8z") pod "71dcee18-2908-46d8-9fc7-eba3d68a1185" (UID: "71dcee18-2908-46d8-9fc7-eba3d68a1185"). InnerVolumeSpecName "kube-api-access-mvb8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:16.982352 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.982319    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:16.982699 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.982685    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71dcee18-2908-46d8-9fc7-eba3d68a1185" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:16.982745 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.982702    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="71dcee18-2908-46d8-9fc7-eba3d68a1185" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:16.982780 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.982771    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="71dcee18-2908-46d8-9fc7-eba3d68a1185" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:16.985767 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.985749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:16.989643 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:16.989601    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:17.068414 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.068372    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvb8z\" (UniqueName: \"kubernetes.io/projected/71dcee18-2908-46d8-9fc7-eba3d68a1185-kube-api-access-mvb8z\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:17.169301 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.169262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6pn\" (UniqueName: \"kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn\") pod \"test-curl-7435-140134186996768\" (UID: \"53e6aaa0-89f4-4564-beb8-070ebe3afed3\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:17.270492 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.270386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6pn\" (UniqueName: \"kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn\") pod \"test-curl-7435-140134186996768\" (UID: \"53e6aaa0-89f4-4564-beb8-070ebe3afed3\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:17.278987 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.278956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6pn\" (UniqueName: \"kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn\") pod \"test-curl-7435-140134186996768\" (UID: \"53e6aaa0-89f4-4564-beb8-070ebe3afed3\") " pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:17.298138 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.298103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:17.446197 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.446164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:17.448603 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:17.448568    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53e6aaa0_89f4_4564_beb8_070ebe3afed3.slice/crio-51ccb4d59abd39a6b1caf5d74040aeca9a9cf494c0fae6bcc8957dd81f74d691 WatchSource:0}: Error finding container 51ccb4d59abd39a6b1caf5d74040aeca9a9cf494c0fae6bcc8957dd81f74d691: Status 404 returned error can't find the container with id 51ccb4d59abd39a6b1caf5d74040aeca9a9cf494c0fae6bcc8957dd81f74d691
Jul 22 19:42:17.690450 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.690421    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:17.690658 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.690464    2578 scope.go:117] "RemoveContainer" containerID="864536d2dac0f00330e04db38a420bd5ce5bf16a40ba8760042f0fc2ff6e7c1c"
Jul 22 19:42:17.691841 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:17.691818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186996768" event={"ID":"53e6aaa0-89f4-4564-beb8-070ebe3afed3","Type":"ContainerStarted","Data":"51ccb4d59abd39a6b1caf5d74040aeca9a9cf494c0fae6bcc8957dd81f74d691"}
Jul 22 19:42:18.700498 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:18.700462    2578 generic.go:356] "Generic (PLEG): container finished" podID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" containerID="5de55ffdb58dd686a3f077ac912a5106e06c337a1b94cbce7fb9cbd2494f1659" exitCode=0
Jul 22 19:42:18.700905 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:18.700558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186996768" event={"ID":"53e6aaa0-89f4-4564-beb8-070ebe3afed3","Type":"ContainerDied","Data":"5de55ffdb58dd686a3f077ac912a5106e06c337a1b94cbce7fb9cbd2494f1659"}
Jul 22 19:42:18.920530 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:18.920493    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71dcee18-2908-46d8-9fc7-eba3d68a1185" path="/var/lib/kubelet/pods/71dcee18-2908-46d8-9fc7-eba3d68a1185/volumes"
Jul 22 19:42:19.845351 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.845319    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:19.864882 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.864853    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134186996768_53e6aaa0-89f4-4564-beb8-070ebe3afed3/test-curl-7435-140134186996768/0.log"
Jul 22 19:42:19.888495 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.888455    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:19.893145 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.893114    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134186996768"]
Jul 22 19:42:19.992449 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.992354    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz6pn\" (UniqueName: \"kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn\") pod \"53e6aaa0-89f4-4564-beb8-070ebe3afed3\" (UID: \"53e6aaa0-89f4-4564-beb8-070ebe3afed3\") "
Jul 22 19:42:19.994707 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:19.994682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn" (OuterVolumeSpecName: "kube-api-access-wz6pn") pod "53e6aaa0-89f4-4564-beb8-070ebe3afed3" (UID: "53e6aaa0-89f4-4564-beb8-070ebe3afed3"). InnerVolumeSpecName "kube-api-access-wz6pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:20.012010 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.011969    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:20.012405 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.012390    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:20.012460 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.012407    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:20.012492 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.012475    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" containerName="test-curl-7435-140134186996768"
Jul 22 19:42:20.015393 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.015375    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:20.026496 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.026466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:20.093950 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.093909    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz6pn\" (UniqueName: \"kubernetes.io/projected/53e6aaa0-89f4-4564-beb8-070ebe3afed3-kube-api-access-wz6pn\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:20.194841 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.194796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhdf\" (UniqueName: \"kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf\") pod \"test-curl-7435-140134186997776\" (UID: \"9ece29f2-38df-4a51-b140-e79d26056fe7\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:20.296048 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.295956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhdf\" (UniqueName: \"kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf\") pod \"test-curl-7435-140134186997776\" (UID: \"9ece29f2-38df-4a51-b140-e79d26056fe7\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:20.303966 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.303931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhdf\" (UniqueName: \"kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf\") pod \"test-curl-7435-140134186997776\" (UID: \"9ece29f2-38df-4a51-b140-e79d26056fe7\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:20.325696 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.325653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:20.490186 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.490012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:20.492906 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:20.492863    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ece29f2_38df_4a51_b140_e79d26056fe7.slice/crio-aa1cb86f88763dfcee7dab1e57da137e909280dac0e3ffd4a4d524f1fc0cbfbf WatchSource:0}: Error finding container aa1cb86f88763dfcee7dab1e57da137e909280dac0e3ffd4a4d524f1fc0cbfbf: Status 404 returned error can't find the container with id aa1cb86f88763dfcee7dab1e57da137e909280dac0e3ffd4a4d524f1fc0cbfbf
Jul 22 19:42:20.711403 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.711370    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:20.711403 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.711402    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51ccb4d59abd39a6b1caf5d74040aeca9a9cf494c0fae6bcc8957dd81f74d691"
Jul 22 19:42:20.712668 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.712629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186997776" event={"ID":"9ece29f2-38df-4a51-b140-e79d26056fe7","Type":"ContainerStarted","Data":"aa1cb86f88763dfcee7dab1e57da137e909280dac0e3ffd4a4d524f1fc0cbfbf"}
Jul 22 19:42:20.722159 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:42:20.722129    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7435-140134186996768\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" pod="opendatahub/test-curl-7435-140134186996768"
Jul 22 19:42:20.920649 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:20.920611    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e6aaa0-89f4-4564-beb8-070ebe3afed3" path="/var/lib/kubelet/pods/53e6aaa0-89f4-4564-beb8-070ebe3afed3/volumes"
Jul 22 19:42:21.493345 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.493303    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" podUID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" containerName="main" containerID="cri-o://d935753947a541c8b0bf2cdffd4cd8b83546e8eee3c581d0e8cd758b043b348b" gracePeriod=45
Jul 22 19:42:21.721563 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.721519    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ece29f2-38df-4a51-b140-e79d26056fe7" containerID="624eba2004c8a9ac82a7e9072f677202671744503daee16e9617cfde02f62bb6" exitCode=0
Jul 22 19:42:21.721772 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.721607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186997776" event={"ID":"9ece29f2-38df-4a51-b140-e79d26056fe7","Type":"ContainerDied","Data":"624eba2004c8a9ac82a7e9072f677202671744503daee16e9617cfde02f62bb6"}
Jul 22 19:42:21.723538 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.723509    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" containerID="d935753947a541c8b0bf2cdffd4cd8b83546e8eee3c581d0e8cd758b043b348b" exitCode=0
Jul 22 19:42:21.723651 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.723542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" event={"ID":"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd","Type":"ContainerDied","Data":"d935753947a541c8b0bf2cdffd4cd8b83546e8eee3c581d0e8cd758b043b348b"}
Jul 22 19:42:21.748899 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.748829    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:42:21.911388 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911351    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911388 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911671 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911671 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911671 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911500    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w8bq\" (UniqueName: \"kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911671 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911520    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm\") pod \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\" (UID: \"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd\") "
Jul 22 19:42:21.911868 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911714    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home" (OuterVolumeSpecName: "home") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:42:21.911868 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:42:21.911868 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911795    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:42:21.911969 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911880    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-home\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:21.911969 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911898    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-model-cache\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:21.911969 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.911913    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tmp-dir\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:21.913834 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.913807    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq" (OuterVolumeSpecName: "kube-api-access-7w8bq") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "kube-api-access-7w8bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:21.913931 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.913807    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm" (OuterVolumeSpecName: "dshm") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 19:42:21.913931 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:21.913861    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" (UID: "f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 19:42:22.012819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.012716    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-tls-certs\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:22.012819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.012753    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w8bq\" (UniqueName: \"kubernetes.io/projected/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-kube-api-access-7w8bq\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:22.012819 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.012762    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd-dshm\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:22.729544 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.729504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9" event={"ID":"f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd","Type":"ContainerDied","Data":"061bc0b9661628b0841043ed2308f3daf03ce17bf0e60172292fbeaeee06d864"}
Jul 22 19:42:22.729544 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.729530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"
Jul 22 19:42:22.729778 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.729571    2578 scope.go:117] "RemoveContainer" containerID="d935753947a541c8b0bf2cdffd4cd8b83546e8eee3c581d0e8cd758b043b348b"
Jul 22 19:42:22.753438 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.753398    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:42:22.757755 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.757715    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-938311/rate-test-model-938311-kserve-7bdf549bff-t2pb9"]
Jul 22 19:42:22.887171 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.887143    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:22.906638 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.906608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134186997776_9ece29f2-38df-4a51-b140-e79d26056fe7/test-curl-7435-140134186997776/0.log"
Jul 22 19:42:22.919081 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.919054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbhdf\" (UniqueName: \"kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf\") pod \"9ece29f2-38df-4a51-b140-e79d26056fe7\" (UID: \"9ece29f2-38df-4a51-b140-e79d26056fe7\") "
Jul 22 19:42:22.921361 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.921329    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" path="/var/lib/kubelet/pods/f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd/volumes"
Jul 22 19:42:22.921513 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.921486    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf" (OuterVolumeSpecName: "kube-api-access-pbhdf") pod "9ece29f2-38df-4a51-b140-e79d26056fe7" (UID: "9ece29f2-38df-4a51-b140-e79d26056fe7"). InnerVolumeSpecName "kube-api-access-pbhdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:22.929032 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.928998    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:22.931549 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:22.931525    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:23.020264 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.020114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbhdf\" (UniqueName: \"kubernetes.io/projected/9ece29f2-38df-4a51-b140-e79d26056fe7-kube-api-access-pbhdf\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:23.050750 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.050710    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:23.051088 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051074    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" containerName="main"
Jul 22 19:42:23.051127 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051090    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" containerName="main"
Jul 22 19:42:23.051127 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051120    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ece29f2-38df-4a51-b140-e79d26056fe7" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:23.051127 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051126    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ece29f2-38df-4a51-b140-e79d26056fe7" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:23.051287 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051183    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ece29f2-38df-4a51-b140-e79d26056fe7" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:23.051287 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.051193    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a99c5d-b45a-48c3-8e44-9f83fa3ebfdd" containerName="main"
Jul 22 19:42:23.054295 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.054276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.063136 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.061440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:23.121469 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.121419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xltw\" (UniqueName: \"kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw\") pod \"test-curl-7435-140134186997776\" (UID: \"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.222810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.222760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xltw\" (UniqueName: \"kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw\") pod \"test-curl-7435-140134186997776\" (UID: \"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.231307 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.231283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xltw\" (UniqueName: \"kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw\") pod \"test-curl-7435-140134186997776\" (UID: \"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093\") " pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.371947 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.371846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.514623 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.514594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:23.516900 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:23.516869    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3ea9a86_0e30_4dc8_bef0_fb7d1d37f093.slice/crio-e830f9af568ea41bcb1cbba6e6e6805e29b261069c608f1550385590a50505c6 WatchSource:0}: Error finding container e830f9af568ea41bcb1cbba6e6e6805e29b261069c608f1550385590a50505c6: Status 404 returned error can't find the container with id e830f9af568ea41bcb1cbba6e6e6805e29b261069c608f1550385590a50505c6
Jul 22 19:42:23.735778 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.735751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:23.735778 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.735765    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa1cb86f88763dfcee7dab1e57da137e909280dac0e3ffd4a4d524f1fc0cbfbf"
Jul 22 19:42:23.738400 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.738369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186997776" event={"ID":"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093","Type":"ContainerStarted","Data":"e830f9af568ea41bcb1cbba6e6e6805e29b261069c608f1550385590a50505c6"}
Jul 22 19:42:23.742093 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:23.742060    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7435-140134186997776" oldPodUID="9ece29f2-38df-4a51-b140-e79d26056fe7" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093"
Jul 22 19:42:24.745054 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:24.745020    2578 generic.go:356] "Generic (PLEG): container finished" podID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" containerID="0fb43c9dbcd28599df8ac7484c6493a2996e18d118f5acd9688c655d72ce367a" exitCode=0
Jul 22 19:42:24.745458 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:24.745075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7435-140134186997776" event={"ID":"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093","Type":"ContainerDied","Data":"0fb43c9dbcd28599df8ac7484c6493a2996e18d118f5acd9688c655d72ce367a"}
Jul 22 19:42:24.920049 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:24.920014    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ece29f2-38df-4a51-b140-e79d26056fe7" path="/var/lib/kubelet/pods/9ece29f2-38df-4a51-b140-e79d26056fe7/volumes"
Jul 22 19:42:25.897771 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.897742    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:25.916079 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.916040    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7435-140134186997776_b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093/test-curl-7435-140134186997776/0.log"
Jul 22 19:42:25.936831 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.936791    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:25.940938 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.940907    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7435-140134186997776"]
Jul 22 19:42:25.944486 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.944462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xltw\" (UniqueName: \"kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw\") pod \"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093\" (UID: \"b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093\") "
Jul 22 19:42:25.946750 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:25.946722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw" (OuterVolumeSpecName: "kube-api-access-9xltw") pod "b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" (UID: "b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093"). InnerVolumeSpecName "kube-api-access-9xltw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 19:42:26.045744 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.045642    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xltw\" (UniqueName: \"kubernetes.io/projected/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093-kube-api-access-9xltw\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:26.114202 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.114161    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"]
Jul 22 19:42:26.114573 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.114558    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:26.114630 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.114576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:26.114664 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.114652    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" containerName="test-curl-7435-140134186997776"
Jul 22 19:42:26.117417 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.117399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:26.119756 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.119732    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 19:42:26.119888 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.119791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jhv4j\""
Jul 22 19:42:26.124225 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.124174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"]
Jul 22 19:42:26.146115 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.146077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-938311-fdw9s\" (UID: \"4a86fed6-c912-4d4c-9785-01bb96767b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:26.247016 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.246978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-938311-fdw9s\" (UID: \"4a86fed6-c912-4d4c-9785-01bb96767b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:26.247631 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.247610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-938311-fdw9s\" (UID: \"4a86fed6-c912-4d4c-9785-01bb96767b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:26.429540 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.429503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:26.582497 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.582467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"]
Jul 22 19:42:26.584311 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:42:26.584279    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a86fed6_c912_4d4c_9785_01bb96767b4c.slice/crio-614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1 WatchSource:0}: Error finding container 614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1: Status 404 returned error can't find the container with id 614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1
Jul 22 19:42:26.678182 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.678126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:26.759810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.759714    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:26.759810 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.759742    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e830f9af568ea41bcb1cbba6e6e6805e29b261069c608f1550385590a50505c6"
Jul 22 19:42:26.761166 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.761140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s" event={"ID":"4a86fed6-c912-4d4c-9785-01bb96767b4c","Type":"ContainerStarted","Data":"614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1"}
Jul 22 19:42:26.771092 ip-10-0-129-246 kubenswrapper[2578]: E0722 19:42:26.771059    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7435-140134186997776\" is forbidden: User \"system:node:ip-10-0-129-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-246.ec2.internal' and this object" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" pod="opendatahub/test-curl-7435-140134186997776"
Jul 22 19:42:26.778880 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.778839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:26.920404 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:26.920363    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093" path="/var/lib/kubelet/pods/b3ea9a86-0e30-4dc8-bef0-fb7d1d37f093/volumes"
Jul 22 19:42:29.781999 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:29.781888    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a86fed6-c912-4d4c-9785-01bb96767b4c" containerID="e2d91c47321c327f738e7110962c7a0ce772487485f070d09f26e757349d42f0" exitCode=0
Jul 22 19:42:29.781999 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:29.781967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s" event={"ID":"4a86fed6-c912-4d4c-9785-01bb96767b4c","Type":"ContainerDied","Data":"e2d91c47321c327f738e7110962c7a0ce772487485f070d09f26e757349d42f0"}
Jul 22 19:42:30.925779 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:30.925752    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:31.084361 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.084257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca\") pod \"4a86fed6-c912-4d4c-9785-01bb96767b4c\" (UID: \"4a86fed6-c912-4d4c-9785-01bb96767b4c\") "
Jul 22 19:42:31.084636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.084609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a86fed6-c912-4d4c-9785-01bb96767b4c" (UID: "4a86fed6-c912-4d4c-9785-01bb96767b4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 19:42:31.184889 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.184838    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a86fed6-c912-4d4c-9785-01bb96767b4c-maas-api-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 22 19:42:31.792452 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.792418    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"
Jul 22 19:42:31.792636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.792417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s" event={"ID":"4a86fed6-c912-4d4c-9785-01bb96767b4c","Type":"ContainerDied","Data":"614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1"}
Jul 22 19:42:31.792636 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:31.792552    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="614ae0de7f850eda52757a22005e4279d848b2c9344268c3e3d588b860c5ebf1"
Jul 22 19:42:36.530642 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:36.530601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:41.186274 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:41.186227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:41.200830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:41.200789    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"]
Jul 22 19:42:41.203471 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:41.203444    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-938311-fdw9s"]
Jul 22 19:42:41.597482 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:41.597381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:42.556163 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:42.556116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:42.657369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:42.657330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:42.919781 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:42.919745    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a86fed6-c912-4d4c-9785-01bb96767b4c" path="/var/lib/kubelet/pods/4a86fed6-c912-4d4c-9785-01bb96767b4c/volumes"
Jul 22 19:42:47.451016 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:47.450975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:47.511553 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:47.511518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:47.708581 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:47.708479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:47.932435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:47.932399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:48.553435 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:48.553397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:48.658255 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:48.658203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:42:58.453799 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:42:58.453762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:03.154673 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:03.154584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:03.512275 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:03.512124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:09.507616 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:09.507574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:09.565136 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:09.565101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:09.810449 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:09.810354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:10.040772 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:10.040731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:10.788415 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:10.788375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:10.888271 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:10.888232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:16.585223 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:16.585175    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb586fcb5-rdsfb_414c559a-c298-4016-a655-5b9747dfc997/copy-manifests/0.log"
Jul 22 19:43:16.603999 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:16.603966    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb586fcb5-rdsfb_414c559a-c298-4016-a655-5b9747dfc997/manager/0.log"
Jul 22 19:43:18.861774 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:18.861737    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sdq9z_fb8d453f-0bac-4a43-bb68-de855528fa7d/kuadrant-console-plugin/0.log"
Jul 22 19:43:19.102292 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:19.102261    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5cs79_7af7d958-97fd-4a7d-bb06-59f33b603174/manager/0.log"
Jul 22 19:43:20.011167 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:20.011137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69768f7b48-t6vk4_a8fe853c-20b7-44d4-94e6-7e61f69761c3/kube-auth-proxy/0.log"
Jul 22 19:43:20.374278 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:20.374156    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-524m4_8ed29aed-8dce-4c0e-9442-425f6d45ea6c/payload-processing/0.log"
Jul 22 19:43:21.040697 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:21.040669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-g4v6r_2df1cd02-73c7-4e69-a26d-5eb1c5880cc5/main/0.log"
Jul 22 19:43:21.271749 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:21.271707    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-h5k8j_e78062a6-aefc-46cc-98d7-0f1a8124a23a/main/0.log"
Jul 22 19:43:21.379599 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:21.379512    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dzwmb_d0622e10-7f89-447b-86be-0ce64b8e1c2e/main/0.log"
Jul 22 19:43:26.585972 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:26.585933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:26.649700 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:26.649670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log" limit=1024
Jul 22 19:43:29.184128 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:29.184092    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5h2rj_255cc3cf-03c9-4f0e-a802-aa20b542aa34/global-pull-secret-syncer/0.log"
Jul 22 19:43:29.314155 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:29.314109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f2grc_f8026137-167f-411c-8dfa-3304c8739514/konnectivity-agent/0.log"
Jul 22 19:43:29.398651 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:29.398618    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-246.ec2.internal_4b1dd8c2174ce1853b1e15b0d6ee0318/haproxy/0.log"
Jul 22 19:43:34.784451 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:34.784417    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sdq9z_fb8d453f-0bac-4a43-bb68-de855528fa7d/kuadrant-console-plugin/0.log"
Jul 22 19:43:35.050304 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:35.050180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5cs79_7af7d958-97fd-4a7d-bb06-59f33b603174/manager/0.log"
Jul 22 19:43:37.192587 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.192556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l46z_2e2c3183-c792-48e3-a4e1-ab24d5432b35/node-exporter/0.log"
Jul 22 19:43:37.212547 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.212516    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l46z_2e2c3183-c792-48e3-a4e1-ab24d5432b35/kube-rbac-proxy/0.log"
Jul 22 19:43:37.234409 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.234378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l46z_2e2c3183-c792-48e3-a4e1-ab24d5432b35/init-textfile/0.log"
Jul 22 19:43:37.480340 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.480244    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/prometheus/0.log"
Jul 22 19:43:37.499238 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.499197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/config-reloader/0.log"
Jul 22 19:43:37.517610 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.517586    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/thanos-sidecar/0.log"
Jul 22 19:43:37.545254 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.545203    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/kube-rbac-proxy-web/0.log"
Jul 22 19:43:37.562338 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.562310    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/kube-rbac-proxy/0.log"
Jul 22 19:43:37.583067 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.583042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/kube-rbac-proxy-thanos/0.log"
Jul 22 19:43:37.603085 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.603060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1753bfed-91f1-41c4-b951-77ff69fd7d7e/init-config-reloader/0.log"
Jul 22 19:43:37.658830 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.658796    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-lcjw6_d3fb8957-4cbd-4fac-b9e3-d006d81416d8/prometheus-operator/0.log"
Jul 22 19:43:37.674068 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.674050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-lcjw6_d3fb8957-4cbd-4fac-b9e3-d006d81416d8/kube-rbac-proxy/0.log"
Jul 22 19:43:37.693645 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.693619    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-q94jf_fab65765-ff68-42e6-a486-53714341c818/prometheus-operator-admission-webhook/0.log"
Jul 22 19:43:37.792937 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.792862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/thanos-query/0.log"
Jul 22 19:43:37.817264 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.817236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/kube-rbac-proxy-web/0.log"
Jul 22 19:43:37.838598 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.838564    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/kube-rbac-proxy/0.log"
Jul 22 19:43:37.863354 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.863326    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/prom-label-proxy/0.log"
Jul 22 19:43:37.882463 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.882435    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/kube-rbac-proxy-rules/0.log"
Jul 22 19:43:37.901312 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:37.901277    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc4f58bf6-cdwdg_f39b968c-c8e5-424c-8cac-2a084c83e267/kube-rbac-proxy-metrics/0.log"
Jul 22 19:43:39.016769 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.016734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-wnhx8_cc390638-32ec-45c7-94bf-4dc9f2cbf94d/networking-console-plugin/0.log"
Jul 22 19:43:39.222259 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.222224    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"]
Jul 22 19:43:39.222614 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.222601    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a86fed6-c912-4d4c-9785-01bb96767b4c" containerName="revoke-keys"
Jul 22 19:43:39.222657 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.222616    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a86fed6-c912-4d4c-9785-01bb96767b4c" containerName="revoke-keys"
Jul 22 19:43:39.222692 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.222684    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a86fed6-c912-4d4c-9785-01bb96767b4c" containerName="revoke-keys"
Jul 22 19:43:39.225963 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.225941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.228344 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.228321    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mw4wd\"/\"kube-root-ca.crt\""
Jul 22 19:43:39.229129 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.229108    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mw4wd\"/\"openshift-service-ca.crt\""
Jul 22 19:43:39.229262 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.229162    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mw4wd\"/\"default-dockercfg-lwfnl\""
Jul 22 19:43:39.234082 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.234060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"]
Jul 22 19:43:39.315962 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.315856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-sys\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.315962 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.315898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-lib-modules\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.315962 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.315921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rm9\" (UniqueName: \"kubernetes.io/projected/abb2c305-05ab-4403-afdd-29915d57acba-kube-api-access-48rm9\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.316255 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.315969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-podres\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.316255 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.316016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-proc\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.416812 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-lib-modules\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.416812 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rm9\" (UniqueName: \"kubernetes.io/projected/abb2c305-05ab-4403-afdd-29915d57acba-kube-api-access-48rm9\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-podres\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-proc\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-lib-modules\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.416985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-sys\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.417039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-sys\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.417054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-podres\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.417073 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.417069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abb2c305-05ab-4403-afdd-29915d57acba-proc\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.424758 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.424730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rm9\" (UniqueName: \"kubernetes.io/projected/abb2c305-05ab-4403-afdd-29915d57acba-kube-api-access-48rm9\") pod \"perf-node-gather-daemonset-9pd8n\" (UID: \"abb2c305-05ab-4403-afdd-29915d57acba\") " pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.536394 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.536345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:39.673115 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:39.673091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"]
Jul 22 19:43:39.675017 ip-10-0-129-246 kubenswrapper[2578]: W0722 19:43:39.674989    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabb2c305_05ab_4403_afdd_29915d57acba.slice/crio-c6a3333df53a9923968d7610db3f0cbe13e24b8fdca08ae7fdea539fe27f2b05 WatchSource:0}: Error finding container c6a3333df53a9923968d7610db3f0cbe13e24b8fdca08ae7fdea539fe27f2b05: Status 404 returned error can't find the container with id c6a3333df53a9923968d7610db3f0cbe13e24b8fdca08ae7fdea539fe27f2b05
Jul 22 19:43:40.111368 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:40.111334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n" event={"ID":"abb2c305-05ab-4403-afdd-29915d57acba","Type":"ContainerStarted","Data":"55a237e214725387e05367d500fc5cbf693103b643523cfe88f495986f40f429"}
Jul 22 19:43:40.111790 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:40.111393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n" event={"ID":"abb2c305-05ab-4403-afdd-29915d57acba","Type":"ContainerStarted","Data":"c6a3333df53a9923968d7610db3f0cbe13e24b8fdca08ae7fdea539fe27f2b05"}
Jul 22 19:43:40.111790 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:40.111459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:40.126489 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:40.126413    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n" podStartSLOduration=1.126396158 podStartE2EDuration="1.126396158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 19:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:43:40.125831544 +0000 UTC m=+2821.694175927" watchObservedRunningTime="2026-07-22 19:43:40.126396158 +0000 UTC m=+2821.694740529"
Jul 22 19:43:40.274897 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:40.274864    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6s4jg_fe2cd89f-ad77-4285-9c13-5979e4bc1fbf/download-server/0.log"
Jul 22 19:43:41.932594 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:41.932554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8gwq_c89d952e-0451-4ac0-916b-af5497ccdb80/dns/0.log"
Jul 22 19:43:41.952091 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:41.952064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8gwq_c89d952e-0451-4ac0-916b-af5497ccdb80/kube-rbac-proxy/0.log"
Jul 22 19:43:42.018918 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:42.018884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fttc4_e70d5056-68cc-4459-828c-8991cc528fa1/dns-node-resolver/0.log"
Jul 22 19:43:42.538284 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:42.538253    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-858fcbcd6c-pwcxm_8082043c-8176-472c-a9b5-2718e9a0add4/registry/0.log"
Jul 22 19:43:42.558968 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:42.558940    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f7z2_38c11dbb-50be-4fc7-ab02-ac97b3be44d6/node-ca/0.log"
Jul 22 19:43:43.683863 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:43.683831    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69768f7b48-t6vk4_a8fe853c-20b7-44d4-94e6-7e61f69761c3/kube-auth-proxy/0.log"
Jul 22 19:43:43.808369 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:43.808338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-524m4_8ed29aed-8dce-4c0e-9442-425f6d45ea6c/payload-processing/0.log"
Jul 22 19:43:44.505287 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:44.505250    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d5849_893f3df3-d326-424b-aa96-b6f2387f4785/serve-healthcheck-canary/0.log"
Jul 22 19:43:44.995075 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:44.995036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cm6x_c22453af-daa6-455c-b426-448d2b619392/kube-rbac-proxy/0.log"
Jul 22 19:43:45.014448 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:45.014410    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cm6x_c22453af-daa6-455c-b426-448d2b619392/exporter/0.log"
Jul 22 19:43:45.034095 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:45.034064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cm6x_c22453af-daa6-455c-b426-448d2b619392/extractor/0.log"
Jul 22 19:43:46.125814 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:46.125787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mw4wd/perf-node-gather-daemonset-9pd8n"
Jul 22 19:43:47.786714 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:47.786683    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb586fcb5-rdsfb_414c559a-c298-4016-a655-5b9747dfc997/manager/0.log"
Jul 22 19:43:47.801579 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:47.801558    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb586fcb5-rdsfb_414c559a-c298-4016-a655-5b9747dfc997/copy-manifests/0.log"
Jul 22 19:43:49.201661 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:49.201634    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dd84c44d8-5wnbg_55742fef-6f94-476b-b3e7-423447a6119c/manager/0.log"
Jul 22 19:43:50.504535 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:50.504509    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69768f7b48-t6vk4_a8fe853c-20b7-44d4-94e6-7e61f69761c3/kube-auth-proxy/0.log"
Jul 22 19:43:50.621053 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:50.621019    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-524m4_8ed29aed-8dce-4c0e-9442-425f6d45ea6c/payload-processing/0.log"
Jul 22 19:43:51.932445 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:51.932416    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69768f7b48-t6vk4_a8fe853c-20b7-44d4-94e6-7e61f69761c3/kube-auth-proxy/0.log"
Jul 22 19:43:52.044223 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:52.044172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-524m4_8ed29aed-8dce-4c0e-9442-425f6d45ea6c/payload-processing/0.log"
Jul 22 19:43:55.716984 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.716957    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/kube-multus-additional-cni-plugins/0.log"
Jul 22 19:43:55.740327 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.740291    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/egress-router-binary-copy/0.log"
Jul 22 19:43:55.758932 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.758903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/cni-plugins/0.log"
Jul 22 19:43:55.777627 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.777597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/bond-cni-plugin/0.log"
Jul 22 19:43:55.796267 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.796236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/routeoverride-cni/0.log"
Jul 22 19:43:55.814782 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.814755    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/whereabouts-cni-bincopy/0.log"
Jul 22 19:43:55.833427 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.833398    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w46fs_cbf4cff1-8c41-4594-8622-eb727b6a04de/whereabouts-cni/0.log"
Jul 22 19:43:55.931440 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:55.931403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zt8n7_e3295bb0-66ba-48f0-9d6c-a12ebebcc17f/kube-multus/0.log"
Jul 22 19:43:56.036276 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:56.036137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrp45_faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb/network-metrics-daemon/0.log"
Jul 22 19:43:56.052643 ip-10-0-129-246 kubenswrapper[2578]: I0722 19:43:56.052618    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrp45_faf36ee6-9fe8-4e43-b2fb-7763dd06bfeb/kube-rbac-proxy/0.log"