Jul 27 15:48:17.810200 ip-10-0-141-100 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 15:48:18.174656 ip-10-0-141-100 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:18.174656 ip-10-0-141-100 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 15:48:18.174656 ip-10-0-141-100 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:18.174656 ip-10-0-141-100 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 15:48:18.174656 ip-10-0-141-100 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:18.176427 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.176276    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 15:48:18.183402 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183381    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.183402 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183398    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.183402 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183402    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.183402 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183405    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.183402 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183409    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183412    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183415    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183418    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183421    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183424    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183426    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183429    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183431    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183434    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183436    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183440    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183445    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183447    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183450    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183453    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183455    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183458    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183461    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183464    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.183601 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183467    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183469    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183473    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183475    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183478    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183481    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183484    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183486    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183489    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183491    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183494    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183496    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183499    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183501    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183506    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183511    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183514    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183517    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183520    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.184096 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183522    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183525    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183528    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183531    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183533    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183537    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183539    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183542    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183544    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183547    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183550    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183552    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183555    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183557    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183560    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183563    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183565    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183568    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183570    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183573    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.184607 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183575    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183578    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183581    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183583    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183586    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183590    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183594    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183598    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183601    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183604    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183607    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183610    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183613    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183616    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183619    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183622    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183624    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183627    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183630    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.185111 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183632    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183636    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183639    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183641    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183644    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183647    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183649    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183652    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183654    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183657    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183660    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183662    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183665    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183667    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183670    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183673    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.183675    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184409    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184419    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184422    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.185572 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184426    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184430    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184432    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184435    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184438    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184441    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184444    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184446    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184449    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184452    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184455    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184458    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184461    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184464    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184467    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184469    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184472    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184475    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184477    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184480    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.186062 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184482    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184484    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184487    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184490    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184493    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184495    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184498    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184500    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184511    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184514    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184516    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184519    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184521    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184524    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184526    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184529    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184531    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184534    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184537    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184539    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.186575 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184542    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184544    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184546    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184549    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184551    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184554    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184557    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184560    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184562    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184565    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184567    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184570    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184572    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184575    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184577    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184581    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184583    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184586    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184589    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184592    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.187075 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184594    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184597    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184599    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184602    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184605    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184607    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184610    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184613    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184615    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184620    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184623    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184625    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184628    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184630    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184633    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184635    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184638    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184641    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.187646 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184644    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184647    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184651    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184653    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184656    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184659    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184662    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184668    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184672    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184676    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184680    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184684    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184687    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184690    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184693    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184696    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184698    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.184701    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185137    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185144    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.188105 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185147    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185150    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185153    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185156    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185159    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185161    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185164    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185168    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185171    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185175    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185178    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185181    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185184    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185187    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185190    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185193    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185195    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185203    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185206    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.188592 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185211    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185214    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185216    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185219    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185222    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185225    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185227    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185230    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185234    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185238    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185241    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185244    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185246    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185249    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185251    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185254    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185256    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185259    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185261    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.189089 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185264    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185266    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185269    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185271    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185274    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185276    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185279    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185281    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185284    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185287    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185289    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185292    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185294    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185298    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185300    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185303    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185305    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185308    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185310    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185313    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.189528 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185316    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185319    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185321    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185324    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185326    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185329    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185331    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185333    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185336    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185340    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185343    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185345    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185348    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185350    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185352    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185355    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185357    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185360    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185362    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185364    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.190035 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185367    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185369    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185372    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185375    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185377    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185381    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185384    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185387    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185389    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185392    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185394    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185397    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185399    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185402    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185404    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185407    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185411    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185414    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.185417    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185486    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 15:48:18.190517 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185493    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185499    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185504    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185508    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185511    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185514    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185518    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185521    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185524    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185528    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185531    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185534    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185537    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185540    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185544    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185548    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185551    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185557    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185560    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185563    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185566    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185570    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185573    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 15:48:18.191019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185576    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185580    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185583    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185586    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185589    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185592    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185595    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185598    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185602    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185606    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185609    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185611    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185614    2573 flags.go:64] FLAG: --enable-server="true"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185617    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185622    2573 flags.go:64] FLAG: --event-burst="100"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185625    2573 flags.go:64] FLAG: --event-qps="50"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185628    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185631    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185634    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185638    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185641    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185644    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185647    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185651    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185654    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 15:48:18.191561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185657    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185661    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185664    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185667    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185670    2573 flags.go:64] FLAG: --feature-gates=""
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185673    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185676    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185679    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185682    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185685    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185688    2573 flags.go:64] FLAG: --help="false"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185691    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185694    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185697    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185700    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185703    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185706    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185709    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185712    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185715    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185717    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185720    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185723    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185726    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 27 15:48:18.192319 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185729    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185732    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185735    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185738    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185741    2573 flags.go:64] FLAG: --lock-file=""
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185743    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185747    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185751    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185756    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185760    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185763    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185766    2573 flags.go:64] FLAG: --logging-format="text"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185768    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185772    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185775    2573 flags.go:64] FLAG: --manifest-url=""
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185778    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185782    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185784    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185789    2573 flags.go:64] FLAG: --max-pods="110"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185791    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185794    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185797    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185800    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185803    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185806    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 15:48:18.192904 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185809    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185816    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185819    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185822    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185824    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185827    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185832    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185835    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185838    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185841    2573 flags.go:64] FLAG: --port="10250"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185844    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185847    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02fe7b6eea6ba5517"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185850    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185853    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185859    2573 flags.go:64] FLAG: --register-node="true"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185862    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185865    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185869    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185871    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185875    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185878    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185882    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185884    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185887    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185890    2573 flags.go:64] FLAG: --runonce="false"
Jul 27 15:48:18.193538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185892    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185895    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185898    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185901    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185904    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185907    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185910    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185913    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185915    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185918    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185921    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185923    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185927    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185930    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185932    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185938    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185940    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185943    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185947    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185950    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185952    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185969    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185972    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185976    2573 flags.go:64] FLAG: --v="2"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185979    2573 flags.go:64] FLAG: --version="false"
Jul 27 15:48:18.194170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185984    2573 flags.go:64] FLAG: --vmodule=""
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185988    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.185992    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186101    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186105    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186108    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186111    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186114    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186117    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186120    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186123    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186127    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186130    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186133    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186136    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186139    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186141    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186144    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186147    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.194752 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186149    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186152    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186154    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186158    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186160    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186163    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186165    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186169    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186172    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186178    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186181    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186184    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186187    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186190    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186193    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186196    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186199    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186201    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186204    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.195234 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186206    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186209    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186211    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186214    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186216    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186219    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186221    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186224    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186226    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186229    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186231    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186234    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186236    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186239    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186241    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186244    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186246    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186249    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186251    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186253    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.195685 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186256    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186258    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186264    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186266    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186269    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186271    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186274    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186276    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186279    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186282    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186284    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186287    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186290    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186292    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186295    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186297    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186300    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186302    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186305    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186308    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.196219 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186310    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186313    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186315    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186318    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186320    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186323    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186325    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186328    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186330    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186333    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186335    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186338    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186340    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186343    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186348    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186350    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186354    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186358    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186361    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.196731 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186364    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186366    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186369    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186372    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.186374    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.186936    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.193414    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.193432    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.193451    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.193457    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193510    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193517    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193521    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193524    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.197210 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193528    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193531    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193534    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193537    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193540    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193542    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193545    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193548    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193551    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193553    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193556    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193559    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193562    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193564    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193568    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193571    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193574    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193577    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193580    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193582    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.197574 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193585    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193588    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193591    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193594    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193596    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193600    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193604    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193606    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193610    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193614    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193616    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193619    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193621    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193624    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193627    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193629    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193632    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193634    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193637    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.198177 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193640    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193643    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193645    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193648    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193650    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193653    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193656    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193658    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193661    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193664    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193666    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193669    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193671    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193674    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193676    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193679    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193681    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193684    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193687    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193690    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.198690 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193692    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193695    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193697    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193700    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193702    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193705    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193707    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193710    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193712    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193715    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193718    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193720    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193723    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193726    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193728    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193731    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193733    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193736    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193738    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193741    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.199532 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193743    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193746    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193748    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193750    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193753    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193755    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193758    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193761    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193763    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193766    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193769    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193772    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193775    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193778    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193780    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.200182 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193783    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.193788    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193912    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193917    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193920    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193923    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193926    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193928    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193931    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193933    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193936    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193938    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193941    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193943    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193946    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:18.200557 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193948    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193951    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193969    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193974    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193978    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193981    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193984    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193986    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193989    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193991    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193994    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193997    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.193999    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194002    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194004    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194008    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194011    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194014    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194018    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:18.201031 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194021    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194024    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194027    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194030    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194033    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194035    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194038    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194040    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194043    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194046    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194048    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194051    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194053    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194056    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194058    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194061    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194063    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194066    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194068    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194071    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:18.201641 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194073    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194076    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194078    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194081    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194083    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194086    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194088    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194091    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194093    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194096    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194099    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194101    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194104    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194106    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194109    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194111    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194113    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194116    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194118    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194120    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:18.202169 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194123    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194125    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194128    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194130    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194133    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194135    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194138    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194140    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194143    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194146    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194148    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194151    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194153    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194155    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194159    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194162    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194165    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194168    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194171    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194174    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:18.202647 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194176    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194179    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194182    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194185    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194188    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194190    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:18.194193    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.194198    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.194297    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.196322    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.197536    2573 server.go:1019] "Starting client certificate rotation"
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.197650    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.197714    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:48:18.203318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.199842    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:48:18.205113 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.205094    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:48:18.218002 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.217984    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 27 15:48:18.220477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.220459    2573 log.go:25] "Validated CRI v1 image API"
Jul 27 15:48:18.222413 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.222398    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 15:48:18.224674 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.224656    2573 fs.go:135] Filesystem UUIDs: map[57a168e2-5378-4a26-af42-fd5bc739d4bb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9b194302-fdf9-45fc-b97a-06f40cdfa989:/dev/nvme0n1p4]
Jul 27 15:48:18.224746 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.224673    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 15:48:18.229599 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.229497    2573 manager.go:216] Machine: {Timestamp:2026-07-27 15:48:18.228224758 +0000 UTC m=+0.314180483 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101362 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29e4326aa9d9ee992d012f535ea058 SystemUUID:ec29e432-6aa9-d9ee-992d-012f535ea058 BootID:a547fc36-144c-4208-afa4-871b0c67b739 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:be:9d:4a:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:be:9d:4a:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:84:c7:8a:24:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 15:48:18.229599 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.229597    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 15:48:18.229703 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.229666    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 15:48:18.229898 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.229884    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:48:18.233257 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.233234    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 15:48:18.233390 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.233259    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 15:48:18.234435 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.234424    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 15:48:18.234474 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.234440    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 15:48:18.234474 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.234447    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:48:18.235064 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.235054    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:48:18.235812 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.235803    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 15:48:18.237446 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237435    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:48:18.237572 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237562    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 15:48:18.237610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237591    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 15:48:18.237610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237601    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 15:48:18.237610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237611    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 15:48:18.237733 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237619    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 27 15:48:18.237733 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237628    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 15:48:18.237993 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.237982    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:48:18.237993 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.238005    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:48:18.240309 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.240295    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 15:48:18.242061 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.242046    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 15:48:18.242130 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.242076    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 15:48:18.243481 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243467    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 15:48:18.243481 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243483    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243490    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243496    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243504    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243510    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243517    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243522    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243529    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243534    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243542    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 15:48:18.243565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.243553    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 15:48:18.244421 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.244409    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 15:48:18.244421 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.244417    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 15:48:18.247527 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.247514    2573 server.go:1268] "Started kubelet"
Jul 27 15:48:18.247698 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.247677    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 15:48:18.247821 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.247783    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 15:48:18.248423 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.247900    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 15:48:18.248423 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.247942    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 15:48:18.248423 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.248344    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 15:48:18.248423 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.248374    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 15:48:18.248395 ip-10-0-141-100 systemd[1]: Started Kubernetes Kubelet.
Jul 27 15:48:18.249856 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.249831    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 15:48:18.251354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.251334    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 15:48:18.254162 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.254142    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 15:48:18.256692 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.255917    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-100.ec2.internal.18c6303314af64fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-100.ec2.internal,UID:ip-10-0-141-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-100.ec2.internal,},FirstTimestamp:2026-07-27 15:48:18.247484667 +0000 UTC m=+0.333440392,LastTimestamp:2026-07-27 15:48:18.247484667 +0000 UTC m=+0.333440392,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-100.ec2.internal,}"
Jul 27 15:48:18.259225 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259207    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 15:48:18.259225 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259215    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 15:48:18.259345 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.259284    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.259765 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259744    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 15:48:18.259870 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259778    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 15:48:18.259870 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259789    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 15:48:18.259995 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259904    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 15:48:18.259995 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.259912    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 15:48:18.260320 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260306    2573 factory.go:153] Registering CRI-O factory
Jul 27 15:48:18.260320 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260322    2573 factory.go:223] Registration of the crio container factory successfully
Jul 27 15:48:18.260439 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260368    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 15:48:18.260439 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260377    2573 factory.go:55] Registering systemd factory
Jul 27 15:48:18.260439 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260385    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 27 15:48:18.260439 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260403    2573 factory.go:103] Registering Raw factory
Jul 27 15:48:18.260439 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.260419    2573 manager.go:1196] Started watching for new ooms in manager
Jul 27 15:48:18.261565 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.261390    2573 manager.go:349] Starting recovery of all containers
Jul 27 15:48:18.266797 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.266774    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hh92"
Jul 27 15:48:18.270198 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.270043    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 15:48:18.270279 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.270207    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 15:48:18.271200 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.271148    2573 manager.go:354] Recovery completed
Jul 27 15:48:18.275467 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.275454    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.277127 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277112    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.277173 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277141    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.277173 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277151    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.277625 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277610    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 15:48:18.277710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277628    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.277710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277631    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 15:48:18.277710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277648    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:48:18.277895 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.277880    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hh92"
Jul 27 15:48:18.278333 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.278319    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.278384 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.278351    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.278384 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.278361    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.279613 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.279601    2573 policy_none.go:49] "None policy: Start"
Jul 27 15:48:18.279650 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.279618    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 15:48:18.279650 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.279628    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 15:48:18.280493 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.280480    2573 policy_none.go:47] "Start"
Jul 27 15:48:18.317915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.317900    2573 manager.go:337] "Starting Device Plugin manager"
Jul 27 15:48:18.318003 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.317934    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 15:48:18.318003 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.317946    2573 server.go:87] "Starting device plugin registration server"
Jul 27 15:48:18.318191 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.318179    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 15:48:18.318260 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.318196    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 15:48:18.318328 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.318313    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 15:48:18.318405 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.318393    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 15:48:18.318459 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.318405    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 15:48:18.318835 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.318817    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 15:48:18.318913 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.318868    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.403641 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.403601    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 15:48:18.404805 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.404785    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 15:48:18.404873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.404832    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 15:48:18.404873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.404860    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 15:48:18.404938 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.404900    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 15:48:18.406785 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.406765    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:18.418780 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.418765    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.420041 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.420026    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.420098 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.420056    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.420098 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.420069    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.420098 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.420091    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.427472 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.427436    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.427472 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.427457    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-100.ec2.internal\": node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.445673 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.445655    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.505214 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.505186    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"]
Jul 27 15:48:18.505349 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.505260    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.506654 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.506636    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.506713 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.506670    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.506713 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.506683    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.507873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.507860    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.508006 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.507993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.508050 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508019    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.508572 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508551    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.508572 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508569    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.508695 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508598    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.508695 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508572    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.508695 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508609    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.508695 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.508616    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.509638 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.509625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.509691 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.509649    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.510280 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.510265    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.510350 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.510292    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.510350 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.510304    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.534581 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.534554    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-100.ec2.internal\" not found" node="ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.538758 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.538742    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-100.ec2.internal\" not found" node="ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.545737 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.545720    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.561545 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.561522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.561630 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.561547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.561630 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.561565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5d50b3cc58a6af6444972f1eb87d63-config\") pod \"kube-apiserver-proxy-ip-10-0-141-100.ec2.internal\" (UID: \"3d5d50b3cc58a6af6444972f1eb87d63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.646399 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.646377    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.662145 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.662210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.662210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5d50b3cc58a6af6444972f1eb87d63-config\") pod \"kube-apiserver-proxy-ip-10-0-141-100.ec2.internal\" (UID: \"3d5d50b3cc58a6af6444972f1eb87d63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.662210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5d50b3cc58a6af6444972f1eb87d63-config\") pod \"kube-apiserver-proxy-ip-10-0-141-100.ec2.internal\" (UID: \"3d5d50b3cc58a6af6444972f1eb87d63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.662318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.662318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.662234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd3b8d86cec4b4fe5c04426d01724d6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal\" (UID: \"fd3b8d86cec4b4fe5c04426d01724d6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.747207 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.747155    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.839042 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.839014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.841761 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:18.841744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:18.847518 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.847502    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:18.948670 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:18.948627    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.051047 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:19.050949    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.151455 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:19.151420    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.189428 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.189407    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.197223 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.197205    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 15:48:19.197353 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.197334    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:48:19.197388 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.197366    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:48:19.252322 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:19.252297    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.282738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.282699    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 15:43:18 +0000 UTC" deadline="2028-02-03 22:14:17.172186833 +0000 UTC"
Jul 27 15:48:19.282738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.282731    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13350h25m57.889459506s"
Jul 27 15:48:19.354706 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:19.354623    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.458037 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:19.457990    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-100.ec2.internal\" not found"
Jul 27 15:48:19.534937 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.534907    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.559356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.559332    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:19.571761 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.571740    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 15:48:19.573572 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.573559    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal"
Jul 27 15:48:19.583430 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.583412    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 15:48:19.651840 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.651770    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.925053 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:19.925010    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5d50b3cc58a6af6444972f1eb87d63.slice/crio-16fca44b21465a5ac055f0a7272e82ecd947a074582ee4a0d2fd3809efe8bc74 WatchSource:0}: Error finding container 16fca44b21465a5ac055f0a7272e82ecd947a074582ee4a0d2fd3809efe8bc74: Status 404 returned error can't find the container with id 16fca44b21465a5ac055f0a7272e82ecd947a074582ee4a0d2fd3809efe8bc74
Jul 27 15:48:19.929791 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:19.929776    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:48:20.240946 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.240861    2573 apiserver.go:52] "Watching apiserver"
Jul 27 15:48:20.251987 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.251959    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 15:48:20.252283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.252259    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-fbmbs","openshift-network-diagnostics/network-check-target-4j2rg","openshift-network-operator/iptables-alerter-nt6jk","openshift-ovn-kubernetes/ovnkube-node-z6cm4","kube-system/global-pull-secret-syncer-55fnh","kube-system/konnectivity-agent-29kxv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9","openshift-cluster-node-tuning-operator/tuned-h6cwm","openshift-image-registry/node-ca-xkx4k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal","openshift-multus/multus-additional-cni-plugins-p6bk2","openshift-multus/multus-grvlj","kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal","openshift-dns/node-resolver-tpr4z"]
Jul 27 15:48:20.254186 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.254169    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.254266 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.254247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:20.255161 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.255143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.256171 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.256153    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.257294 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.257273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.257472 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.257440    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fz2mj\""
Jul 27 15:48:20.257818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.257797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.257913 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.257817    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.258336 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.258314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.258745 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.258728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.258815 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.258769    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r8k6z\""
Jul 27 15:48:20.258873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.258826    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.258873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.258853    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 15:48:20.259579 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.259557    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.259701    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.259732    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.259974    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.259989    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.260104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 15:48:20.260297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.260248    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7fhkl\""
Jul 27 15:48:20.260578 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.260413    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 15:48:20.260738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.260723    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.261079 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.261057    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.261166 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.261124    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.261166 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.261128    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5knh4\""
Jul 27 15:48:20.261314 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.261198    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 15:48:20.261908 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.261893    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.262253 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.262231    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qvrlv\""
Jul 27 15:48:20.262986 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.262969    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 15:48:20.263094 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.263034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.263094 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.263034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.263205 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.263175    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.263262 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.263244    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:20.263592 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.263564    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 15:48:20.263990 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.263974    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v822k\""
Jul 27 15:48:20.264082 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.264002    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 15:48:20.264386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.264367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.264494 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.264479    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.264558 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.264498    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4shq\""
Jul 27 15:48:20.264610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.264596    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.265896 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.265866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.267089 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.267065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:20.267167 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.267111    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:20.267803 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.267791    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 15:48:20.268013 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.267975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 15:48:20.268013 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.267975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 15:48:20.268013 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.267994    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 15:48:20.268245 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268025    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8lbtx\""
Jul 27 15:48:20.268245 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268127    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 15:48:20.268725 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eca20836-d166-4b2e-9667-3852a70b397a-serviceca\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.268725 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-registration-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.268848 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.268848 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.268848 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd716f01-bac1-41c0-aaf6-b63bff3a2669-tmp-dir\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnpx\" (UniqueName: \"kubernetes.io/projected/cd716f01-bac1-41c0-aaf6-b63bff3a2669-kube-api-access-7rnpx\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268877    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268887    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lsq2h\""
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268906    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16e0c70b-0344-415e-9d8b-b3ac0d06295d-konnectivity-ca\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.268993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd716f01-bac1-41c0-aaf6-b63bff3a2669-hosts-file\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-socket-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.269023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16e0c70b-0344-415e-9d8b-b3ac0d06295d-agent-certs\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-system-cni-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-os-release\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d24041b8-161f-4905-ab2f-0677ef0b2867-iptables-alerter-script\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbp2f\" (UniqueName: \"kubernetes.io/projected/d24041b8-161f-4905-ab2f-0677ef0b2867-kube-api-access-dbp2f\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-cnibin\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eca20836-d166-4b2e-9667-3852a70b397a-host\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.269520 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595fb\" (UniqueName: \"kubernetes.io/projected/70ec3b92-4fef-439d-8fa0-298eec85086c-kube-api-access-595fb\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.270252 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.269476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d24041b8-161f-4905-ab2f-0677ef0b2867-host-slash\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.270313 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.270260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgpg9\" (UniqueName: \"kubernetes.io/projected/eca20836-d166-4b2e-9667-3852a70b397a-kube-api-access-wgpg9\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.270313 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.270304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-sys-fs\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.270415 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.270337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwk9\" (UniqueName: \"kubernetes.io/projected/b14c41af-ddb6-4648-958f-ff726e87bfaf-kube-api-access-7wwk9\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.270415 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.270378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.270542 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.270430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.271804 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.271072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qlq\" (UniqueName: \"kubernetes.io/projected/bc1b40b5-147d-46d9-9c58-35b044526a7d-kube-api-access-s7qlq\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.271804 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.271124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-device-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.272878 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.272810    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:48:20.299359 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.299337    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqb45"
Jul 27 15:48:20.309169 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.309151    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqb45"
Jul 27 15:48:20.357531 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.357509    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3b8d86cec4b4fe5c04426d01724d6c.slice/crio-4e5b1f69459a40a4aeae6410a92abf393141ef49ecfeb60d584d5f95d1dc663d WatchSource:0}: Error finding container 4e5b1f69459a40a4aeae6410a92abf393141ef49ecfeb60d584d5f95d1dc663d: Status 404 returned error can't find the container with id 4e5b1f69459a40a4aeae6410a92abf393141ef49ecfeb60d584d5f95d1dc663d
Jul 27 15:48:20.361354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.361331    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 15:48:20.371276 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-socket-dir-parent\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.371360 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-log-socket\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.371360 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-config\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.371360 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eca20836-d166-4b2e-9667-3852a70b397a-serviceca\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.371360 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-registration-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-registration-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.371551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-ovn\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnpx\" (UniqueName: \"kubernetes.io/projected/cd716f01-bac1-41c0-aaf6-b63bff3a2669-kube-api-access-7rnpx\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-k8s-cni-cncf-io\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.371823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bf45\" (UniqueName: \"kubernetes.io/projected/12ac1e05-617e-41e7-9bce-4056e468fa45-kube-api-access-4bf45\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-systemd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-bin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-dbus\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-socket-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.371944    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.371955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-system-cni-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-systemd-units\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.372036    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.872007812 +0000 UTC m=+2.957963525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-system-cni-dir\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372039    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eca20836-d166-4b2e-9667-3852a70b397a-serviceca\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovn-node-metrics-cert\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.372095 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-socket-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d24041b8-161f-4905-ab2f-0677ef0b2867-iptables-alerter-script\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbp2f\" (UniqueName: \"kubernetes.io/projected/d24041b8-161f-4905-ab2f-0677ef0b2867-kube-api-access-dbp2f\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-run\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-lib-modules\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-tuned\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-kubernetes\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-cnibin\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eca20836-d166-4b2e-9667-3852a70b397a-host\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-595fb\" (UniqueName: \"kubernetes.io/projected/70ec3b92-4fef-439d-8fa0-298eec85086c-kube-api-access-595fb\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d24041b8-161f-4905-ab2f-0677ef0b2867-host-slash\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-cnibin\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eca20836-d166-4b2e-9667-3852a70b397a-host\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-var-lib-kubelet\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d24041b8-161f-4905-ab2f-0677ef0b2867-host-slash\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.372607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d24041b8-161f-4905-ab2f-0677ef0b2867-iptables-alerter-script\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-env-overrides\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-sys-fs\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwk9\" (UniqueName: \"kubernetes.io/projected/b14c41af-ddb6-4648-958f-ff726e87bfaf-kube-api-access-7wwk9\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-sys-fs\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qlq\" (UniqueName: \"kubernetes.io/projected/bc1b40b5-147d-46d9-9c58-35b044526a7d-kube-api-access-s7qlq\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-multus\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-device-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-multus-certs\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-tmp\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-etc-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-node-log\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-conf-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-modprobe-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-device-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.373288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.372966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-kubelet\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-netns\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd716f01-bac1-41c0-aaf6-b63bff3a2669-tmp-dir\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-netns\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-systemd\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-script-lib\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16e0c70b-0344-415e-9d8b-b3ac0d06295d-konnectivity-ca\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-kubelet-config\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysconfig\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd716f01-bac1-41c0-aaf6-b63bff3a2669-hosts-file\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16e0c70b-0344-415e-9d8b-b3ac0d06295d-agent-certs\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-os-release\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-multus-daemon-config\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgm6\" (UniqueName: \"kubernetes.io/projected/dae26e66-d29e-44d3-9588-a561147f2c08-kube-api-access-5fgm6\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373326    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd716f01-bac1-41c0-aaf6-b63bff3a2669-tmp-dir\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373326    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd716f01-bac1-41c0-aaf6-b63bff3a2669-hosts-file\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.373971 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc1b40b5-147d-46d9-9c58-35b044526a7d-os-release\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-var-lib-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-cnibin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-os-release\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b14c41af-ddb6-4648-958f-ff726e87bfaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-kubelet\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-conf\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-host\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-slash\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373599    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-system-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-cni-binary-copy\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-hostroot\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16e0c70b-0344-415e-9d8b-b3ac0d06295d-konnectivity-ca\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.374560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-sys\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-bin\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgpg9\" (UniqueName: \"kubernetes.io/projected/eca20836-d166-4b2e-9667-3852a70b397a-kube-api-access-wgpg9\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-etc-kubernetes\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-netd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ctd\" (UniqueName: \"kubernetes.io/projected/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-kube-api-access-l8ctd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.373927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.374277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.375073 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.374345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc1b40b5-147d-46d9-9c58-35b044526a7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.376756 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.376740    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16e0c70b-0344-415e-9d8b-b3ac0d06295d-agent-certs\") pod \"konnectivity-agent-29kxv\" (UID: \"16e0c70b-0344-415e-9d8b-b3ac0d06295d\") " pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.388771 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.388744    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-595fb\" (UniqueName: \"kubernetes.io/projected/70ec3b92-4fef-439d-8fa0-298eec85086c-kube-api-access-595fb\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.388771 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.388760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwk9\" (UniqueName: \"kubernetes.io/projected/b14c41af-ddb6-4648-958f-ff726e87bfaf-kube-api-access-7wwk9\") pod \"aws-ebs-csi-driver-node-5wtb9\" (UID: \"b14c41af-ddb6-4648-958f-ff726e87bfaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.388944 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.388925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qlq\" (UniqueName: \"kubernetes.io/projected/bc1b40b5-147d-46d9-9c58-35b044526a7d-kube-api-access-s7qlq\") pod \"multus-additional-cni-plugins-p6bk2\" (UID: \"bc1b40b5-147d-46d9-9c58-35b044526a7d\") " pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.389179 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.389160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgpg9\" (UniqueName: \"kubernetes.io/projected/eca20836-d166-4b2e-9667-3852a70b397a-kube-api-access-wgpg9\") pod \"node-ca-xkx4k\" (UID: \"eca20836-d166-4b2e-9667-3852a70b397a\") " pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.389571 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.389546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnpx\" (UniqueName: \"kubernetes.io/projected/cd716f01-bac1-41c0-aaf6-b63bff3a2669-kube-api-access-7rnpx\") pod \"node-resolver-tpr4z\" (UID: \"cd716f01-bac1-41c0-aaf6-b63bff3a2669\") " pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.389812 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.389794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbp2f\" (UniqueName: \"kubernetes.io/projected/d24041b8-161f-4905-ab2f-0677ef0b2867-kube-api-access-dbp2f\") pod \"iptables-alerter-nt6jk\" (UID: \"d24041b8-161f-4905-ab2f-0677ef0b2867\") " pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.411433 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.411379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal" event={"ID":"fd3b8d86cec4b4fe5c04426d01724d6c","Type":"ContainerStarted","Data":"4e5b1f69459a40a4aeae6410a92abf393141ef49ecfeb60d584d5f95d1dc663d"}
Jul 27 15:48:20.412344 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.412325    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal" event={"ID":"3d5d50b3cc58a6af6444972f1eb87d63","Type":"ContainerStarted","Data":"16fca44b21465a5ac055f0a7272e82ecd947a074582ee4a0d2fd3809efe8bc74"}
Jul 27 15:48:20.475303 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475303 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-kubernetes\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-var-lib-kubelet\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-env-overrides\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-kubernetes\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-multus\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-var-lib-kubelet\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-multus-certs\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-tmp\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475504 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-multus-certs\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.475462    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-etc-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-etc-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.475573    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.975552886 +0000 UTC m=+3.061508601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-multus\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-node-log\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-conf-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-modprobe-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-conf-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-node-log\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-env-overrides\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-modprobe-d\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-kubelet\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.475945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-netns\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-netns\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-systemd\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-netns\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-netns\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-script-lib\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-kubelet-config\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysconfig\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.475927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-kubelet\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-systemd\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysconfig\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-multus-daemon-config\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgm6\" (UniqueName: \"kubernetes.io/projected/dae26e66-d29e-44d3-9588-a561147f2c08-kube-api-access-5fgm6\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476207    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-var-lib-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-cnibin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-os-release\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-kubelet\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.476787 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-conf\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-host\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-slash\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-var-lib-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-system-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-cni-binary-copy\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-hostroot\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-os-release\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-sysctl-conf\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-slash\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-cnibin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-kubelet\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-hostroot\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-system-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-sys\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-host\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-bin\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.477612 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-script-lib\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476616    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-sys\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-etc-kubernetes\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-bin\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-netd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ctd\" (UniqueName: \"kubernetes.io/projected/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-kube-api-access-l8ctd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-etc-kubernetes\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-kubelet-config\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-socket-dir-parent\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-log-socket\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476748    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-host-cni-netd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-config\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-log-socket\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-socket-dir-parent\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-multus-cni-dir\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-ovn\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478228 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-openvswitch\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-ovn\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-k8s-cni-cncf-io\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bf45\" (UniqueName: \"kubernetes.io/projected/12ac1e05-617e-41e7-9bce-4056e468fa45-kube-api-access-4bf45\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476959    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-run-k8s-cni-cncf-io\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.476980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-systemd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-cni-binary-copy\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477029    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-run-systemd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-bin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-dbus\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-systemd-units\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovn-node-metrics-cert\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dae26e66-d29e-44d3-9588-a561147f2c08-host-var-lib-cni-bin\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-run\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-lib-modules\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e55a879-6ecc-4217-8b76-77e4f9535a5c-dbus\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-tuned\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-systemd-units\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.478790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dae26e66-d29e-44d3-9588-a561147f2c08-multus-daemon-config\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-run\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477371    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ac1e05-617e-41e7-9bce-4056e468fa45-lib-modules\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovnkube-config\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.477975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-tmp\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.479256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ac1e05-617e-41e7-9bce-4056e468fa45-etc-tuned\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.479416 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.479268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-ovn-node-metrics-cert\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.482786 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.482772    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:20.482839 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.482791    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:20.482839 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.482801    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:20.482911 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.482856    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.982843327 +0000 UTC m=+3.068799038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:20.489263 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.489241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgm6\" (UniqueName: \"kubernetes.io/projected/dae26e66-d29e-44d3-9588-a561147f2c08-kube-api-access-5fgm6\") pod \"multus-grvlj\" (UID: \"dae26e66-d29e-44d3-9588-a561147f2c08\") " pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.489356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.489269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bf45\" (UniqueName: \"kubernetes.io/projected/12ac1e05-617e-41e7-9bce-4056e468fa45-kube-api-access-4bf45\") pod \"tuned-h6cwm\" (UID: \"12ac1e05-617e-41e7-9bce-4056e468fa45\") " pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.489574 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.489556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ctd\" (UniqueName: \"kubernetes.io/projected/91e0bec6-ded4-45c6-ad39-fc8ea3f83d71-kube-api-access-l8ctd\") pod \"ovnkube-node-z6cm4\" (UID: \"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.565848 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.565777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tpr4z"
Jul 27 15:48:20.574695 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.574671    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd716f01_bac1_41c0_aaf6_b63bff3a2669.slice/crio-340eab75d2bde9e232fd989519128d3ac52c081d738e9a07cc117edc427b0d8d WatchSource:0}: Error finding container 340eab75d2bde9e232fd989519128d3ac52c081d738e9a07cc117edc427b0d8d: Status 404 returned error can't find the container with id 340eab75d2bde9e232fd989519128d3ac52c081d738e9a07cc117edc427b0d8d
Jul 27 15:48:20.574788 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.574700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nt6jk"
Jul 27 15:48:20.581718 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.581694    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24041b8_161f_4905_ab2f_0677ef0b2867.slice/crio-77a14e51601b62ce64a93eedef6af281376293d9d09d2796eac96511f9fbc6b3 WatchSource:0}: Error finding container 77a14e51601b62ce64a93eedef6af281376293d9d09d2796eac96511f9fbc6b3: Status 404 returned error can't find the container with id 77a14e51601b62ce64a93eedef6af281376293d9d09d2796eac96511f9fbc6b3
Jul 27 15:48:20.582350 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.582334    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p6bk2"
Jul 27 15:48:20.586535 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.586513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkx4k"
Jul 27 15:48:20.589987 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.589965    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1b40b5_147d_46d9_9c58_35b044526a7d.slice/crio-c276ede85c04cb2ae6359dbaa7a3ffa39b64f9b3b6219b5c905f4ad4f4f381ea WatchSource:0}: Error finding container c276ede85c04cb2ae6359dbaa7a3ffa39b64f9b3b6219b5c905f4ad4f4f381ea: Status 404 returned error can't find the container with id c276ede85c04cb2ae6359dbaa7a3ffa39b64f9b3b6219b5c905f4ad4f4f381ea
Jul 27 15:48:20.592738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.592682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9"
Jul 27 15:48:20.595150 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.595067    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca20836_d166_4b2e_9667_3852a70b397a.slice/crio-fbce3b7037bf16f3f7e41d77cf054250e3cf5562dfa919a60ba1424eeff17a99 WatchSource:0}: Error finding container fbce3b7037bf16f3f7e41d77cf054250e3cf5562dfa919a60ba1424eeff17a99: Status 404 returned error can't find the container with id fbce3b7037bf16f3f7e41d77cf054250e3cf5562dfa919a60ba1424eeff17a99
Jul 27 15:48:20.598341 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.598324    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:20.599912 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.599889    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14c41af_ddb6_4648_958f_ff726e87bfaf.slice/crio-a51ac63fae1a1e454356331a67b229f55004539c98debdd5eca58c00b9d204c9 WatchSource:0}: Error finding container a51ac63fae1a1e454356331a67b229f55004539c98debdd5eca58c00b9d204c9: Status 404 returned error can't find the container with id a51ac63fae1a1e454356331a67b229f55004539c98debdd5eca58c00b9d204c9
Jul 27 15:48:20.605076 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.605061    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6cwm"
Jul 27 15:48:20.605896 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.605873    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e0c70b_0344_415e_9d8b_b3ac0d06295d.slice/crio-e86580f54f58525a530ea44daba99bf6d67d8bd6c4dfb8bc66b337dcfed3e278 WatchSource:0}: Error finding container e86580f54f58525a530ea44daba99bf6d67d8bd6c4dfb8bc66b337dcfed3e278: Status 404 returned error can't find the container with id e86580f54f58525a530ea44daba99bf6d67d8bd6c4dfb8bc66b337dcfed3e278
Jul 27 15:48:20.610672 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.610649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:20.612368 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.612343    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ac1e05_617e_41e7_9bce_4056e468fa45.slice/crio-1f8b2fcf920af23ef6f7076d0ada27af841a857962f150facb7c5173eb7d5a80 WatchSource:0}: Error finding container 1f8b2fcf920af23ef6f7076d0ada27af841a857962f150facb7c5173eb7d5a80: Status 404 returned error can't find the container with id 1f8b2fcf920af23ef6f7076d0ada27af841a857962f150facb7c5173eb7d5a80
Jul 27 15:48:20.614847 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.614829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grvlj"
Jul 27 15:48:20.618389 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.618371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e0bec6_ded4_45c6_ad39_fc8ea3f83d71.slice/crio-1eb91a4276f62ff32fb9cc80a597d6c217c9f4d3f44854940b53baf773ead6b8 WatchSource:0}: Error finding container 1eb91a4276f62ff32fb9cc80a597d6c217c9f4d3f44854940b53baf773ead6b8: Status 404 returned error can't find the container with id 1eb91a4276f62ff32fb9cc80a597d6c217c9f4d3f44854940b53baf773ead6b8
Jul 27 15:48:20.622538 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:20.622515    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae26e66_d29e_44d3_9588_a561147f2c08.slice/crio-fec04e689ad6a658eaaff707abf9995cf54f49d88e75a9dbdc00d6bd1edbe5ec WatchSource:0}: Error finding container fec04e689ad6a658eaaff707abf9995cf54f49d88e75a9dbdc00d6bd1edbe5ec: Status 404 returned error can't find the container with id fec04e689ad6a658eaaff707abf9995cf54f49d88e75a9dbdc00d6bd1edbe5ec
Jul 27 15:48:20.777396 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.777364    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:20.880728 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.880577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:20.880728 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.880719    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.880926 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.880797    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:21.880775238 +0000 UTC m=+3.966730969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.981020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:20.980985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:20.981198 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.981169    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:20.981271 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:20.981232    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:21.981212342 +0000 UTC m=+4.067168059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:21.082463 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.082424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:21.082664 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.082646    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:21.082802 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.082674    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:21.082802 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.082701    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:21.082802 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.082801    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:22.082781944 +0000 UTC m=+4.168737659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:21.312035 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.311826    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:43:20 +0000 UTC" deadline="2028-03-16 16:27:52.743046349 +0000 UTC"
Jul 27 15:48:21.312035 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.311869    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14352h39m31.431182206s"
Jul 27 15:48:21.416492 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.416451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nt6jk" event={"ID":"d24041b8-161f-4905-ab2f-0677ef0b2867","Type":"ContainerStarted","Data":"77a14e51601b62ce64a93eedef6af281376293d9d09d2796eac96511f9fbc6b3"}
Jul 27 15:48:21.418844 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.418760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grvlj" event={"ID":"dae26e66-d29e-44d3-9588-a561147f2c08","Type":"ContainerStarted","Data":"fec04e689ad6a658eaaff707abf9995cf54f49d88e75a9dbdc00d6bd1edbe5ec"}
Jul 27 15:48:21.420604 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.420495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"1eb91a4276f62ff32fb9cc80a597d6c217c9f4d3f44854940b53baf773ead6b8"}
Jul 27 15:48:21.422349 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.422258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6cwm" event={"ID":"12ac1e05-617e-41e7-9bce-4056e468fa45","Type":"ContainerStarted","Data":"1f8b2fcf920af23ef6f7076d0ada27af841a857962f150facb7c5173eb7d5a80"}
Jul 27 15:48:21.424036 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.423947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29kxv" event={"ID":"16e0c70b-0344-415e-9d8b-b3ac0d06295d","Type":"ContainerStarted","Data":"e86580f54f58525a530ea44daba99bf6d67d8bd6c4dfb8bc66b337dcfed3e278"}
Jul 27 15:48:21.426590 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.426564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerStarted","Data":"c276ede85c04cb2ae6359dbaa7a3ffa39b64f9b3b6219b5c905f4ad4f4f381ea"}
Jul 27 15:48:21.428834 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.428809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tpr4z" event={"ID":"cd716f01-bac1-41c0-aaf6-b63bff3a2669","Type":"ContainerStarted","Data":"340eab75d2bde9e232fd989519128d3ac52c081d738e9a07cc117edc427b0d8d"}
Jul 27 15:48:21.433992 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.431550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9" event={"ID":"b14c41af-ddb6-4648-958f-ff726e87bfaf","Type":"ContainerStarted","Data":"a51ac63fae1a1e454356331a67b229f55004539c98debdd5eca58c00b9d204c9"}
Jul 27 15:48:21.435231 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.435152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkx4k" event={"ID":"eca20836-d166-4b2e-9667-3852a70b397a","Type":"ContainerStarted","Data":"fbce3b7037bf16f3f7e41d77cf054250e3cf5562dfa919a60ba1424eeff17a99"}
Jul 27 15:48:21.890354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.890312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:21.890593 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.890461    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:21.890593 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.890533    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:23.890512629 +0000 UTC m=+5.976468356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:21.991619 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:21.991575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:21.991791 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.991748    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:21.991871 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:21.991813    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:23.99179309 +0000 UTC m=+6.077748803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:22.054221 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.054187    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:22.092454 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.092413    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:22.092722 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.092670    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:22.092722 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.092695    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:22.092722 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.092709    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:22.092931 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.092770    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:24.092751079 +0000 UTC m=+6.178706794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:22.312798 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.312674    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:43:20 +0000 UTC" deadline="2027-12-31 01:48:23.149974307 +0000 UTC"
Jul 27 15:48:22.312798 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.312734    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12514h0m0.837244416s"
Jul 27 15:48:22.409489 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.409452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:22.409806 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.409566    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:22.409806 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.409582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:22.409806 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:22.409457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:22.409806 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.409701    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:22.409806 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:22.409800    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:23.909355 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:23.909316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:23.909826 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:23.909504    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:23.909826 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:23.909572    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:27.90955054 +0000 UTC m=+9.995506268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:24.009995 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:24.009950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:24.010188 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.010143    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:24.010266 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.010209    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:28.010190834 +0000 UTC m=+10.096146552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:24.110917 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:24.110877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:24.111123 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.111101    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:24.111194 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.111128    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:24.111194 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.111142    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:24.111300 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.111201    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:28.111180926 +0000 UTC m=+10.197136655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:24.406349 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:24.406268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:24.406349 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:24.406286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:24.406583 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.406442    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:24.406816 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:24.406796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:24.406923 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.406905    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:24.407086 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:24.406990    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:26.405659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:26.406006    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:26.406383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:26.406462    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:26.406505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:26.407250 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:26.406580    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:27.943196 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:27.943160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:27.943660 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:27.943308    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:27.943660 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:27.943376    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:35.943356652 +0000 UTC m=+18.029312379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:28.044108 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:28.044067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:28.044285 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.044247    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:28.044342 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.044308    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:36.044291919 +0000 UTC m=+18.130247632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:28.145356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:28.145171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:28.145356 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.145339    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:28.145356 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.145362    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:28.145729 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.145374    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:28.145729 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.145436    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:36.145415786 +0000 UTC m=+18.231371498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:28.406104 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:28.406076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:28.406217 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:28.406087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:28.406217 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:28.406124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:28.407336 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.407152    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:28.407336 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.407258    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:28.407507 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:28.407341    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:30.405726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:30.405760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:30.405726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:30.405857    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:30.405909    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:30.406027 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:30.405991    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:32.405911 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:32.405870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:32.406343 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:32.405881    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:32.406343 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:32.406000    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:32.406343 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:32.406016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:32.406343 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:32.406075    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:32.406343 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:32.406153    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:34.405141 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:34.405107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:34.405617 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:34.405107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:34.405617 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:34.405255    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:34.405617 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:34.405112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:34.405617 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:34.405320    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:34.405617 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:34.405428    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:35.997227 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:35.997190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:35.997729 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:35.997356    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:35.997729 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:35.997427    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:51.997411667 +0000 UTC m=+34.083367382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:36.097773 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:36.097737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:36.097973 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.097901    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:36.098040 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.097986    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:48:52.097951449 +0000 UTC m=+34.183907164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:36.198355 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:36.198325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:36.198506 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.198490    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:36.198550 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.198512    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:36.198550 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.198522    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:36.198633 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.198576    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:52.198558672 +0000 UTC m=+34.284514382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:36.405797 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:36.405686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:36.405797 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:36.405701    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:36.406039 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:36.405813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:36.406039 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.405812    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:36.406039 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.405917    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:36.406039 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:36.406013    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:38.406162 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:38.406130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:38.406657 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:38.406231    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:38.406657 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:38.406268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:38.406657 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:38.406344    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:38.406657 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:38.406359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:38.406657 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:38.406484    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:40.405896 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.405595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:40.406623 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.405631    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:40.406623 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:40.406001    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:40.406623 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.405661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:40.406623 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:40.406059    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:40.406623 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:40.406123    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:40.472089 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.472054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkx4k" event={"ID":"eca20836-d166-4b2e-9667-3852a70b397a","Type":"ContainerStarted","Data":"a0bdd654c09e84d508fc0cf4b3713c0625d52b158cd6fdbe9dfda5fa9f3c75d8"}
Jul 27 15:48:40.473498 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.473469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal" event={"ID":"3d5d50b3cc58a6af6444972f1eb87d63","Type":"ContainerStarted","Data":"90aa8b161fdd0d3f609c1e3c5dbd0816d25de8edf16bfe0742d637d1296cae31"}
Jul 27 15:48:40.474823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.474802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grvlj" event={"ID":"dae26e66-d29e-44d3-9588-a561147f2c08","Type":"ContainerStarted","Data":"a118586584bf1a378abf87886cabe280c9b158d84f8290590770ef8fd4755b19"}
Jul 27 15:48:40.477544 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.477524    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"10907710c5ba632b3c4c0c36093859297579705138b0324d6f7a2be3d016b0f2"}
Jul 27 15:48:40.477636 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.477584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"562fcc9a7c275e2ad384de82bd301d747c07bf7899ef5890fff05cb0b448832c"}
Jul 27 15:48:40.477636 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.477620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"cb4a44363d670244d0896f2527a878efa8732ac3e502fe235a35b970cd547794"}
Jul 27 15:48:40.477764 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.477667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"2067c458de459eaf9b1cb9046143c9942c31f6ccb6f6dfcab4c52f0ddf84060f"}
Jul 27 15:48:40.477764 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.477713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"8c8dd059aeaeccb1767a29a4417de9c2eda7767dd75f429508242e23d7d1cb7a"}
Jul 27 15:48:40.478945 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.478919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6cwm" event={"ID":"12ac1e05-617e-41e7-9bce-4056e468fa45","Type":"ContainerStarted","Data":"35c8a54abc254cd5b2930f79df246841404aa6437e9f57af8f75155dab9732d4"}
Jul 27 15:48:40.480219 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.480200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29kxv" event={"ID":"16e0c70b-0344-415e-9d8b-b3ac0d06295d","Type":"ContainerStarted","Data":"de86bd5e43ac9d30ba4c50d312166f16ef3857ce74c126e68aeac48016bb4e49"}
Jul 27 15:48:40.481537 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.481519    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="837ee044af98686e7f1686ef650ffd811e2d5871d24f424159889c0a882505dd" exitCode=0
Jul 27 15:48:40.481605 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.481573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"837ee044af98686e7f1686ef650ffd811e2d5871d24f424159889c0a882505dd"}
Jul 27 15:48:40.482877 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.482860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tpr4z" event={"ID":"cd716f01-bac1-41c0-aaf6-b63bff3a2669","Type":"ContainerStarted","Data":"e0926b9fdce2b1496023d303480d462a8257f82dcbcc852ddde7b77561936789"}
Jul 27 15:48:40.484296 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.484278    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd3b8d86cec4b4fe5c04426d01724d6c" containerID="4b174f70aa11f65de336d2a3cc666ac7e94c0772a1e6eb1ee1daaadf4ece3d3a" exitCode=0
Jul 27 15:48:40.484374 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.484331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal" event={"ID":"fd3b8d86cec4b4fe5c04426d01724d6c","Type":"ContainerDied","Data":"4b174f70aa11f65de336d2a3cc666ac7e94c0772a1e6eb1ee1daaadf4ece3d3a"}
Jul 27 15:48:40.485696 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.485678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9" event={"ID":"b14c41af-ddb6-4648-958f-ff726e87bfaf","Type":"ContainerStarted","Data":"a3abe64fb3663752dee875f5522e5ff05b843c423d0907c6d9f2f7a9f95d5137"}
Jul 27 15:48:40.503615 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.503572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xkx4k" podStartSLOduration=7.823201222 podStartE2EDuration="22.503560727s" totalImagesPullingTime="14.680359505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.486190853 +0000 UTC m=+22.572146594" watchObservedRunningTime="2026-07-27 15:48:40.503560727 +0000 UTC m=+22.589516492"
Jul 27 15:48:40.503743 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.503725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-grvlj" podStartSLOduration=2.250392573 podStartE2EDuration="21.503720006s" totalImagesPullingTime="19.253327433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.502823174 +0000 UTC m=+22.588778917" watchObservedRunningTime="2026-07-27 15:48:40.503720006 +0000 UTC m=+22.589675738"
Jul 27 15:48:40.562008 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.561975    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-100.ec2.internal" podStartSLOduration=21.561945703 podStartE2EDuration="21.561945703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.53753354 +0000 UTC m=+22.623489273" watchObservedRunningTime="2026-07-27 15:48:40.561945703 +0000 UTC m=+22.647901438"
Jul 27 15:48:40.577234 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.577201    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-29kxv" podStartSLOduration=2.4314752410000002 podStartE2EDuration="21.577189531s" totalImagesPullingTime="19.14571429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.576924527 +0000 UTC m=+22.662880260" watchObservedRunningTime="2026-07-27 15:48:40.577189531 +0000 UTC m=+22.663145263"
Jul 27 15:48:40.617653 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.617572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tpr4z" podStartSLOduration=3.440783756 podStartE2EDuration="22.617550252s" totalImagesPullingTime="19.176766496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.617478349 +0000 UTC m=+22.703434082" watchObservedRunningTime="2026-07-27 15:48:40.617550252 +0000 UTC m=+22.703505994"
Jul 27 15:48:40.618221 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:40.618176    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6cwm" podStartSLOduration=2.47847348 podStartE2EDuration="21.618163116s" totalImagesPullingTime="19.139689636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.598369993 +0000 UTC m=+22.684325726" watchObservedRunningTime="2026-07-27 15:48:40.618163116 +0000 UTC m=+22.704118849"
Jul 27 15:48:41.489089 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.489057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nt6jk" event={"ID":"d24041b8-161f-4905-ab2f-0677ef0b2867","Type":"ContainerStarted","Data":"edf36be3a358f588852142ec33724e85b025206186944499d067020061dc02c8"}
Jul 27 15:48:41.495594 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.495488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"68acf694c4d0e614e708b4dd958b331c7fee2aeedaf2ced1e093b1dc916ab9a9"}
Jul 27 15:48:41.497592 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.497563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal" event={"ID":"fd3b8d86cec4b4fe5c04426d01724d6c","Type":"ContainerStarted","Data":"824ac5472a9854ff1df6a3f67050dbd88e8160a4e85589a391610d3951b1d315"}
Jul 27 15:48:41.504260 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.504221    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nt6jk" podStartSLOduration=12.486788376 podStartE2EDuration="23.504208459s" totalImagesPullingTime="11.017420083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:41.503790421 +0000 UTC m=+23.589746153" watchObservedRunningTime="2026-07-27 15:48:41.504208459 +0000 UTC m=+23.590164191"
Jul 27 15:48:41.519007 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.518968    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-100.ec2.internal" podStartSLOduration=22.518940227 podStartE2EDuration="22.518940227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:41.518679047 +0000 UTC m=+23.604634783" watchObservedRunningTime="2026-07-27 15:48:41.518940227 +0000 UTC m=+23.604895960"
Jul 27 15:48:41.552675 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:41.552648    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 15:48:42.337315 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.337199    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T15:48:41.55266956Z","UUID":"4ae2f040-7d33-44a8-92f2-e9dac3b6618e","Handler":null,"Name":"","Endpoint":""}
Jul 27 15:48:42.338903 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.338879    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 15:48:42.339041 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.338920    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 15:48:42.405421 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.405357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:42.405603 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.405356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:42.405603 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:42.405512    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:42.405603 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:42.405592    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:42.405776 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.405356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:42.405776 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:42.405692    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:42.502272 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:42.502233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9" event={"ID":"b14c41af-ddb6-4648-958f-ff726e87bfaf","Type":"ContainerStarted","Data":"6493e3fb6611e0b57e83492147cb1acfd114104bda5015ebe5974b4f087b9997"}
Jul 27 15:48:43.508616 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:43.508384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"d14fd017c661b00ea60b0ae36b93dec1229a75035a751692cf7a6a210cf9b65d"}
Jul 27 15:48:43.510705 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:43.510674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9" event={"ID":"b14c41af-ddb6-4648-958f-ff726e87bfaf","Type":"ContainerStarted","Data":"db02adba549e9d6cd2bab881a4007a054e4d648fb8af60cbf39c80aa55c673f1"}
Jul 27 15:48:43.530742 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:43.530694    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wtb9" podStartSLOduration=7.212031238 podStartE2EDuration="24.530674997s" totalImagesPullingTime="17.318643759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:43.530194789 +0000 UTC m=+25.616150522" watchObservedRunningTime="2026-07-27 15:48:43.530674997 +0000 UTC m=+25.616630790"
Jul 27 15:48:44.405969 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:44.405914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:44.405969 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:44.405914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:44.406266 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:44.406111    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:44.406266 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:44.406159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:44.406266 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:44.406250    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:44.406422 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:44.406316    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:44.770970 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:44.770680    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:44.771492 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:44.771440    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:45.518771 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.518533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" event={"ID":"91e0bec6-ded4-45c6-ad39-fc8ea3f83d71","Type":"ContainerStarted","Data":"8b34b6882471e70715cf4609f765c36932b84dc7df5a96e16f3542d8a0097a38"}
Jul 27 15:48:45.518976 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.518828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:45.518976 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.518884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:45.520361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.520326    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="b9036403c145a3f9bed668192c874ec9c3121856afe89286329e6653cd6e9b6a" exitCode=0
Jul 27 15:48:45.520444 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.520395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"b9036403c145a3f9bed668192c874ec9c3121856afe89286329e6653cd6e9b6a"}
Jul 27 15:48:45.520651 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.520637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:45.521192 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.521175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-29kxv"
Jul 27 15:48:45.534759 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.534740    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:45.544493 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:45.544458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4" podStartSLOduration=7.3709013930000005 podStartE2EDuration="26.544447097s" totalImagesPullingTime="19.173545704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:45.544340492 +0000 UTC m=+27.630296224" watchObservedRunningTime="2026-07-27 15:48:45.544447097 +0000 UTC m=+27.630402830"
Jul 27 15:48:46.405871 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.405804    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:46.405871 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.405840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:46.407275 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.405812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:46.407275 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.405934    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:46.407275 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.406141    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:46.407275 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.406224    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:46.523235 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.523209    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:46.537343 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.537321    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:48:46.944188 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.944095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4j2rg"]
Jul 27 15:48:46.944347 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.944212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:46.944347 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.944317    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:46.944924 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.944902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbmbs"]
Jul 27 15:48:46.945055 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.945004    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:46.945130 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.945107    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:46.945609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.945589    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55fnh"]
Jul 27 15:48:46.945676 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:46.945655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:46.945749 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:46.945715    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:47.526727 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:47.526697    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="9435495d1b3bd9d304aaaf78b11ed2cd9a64208ac2a50fa6b595424604cfcb06" exitCode=0
Jul 27 15:48:47.527140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:47.526779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"9435495d1b3bd9d304aaaf78b11ed2cd9a64208ac2a50fa6b595424604cfcb06"}
Jul 27 15:48:48.406805 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:48.406773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:48.407001 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:48.406838    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:48.407001 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:48.406850    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:48.407001 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:48.406920    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:48.407001 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:48.406976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:48.407240 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:48.407025    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:49.533448 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:49.533416    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="7819a381758a4b5f5ac45529afcf2f90729942e4230dc046b37f26ca7dab9190" exitCode=0
Jul 27 15:48:49.534140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:49.533474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"7819a381758a4b5f5ac45529afcf2f90729942e4230dc046b37f26ca7dab9190"}
Jul 27 15:48:50.405106 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:50.405074    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:50.405281 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:50.405075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:50.405281 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:50.405178    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:50.405281 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:50.405087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:50.405281 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:50.405273    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:50.405504 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:50.405335    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:52.013856 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.013811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:52.014412 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.014003    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:52.014412 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.014076    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:49:24.014055166 +0000 UTC m=+66.100010879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:52.114649 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.114614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:52.114816 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.114782    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:52.114872 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.114859    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret podName:2e55a879-6ecc-4217-8b76-77e4f9535a5c nodeName:}" failed. No retries permitted until 2026-07-27 15:49:24.114837673 +0000 UTC m=+66.200793407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret") pod "global-pull-secret-syncer-55fnh" (UID: "2e55a879-6ecc-4217-8b76-77e4f9535a5c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:52.215689 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.215650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:52.215856 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.215840    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:52.215900 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.215864    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:52.215900 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.215874    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jb6qk for pod openshift-network-diagnostics/network-check-target-4j2rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:52.216000 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.215933    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk podName:85697c8e-79e5-406b-af56-0bd384abf371 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:24.215916456 +0000 UTC m=+66.301872169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jb6qk" (UniqueName: "kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk") pod "network-check-target-4j2rg" (UID: "85697c8e-79e5-406b-af56-0bd384abf371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:52.406200 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.405951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:52.406359 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.405951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:52.406359 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.406307    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4j2rg" podUID="85697c8e-79e5-406b-af56-0bd384abf371"
Jul 27 15:48:52.406469 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.406041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:52.406469 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.406407    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55fnh" podUID="2e55a879-6ecc-4217-8b76-77e4f9535a5c"
Jul 27 15:48:52.406553 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:52.406478    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:48:52.737236 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.737121    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-100.ec2.internal" event="NodeReady"
Jul 27 15:48:52.737387 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.737260    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 15:48:52.782836 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.782807    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xjnsk"]
Jul 27 15:48:52.786465 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.785950    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w9rlq"]
Jul 27 15:48:52.786465 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.786069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:52.787729 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.787694    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:52.788829 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.788784    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 15:48:52.788972 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.788866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-748tg\""
Jul 27 15:48:52.789088 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.789073    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 15:48:52.790050 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.790020    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 15:48:52.790149 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.790089    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 15:48:52.790149 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.790090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54wz2\""
Jul 27 15:48:52.790414 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.790397    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 15:48:52.796254 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.796195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjnsk"]
Jul 27 15:48:52.798977 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.798926    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9rlq"]
Jul 27 15:48:52.922115 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzkhx\" (UniqueName: \"kubernetes.io/projected/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-kube-api-access-wzkhx\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:52.922284 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-tmp-dir\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:52.922284 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922216    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkpk\" (UniqueName: \"kubernetes.io/projected/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-kube-api-access-tdkpk\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:52.922379 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-cert\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:52.922379 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-config-volume\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:52.922379 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:52.922363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.023251 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-cert\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:53.023251 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-config-volume\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.023251 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzkhx\" (UniqueName: \"kubernetes.io/projected/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-kube-api-access-wzkhx\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-tmp-dir\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkpk\" (UniqueName: \"kubernetes.io/projected/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-kube-api-access-tdkpk\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:53.023396    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:53.023464    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:53.523444207 +0000 UTC m=+35.609399924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.023833 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023748    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-tmp-dir\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.024142 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.023882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-config-volume\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.028014 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.027991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-cert\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:53.032440 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.032413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzkhx\" (UniqueName: \"kubernetes.io/projected/3a24a7f9-a457-4f56-98aa-0d8849b4f0f2-kube-api-access-wzkhx\") pod \"ingress-canary-w9rlq\" (UID: \"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2\") " pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:53.032440 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.032430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkpk\" (UniqueName: \"kubernetes.io/projected/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-kube-api-access-tdkpk\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.105513 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.105478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9rlq"
Jul 27 15:48:53.472475 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.472444    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9rlq"]
Jul 27 15:48:53.478416 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:48:53.478389    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a24a7f9_a457_4f56_98aa_0d8849b4f0f2.slice/crio-10160d6b845d88d8bd8bb5afd9ec2a42772cc8efa843422654558833eaaff4fe WatchSource:0}: Error finding container 10160d6b845d88d8bd8bb5afd9ec2a42772cc8efa843422654558833eaaff4fe: Status 404 returned error can't find the container with id 10160d6b845d88d8bd8bb5afd9ec2a42772cc8efa843422654558833eaaff4fe
Jul 27 15:48:53.526407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.526369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:53.526554 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:53.526511    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.526598 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:53.526578    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:54.526560838 +0000 UTC m=+36.612516548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.546853 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.546824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerStarted","Data":"2fa8379583b44f81a29b8043b2d25e68e93632b77e4a1a289737cabad61391b4"}
Jul 27 15:48:53.547998 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:53.547973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9rlq" event={"ID":"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2","Type":"ContainerStarted","Data":"10160d6b845d88d8bd8bb5afd9ec2a42772cc8efa843422654558833eaaff4fe"}
Jul 27 15:48:54.405254 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.405222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:48:54.405711 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.405223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:48:54.405711 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.405223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:48:54.408171 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.408092    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:48:54.409200 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.409177    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:48:54.409291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.409179    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcv26\""
Jul 27 15:48:54.409291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.409255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x92bc\""
Jul 27 15:48:54.409291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.409185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:48:54.409457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.409297    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:48:54.536475 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.536297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:54.536622 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:54.536448    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:54.536686 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:54.536623    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:56.536600591 +0000 UTC m=+38.622556306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:54.553469 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.553443    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="2fa8379583b44f81a29b8043b2d25e68e93632b77e4a1a289737cabad61391b4" exitCode=0
Jul 27 15:48:54.553609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:54.553507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"2fa8379583b44f81a29b8043b2d25e68e93632b77e4a1a289737cabad61391b4"}
Jul 27 15:48:55.258369 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:55.258322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:55.558498 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:55.558428    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc1b40b5-147d-46d9-9c58-35b044526a7d" containerID="bc4db722a232c84f2448543d7dd03bee71924ac941b52d182804702396e26a14" exitCode=0
Jul 27 15:48:55.558498 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:55.558467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerDied","Data":"bc4db722a232c84f2448543d7dd03bee71924ac941b52d182804702396e26a14"}
Jul 27 15:48:56.076304 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.076266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:56.177231 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.177202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:56.554011 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.553984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:48:56.554157 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:56.554112    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:56.554195 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:48:56.554163    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:00.55414922 +0000 UTC m=+42.640104931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:56.563826 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.563801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" event={"ID":"bc1b40b5-147d-46d9-9c58-35b044526a7d","Type":"ContainerStarted","Data":"c7ef5d3f967cd0261b689ee325446ad592ceb8dbe8fe52ae2ab75ebeb03a0169"}
Jul 27 15:48:56.565233 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.565208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9rlq" event={"ID":"3a24a7f9-a457-4f56-98aa-0d8849b4f0f2","Type":"ContainerStarted","Data":"763f4eccc6a49025e0c31219403eca4523c32b39290788de974af370ed0a84b7"}
Jul 27 15:48:56.589310 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.587502    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p6bk2" podStartSLOduration=17.235120114 podStartE2EDuration="38.587484884s" totalImagesPullingTime="21.35236477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:56.586625861 +0000 UTC m=+38.672581597" watchObservedRunningTime="2026-07-27 15:48:56.587484884 +0000 UTC m=+38.673440616"
Jul 27 15:48:56.602704 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.602664    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w9rlq" podStartSLOduration=2.46771978 podStartE2EDuration="4.602652485s" totalImagesPullingTime="2.134932705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:56.60224712 +0000 UTC m=+38.688202851" watchObservedRunningTime="2026-07-27 15:48:56.602652485 +0000 UTC m=+38.688608217"
Jul 27 15:48:56.704940 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.704906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:56.805190 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.805117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:56.871140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:56.871104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:58.096774 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:58.096737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:48:58.157113 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:48:58.157075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:00.584940 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:00.584911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:49:00.585316 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:00.585031    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:00.585316 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:00.585077    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:08.585065527 +0000 UTC m=+50.671021237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:01.684588 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:01.684548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:01.737876 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:01.737847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:01.960549 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:01.960471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:02.068847 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:02.068813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:02.193130 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:02.193106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:03.292150 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:03.292121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:08.639863 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:08.639829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:49:08.640258 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:08.639944    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:08.640258 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:08.640022    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:24.640007908 +0000 UTC m=+66.725963618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:16.332379 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:16.332344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:16.396527 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:16.396495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:18.543523 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:18.543494    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6cm4"
Jul 27 15:49:18.707262 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:18.707223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:18.806340 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:18.806261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:22.954876 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:22.954838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:23.018641 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:23.018616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:23.087343 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:23.087310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:24.046551 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.046517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:49:24.049201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.049184    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:49:24.057209 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:24.057189    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 15:49:24.057269 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:24.057259    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:50:28.057242536 +0000 UTC m=+130.143198246 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : secret "metrics-daemon-secret" not found
Jul 27 15:49:24.147738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.147707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:49:24.150608 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.150593    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:49:24.161644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.161619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e55a879-6ecc-4217-8b76-77e4f9535a5c-original-pull-secret\") pod \"global-pull-secret-syncer-55fnh\" (UID: \"2e55a879-6ecc-4217-8b76-77e4f9535a5c\") " pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:49:24.248300 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.248270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:49:24.251284 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.251264    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:49:24.261663 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.261647    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:49:24.272069 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.272047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb6qk\" (UniqueName: \"kubernetes.io/projected/85697c8e-79e5-406b-af56-0bd384abf371-kube-api-access-jb6qk\") pod \"network-check-target-4j2rg\" (UID: \"85697c8e-79e5-406b-af56-0bd384abf371\") " pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:49:24.424354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.424333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55fnh"
Jul 27 15:49:24.432099 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.432075    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcv26\""
Jul 27 15:49:24.440193 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.440172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:49:24.599029 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.598997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55fnh"]
Jul 27 15:49:24.602367 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:49:24.602336    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e55a879_6ecc_4217_8b76_77e4f9535a5c.slice/crio-0a6d927287b68e97090644dc5cfe1a13a1f87163a93ae55b7be9193ce2bf595e WatchSource:0}: Error finding container 0a6d927287b68e97090644dc5cfe1a13a1f87163a93ae55b7be9193ce2bf595e: Status 404 returned error can't find the container with id 0a6d927287b68e97090644dc5cfe1a13a1f87163a93ae55b7be9193ce2bf595e
Jul 27 15:49:24.610009 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.609987    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4j2rg"]
Jul 27 15:49:24.613233 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:49:24.613214    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85697c8e_79e5_406b_af56_0bd384abf371.slice/crio-d8eb35cd32dff265d3353f00cb24ba20c84a41569cf166655d4aee519c362256 WatchSource:0}: Error finding container d8eb35cd32dff265d3353f00cb24ba20c84a41569cf166655d4aee519c362256: Status 404 returned error can't find the container with id d8eb35cd32dff265d3353f00cb24ba20c84a41569cf166655d4aee519c362256
Jul 27 15:49:24.629884 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.629858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4j2rg" event={"ID":"85697c8e-79e5-406b-af56-0bd384abf371","Type":"ContainerStarted","Data":"d8eb35cd32dff265d3353f00cb24ba20c84a41569cf166655d4aee519c362256"}
Jul 27 15:49:24.630860 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.630840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55fnh" event={"ID":"2e55a879-6ecc-4217-8b76-77e4f9535a5c","Type":"ContainerStarted","Data":"0a6d927287b68e97090644dc5cfe1a13a1f87163a93ae55b7be9193ce2bf595e"}
Jul 27 15:49:24.651263 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:24.651243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:49:24.651359 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:24.651347    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:24.651399 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:24.651391    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:56.651378517 +0000 UTC m=+98.737334227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:29.646060 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:29.646022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4j2rg" event={"ID":"85697c8e-79e5-406b-af56-0bd384abf371","Type":"ContainerStarted","Data":"45ca63c4c08d67bceb8947f63186407ab17abeac47f739ecde8c70fdde97e1f1"}
Jul 27 15:49:29.646490 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:29.646130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:49:29.647523 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:29.647499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55fnh" event={"ID":"2e55a879-6ecc-4217-8b76-77e4f9535a5c","Type":"ContainerStarted","Data":"088f7f4f6d43670c7266f98a75ab1c3cbf738702ce3f68014d98eed6d138c55e"}
Jul 27 15:49:29.662683 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:29.662639    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4j2rg" podStartSLOduration=65.853507511 podStartE2EDuration="1m10.662623266s" totalImagesPullingTime="4.809115755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:49:29.662106733 +0000 UTC m=+71.748062465" watchObservedRunningTime="2026-07-27 15:49:29.662623266 +0000 UTC m=+71.748578998"
Jul 27 15:49:31.483076 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:31.483043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:31.583437 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:31.583406    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:49:56.662870 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:49:56.662831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:49:56.663408 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:56.662990    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:56.663408 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:49:56.663055    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:00.663038966 +0000 UTC m=+162.748994677 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:50:00.652409 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:50:00.652380    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4j2rg"
Jul 27 15:50:00.668915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:50:00.668867    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-55fnh" podStartSLOduration=96.845423734 podStartE2EDuration="1m41.6688407s" totalImagesPullingTime="4.823416966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:49:29.677871808 +0000 UTC m=+71.763827565" watchObservedRunningTime="2026-07-27 15:50:00.6688407 +0000 UTC m=+102.754796432"
Jul 27 15:50:28.070692 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:50:28.070638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:50:28.071214 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:50:28.070766    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 15:50:28.071214 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:50:28.070829    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs podName:70ec3b92-4fef-439d-8fa0-298eec85086c nodeName:}" failed. No retries permitted until 2026-07-27 15:52:30.070813371 +0000 UTC m=+252.156769081 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs") pod "network-metrics-daemon-fbmbs" (UID: "70ec3b92-4fef-439d-8fa0-298eec85086c") : secret "metrics-daemon-secret" not found
Jul 27 15:50:55.798295 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:50:55.798246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjnsk" podUID="a0608a0a-5ed2-4645-a5f6-c48ad14aeb87"
Jul 27 15:50:55.851070 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:50:55.851046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:50:57.417367 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:50:57.417314    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbmbs" podUID="70ec3b92-4fef-439d-8fa0-298eec85086c"
Jul 27 15:51:00.682892 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:00.682855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:51:00.683309 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:00.682987    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:51:00.683309 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:00.683037    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls podName:a0608a0a-5ed2-4645-a5f6-c48ad14aeb87 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:02.683023147 +0000 UTC m=+284.768978857 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls") pod "dns-default-xjnsk" (UID: "a0608a0a-5ed2-4645-a5f6-c48ad14aeb87") : secret "dns-default-metrics-tls" not found
Jul 27 15:51:10.405610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:10.405522    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:51:34.494339 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.494300    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"]
Jul 27 15:51:34.496062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.496042    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"]
Jul 27 15:51:34.496189 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.496168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.497937 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.497914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.499104 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.499074    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.500456 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500436    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.500682 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500664    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qrthp\""
Jul 27 15:51:34.500762 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500739    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 15:51:34.500809 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500787    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.500865 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500810    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 15:51:34.500865 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.500834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 15:51:34.501623 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.501602    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.501718 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.501702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 15:51:34.511746 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.511727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"]
Jul 27 15:51:34.517419 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.517400    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"]
Jul 27 15:51:34.599064 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.599027    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dbbb99794-9twgs"]
Jul 27 15:51:34.601681 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.601653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.604628 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.604598    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 15:51:34.604764 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.604740    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twmt9\""
Jul 27 15:51:34.604851 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.604834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 15:51:34.605114 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.605099    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 15:51:34.610818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.610800    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 15:51:34.610992 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.610972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e6f39ea-2947-4718-aeff-f4ac06b851d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.611040 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.611021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqhh\" (UniqueName: \"kubernetes.io/projected/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-kube-api-access-8nqhh\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.611074 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.611042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-tmp\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.611074 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.611066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.611140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.611114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.611181 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.611160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrlkz\" (UniqueName: \"kubernetes.io/projected/5e6f39ea-2947-4718-aeff-f4ac06b851d1-kube-api-access-zrlkz\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.619707 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.619685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbbb99794-9twgs"]
Jul 27 15:51:34.706549 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.706518    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"]
Jul 27 15:51:34.708264 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.708249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.711478 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.711604 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrlkz\" (UniqueName: \"kubernetes.io/projected/5e6f39ea-2947-4718-aeff-f4ac06b851d1-kube-api-access-zrlkz\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.711604 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e6f39ea-2947-4718-aeff-f4ac06b851d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.711604 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqhh\" (UniqueName: \"kubernetes.io/projected/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-kube-api-access-8nqhh\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.711604 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwld7\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-tmp\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.711807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.712177 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.712177 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:34.711893    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:34.712177 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.711920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.712177 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:34.711992    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:35.211942248 +0000 UTC m=+197.297898215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:34.712177 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.712136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-tmp\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.712434 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.712284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e6f39ea-2947-4718-aeff-f4ac06b851d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.714239 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.714204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.716128 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.716103    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 15:51:34.716206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.716142    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.716268 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.716250    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.716407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.716394    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t6ncv\""
Jul 27 15:51:34.720915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.720896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 15:51:34.727028 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.727008    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"]
Jul 27 15:51:34.728978 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.728933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqhh\" (UniqueName: \"kubernetes.io/projected/38d7da00-5a4f-4384-b3d1-a3a7f5b6064f-kube-api-access-8nqhh\") pod \"klusterlet-addon-workmgr-9966b9d44-mq889\" (UID: \"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.733877 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.733859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrlkz\" (UniqueName: \"kubernetes.io/projected/5e6f39ea-2947-4718-aeff-f4ac06b851d1-kube-api-access-zrlkz\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:34.811346 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.811287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:34.812464 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwld7\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.812530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812682 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812682 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812682 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.812827 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-config\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.812827 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:34.812728    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:34.812827 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:34.812743    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:34.812827 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:34.812789    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:35.312771287 +0000 UTC m=+197.398727000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:34.812827 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zvlw\" (UniqueName: \"kubernetes.io/projected/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-kube-api-access-2zvlw\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.813101 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.813101 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.812891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.813101 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.813024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.813990 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.813602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.814090 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.814065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.815081 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.815054    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.815204 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.815188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.822335 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.822268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.823008 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.822988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwld7\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:34.913454 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.913424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-config\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.913611 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.913485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zvlw\" (UniqueName: \"kubernetes.io/projected/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-kube-api-access-2zvlw\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.913611 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.913537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.914221 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.914196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-config\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.915605 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.915580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.925908 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.925883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zvlw\" (UniqueName: \"kubernetes.io/projected/efc6c6a0-6811-4e51-82b1-6093ed5d6ea5-kube-api-access-2zvlw\") pod \"service-ca-operator-5d6c75f84f-gxnsd\" (UID: \"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:34.938555 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.938522    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"]
Jul 27 15:51:34.941214 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:51:34.941194    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d7da00_5a4f_4384_b3d1_a3a7f5b6064f.slice/crio-59ba770609c3fc644b3f9a83364b4930ef0c005d36cc352626667a612d3bf421 WatchSource:0}: Error finding container 59ba770609c3fc644b3f9a83364b4930ef0c005d36cc352626667a612d3bf421: Status 404 returned error can't find the container with id 59ba770609c3fc644b3f9a83364b4930ef0c005d36cc352626667a612d3bf421
Jul 27 15:51:34.961944 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:34.961923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:35.020893 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.020869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"
Jul 27 15:51:35.061914 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.061849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:35.141044 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.141011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd"]
Jul 27 15:51:35.143839 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:51:35.143815    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc6c6a0_6811_4e51_82b1_6093ed5d6ea5.slice/crio-da4aa63158d399a7fa12833f6978dce57497781cc7f7337e8af9030ada8c4c80 WatchSource:0}: Error finding container da4aa63158d399a7fa12833f6978dce57497781cc7f7337e8af9030ada8c4c80: Status 404 returned error can't find the container with id da4aa63158d399a7fa12833f6978dce57497781cc7f7337e8af9030ada8c4c80
Jul 27 15:51:35.215719 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.215685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:35.215849 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:35.215832    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:35.215901 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:35.215891    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:36.21587589 +0000 UTC m=+198.301831600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:35.316221 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.316159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:35.316305 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:35.316281    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:35.316305 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:35.316291    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:35.316372 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:35.316332    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:36.316319528 +0000 UTC m=+198.402275238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:35.942291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.942252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd" event={"ID":"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5","Type":"ContainerStarted","Data":"da4aa63158d399a7fa12833f6978dce57497781cc7f7337e8af9030ada8c4c80"}
Jul 27 15:51:35.943839 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:35.943783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889" event={"ID":"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f","Type":"ContainerStarted","Data":"59ba770609c3fc644b3f9a83364b4930ef0c005d36cc352626667a612d3bf421"}
Jul 27 15:51:36.222899 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:36.222809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:36.223084 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:36.223004    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:36.223084 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:36.223073    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:38.223052146 +0000 UTC m=+200.309007862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:36.323784 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:36.323744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:36.323982 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:36.323908    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:36.323982 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:36.323930    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:36.324102 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:36.324011    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:38.323990622 +0000 UTC m=+200.409946331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:37.305150 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:37.305112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:37.373390 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:37.373336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:38.239425 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:38.239379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:38.239978 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:38.239783    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:38.239978 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:38.239888    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.239853144 +0000 UTC m=+204.325808868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:38.339974 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:38.339923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:38.340429 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:38.340112    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:38.340429 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:38.340138    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:38.340429 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:38.340209    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.340187712 +0000 UTC m=+204.426143421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:39.955877 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.955841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd" event={"ID":"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5","Type":"ContainerStarted","Data":"9109c92c9530c4832421e0ad6c0f6ba841e9d68d3df961cf3000ec791208756c"}
Jul 27 15:51:39.957250 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.957225    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889" event={"ID":"38d7da00-5a4f-4384-b3d1-a3a7f5b6064f","Type":"ContainerStarted","Data":"b07645cddbbacbf10b6d57d1c4522f7329ffe01a775a4e8b682b94003ae7430c"}
Jul 27 15:51:39.957444 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.957426    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:39.959009 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.958991    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889"
Jul 27 15:51:39.973022 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.972981    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd" podStartSLOduration=1.943981036 podStartE2EDuration="5.972951342s" totalImagesPullingTime="4.028970306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:39.972450087 +0000 UTC m=+202.058405816" watchObservedRunningTime="2026-07-27 15:51:39.972951342 +0000 UTC m=+202.058907073"
Jul 27 15:51:39.987347 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:39.987304    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9966b9d44-mq889" podStartSLOduration=1.742736309 podStartE2EDuration="5.987288423s" totalImagesPullingTime="4.244552114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:39.986718554 +0000 UTC m=+202.072674286" watchObservedRunningTime="2026-07-27 15:51:39.987288423 +0000 UTC m=+202.073244159"
Jul 27 15:51:40.208435 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.208364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.236824 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.236789    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"]
Jul 27 15:51:40.240199 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.240180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"
Jul 27 15:51:40.242874 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.242854    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 15:51:40.242874 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.242854    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 15:51:40.243054 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.242855    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ktvxw\""
Jul 27 15:51:40.248117 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.247772    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"]
Jul 27 15:51:40.291690 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.291656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.352010 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.351978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.356090 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.356072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jggtf\" (UniqueName: \"kubernetes.io/projected/45b66abd-5cd8-4687-ae4c-423b494b94f2-kube-api-access-jggtf\") pod \"migrator-6865c9967-8lczd\" (UID: \"45b66abd-5cd8-4687-ae4c-423b494b94f2\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"
Jul 27 15:51:40.456807 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.456777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jggtf\" (UniqueName: \"kubernetes.io/projected/45b66abd-5cd8-4687-ae4c-423b494b94f2-kube-api-access-jggtf\") pod \"migrator-6865c9967-8lczd\" (UID: \"45b66abd-5cd8-4687-ae4c-423b494b94f2\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"
Jul 27 15:51:40.464942 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.464879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jggtf\" (UniqueName: \"kubernetes.io/projected/45b66abd-5cd8-4687-ae4c-423b494b94f2-kube-api-access-jggtf\") pod \"migrator-6865c9967-8lczd\" (UID: \"45b66abd-5cd8-4687-ae4c-423b494b94f2\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"
Jul 27 15:51:40.550920 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.550887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"
Jul 27 15:51:40.643814 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.643776    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-49rf9"]
Jul 27 15:51:40.647679 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.647654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.650921 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.650747    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 15:51:40.650921 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.650749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 15:51:40.650921 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.650807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 15:51:40.651224 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.651167    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgjlr\""
Jul 27 15:51:40.651356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.651335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 15:51:40.656211 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.655866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-49rf9"]
Jul 27 15:51:40.675294 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.675273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.686493 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.683372    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd"]
Jul 27 15:51:40.689292 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:51:40.689268    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b66abd_5cd8_4687_ae4c_423b494b94f2.slice/crio-3b2fc3c52e32662a7d02ec74efbe01ea0dc2c598aa311ceaf262c72e926ce118 WatchSource:0}: Error finding container 3b2fc3c52e32662a7d02ec74efbe01ea0dc2c598aa311ceaf262c72e926ce118: Status 404 returned error can't find the container with id 3b2fc3c52e32662a7d02ec74efbe01ea0dc2c598aa311ceaf262c72e926ce118
Jul 27 15:51:40.741641 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.741535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.759645 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.759611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.759795 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.759699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.759795 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.759742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-data-volume\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.759795 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.759766    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxft\" (UniqueName: \"kubernetes.io/projected/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-api-access-cvxft\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.759915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.759876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-crio-socket\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861145 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861105    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-crio-socket\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861295 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861295 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-crio-socket\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861295 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:40.861249    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:40.861409 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:40.861310    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:41.36129174 +0000 UTC m=+203.447247453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:40.861409 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861322    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861409 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-data-volume\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861536 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:40.861502    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:40.861578 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxft\" (UniqueName: \"kubernetes.io/projected/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-api-access-cvxft\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.861670 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:40.861588    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:41.36157166 +0000 UTC m=+203.447527378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:40.861670 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.861660    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-data-volume\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.870632 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.870613    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxft\" (UniqueName: \"kubernetes.io/projected/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-api-access-cvxft\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:40.941799 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.941769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:40.960581 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:40.960550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd" event={"ID":"45b66abd-5cd8-4687-ae4c-423b494b94f2","Type":"ContainerStarted","Data":"3b2fc3c52e32662a7d02ec74efbe01ea0dc2c598aa311ceaf262c72e926ce118"}
Jul 27 15:51:41.002384 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.002305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:41.150012 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.149978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:41.224206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.224173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:41.365491 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.365453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:41.365672 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.365554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:41.365672 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:41.365595    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:41.365672 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:41.365663    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:41.365783 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:41.365678    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.365660947 +0000 UTC m=+204.451616677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:41.365783 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:41.365713    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.365700363 +0000 UTC m=+204.451656074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:41.604906 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.604869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:41.873772 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.873740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:41.965024 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.964971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd" event={"ID":"45b66abd-5cd8-4687-ae4c-423b494b94f2","Type":"ContainerStarted","Data":"6a1c00952172e36fb07e10a9eb535e9d5f7285662bf05e70ba4421ed772f30d5"}
Jul 27 15:51:41.965024 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.965022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd" event={"ID":"45b66abd-5cd8-4687-ae4c-423b494b94f2","Type":"ContainerStarted","Data":"eddcba13f110f7faacbf3ae2e48d2403275199f10436e5ae1ec3d15cc6c6951c"}
Jul 27 15:51:41.981362 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:41.981320    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8lczd" podStartSLOduration=0.859421957 podStartE2EDuration="1.981305839s" totalImagesPullingTime="1.121883882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:41.979780146 +0000 UTC m=+204.065735878" watchObservedRunningTime="2026-07-27 15:51:41.981305839 +0000 UTC m=+204.067261570"
Jul 27 15:51:42.082205 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.082173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:42.228576 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.228543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:42.273936 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.273905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:42.274086 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.274032    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:42.274086 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.274081    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:50.274069029 +0000 UTC m=+212.360024739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:42.374820 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.374738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:42.374820 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.374779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:42.375013 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.374880    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:42.375013 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.374894    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:42.375013 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.374920    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:42.375013 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.374947    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:50.37492903 +0000 UTC m=+212.460884742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:42.375013 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:42.374999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:42.375171 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.375026    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:44.375001651 +0000 UTC m=+206.460957367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:42.375171 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.375066    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:42.375171 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:42.375106    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:44.375094089 +0000 UTC m=+206.461049813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:43.298329 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:43.298297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:43.398909 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:43.398874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:43.428261 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:43.428240    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tpr4z_cd716f01-bac1-41c0-aaf6-b63bff3a2669/dns-node-resolver/0.log"
Jul 27 15:51:44.126581 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:44.126539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:44.390049 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:44.389940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:44.390448 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:44.390066    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:44.390448 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:44.390129    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:48.39011431 +0000 UTC m=+210.476070020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:44.390448 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:44.390149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:44.390448 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:44.390282    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:44.390448 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:44.390312    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:48.390304169 +0000 UTC m=+210.476259879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:44.628756 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:44.628730    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkx4k_eca20836-d166-4b2e-9667-3852a70b397a/node-ca/0.log"
Jul 27 15:51:45.428833 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:45.428806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9rlq_3a24a7f9-a457-4f56-98aa-0d8849b4f0f2/serve-healthcheck-canary/0.log"
Jul 27 15:51:45.629147 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:45.629121    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8lczd_45b66abd-5cd8-4687-ae4c-423b494b94f2/migrator/0.log"
Jul 27 15:51:45.828559 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:45.828536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8lczd_45b66abd-5cd8-4687-ae4c-423b494b94f2/graceful-termination/0.log"
Jul 27 15:51:46.128818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:46.128731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:46.203441 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:46.203412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:46.686920 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:46.686889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:47.625421 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:47.625389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:47.878949 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:47.878866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:47.979553 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:47.979506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:48.325098 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:48.325068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:48.418841 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:48.418809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:48.419023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:48.418867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:48.419023 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:48.418928    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:48.419023 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:48.418994    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:48.419023 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:48.419014    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:56.418995763 +0000 UTC m=+218.504951485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:48.419156 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:48.419034    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:56.41902224 +0000 UTC m=+218.504977966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:49.719169 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:49.719138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:49.790643 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:49.790613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:49.937518 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:49.937487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:50.146772 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:50.146724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:50.326696 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:50.326633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:50.333765 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:50.333738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:51:50.333883 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:50.333851    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:50.333937 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:50.333925    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls podName:5e6f39ea-2947-4718-aeff-f4ac06b851d1 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:06.333904886 +0000 UTC m=+228.419860610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4qdfn" (UID: "5e6f39ea-2947-4718-aeff-f4ac06b851d1") : secret "cluster-monitoring-operator-tls" not found
Jul 27 15:51:50.434800 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:50.434722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") pod \"image-registry-dbbb99794-9twgs\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") " pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:51:50.434911 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:50.434872    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:51:50.434911 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:50.434888    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbbb99794-9twgs: secret "image-registry-tls" not found
Jul 27 15:51:50.435007 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:50.434935    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls podName:ebbb77c0-d1b6-4ec2-8126-f5358b265988 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:06.434920288 +0000 UTC m=+228.520875999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls") pod "image-registry-dbbb99794-9twgs" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988") : secret "image-registry-tls" not found
Jul 27 15:51:51.227201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:51.227161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:51.331534 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:51.331502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:51.569273 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:51.569183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:51.734222 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:51.734165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:51.945331 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:51.945300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:52.130676 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:52.130645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:52.326345 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:52.326324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:53.325419 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:53.325390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:55.313004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:55.312954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:55.396589 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:55.396554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:55.525634 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:55.525604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:56.130714 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.130681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:56.216903 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.216877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:56.482613 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.482535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:56.482613 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.482586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:56.483030 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:56.482706    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:56.483030 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:51:56.482767    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls podName:96bdbd86-6c2e-4c6a-9dee-4fadf6131e18 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:12.482752363 +0000 UTC m=+234.568708074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49rf9" (UID: "96bdbd86-6c2e-4c6a-9dee-4fadf6131e18") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:56.483102 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.483063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:51:56.740478 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:56.740397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:57.131357 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:57.131328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:58.347024 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:58.346992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:51:58.428519 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:51:58.428489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:01.681548 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:01.681513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:01.735814 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:01.735775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:02.625288 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:02.625249    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbbb99794-9twgs"]
Jul 27 15:52:02.625506 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:02.625478    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-dbbb99794-9twgs" podUID="ebbb77c0-d1b6-4ec2-8126-f5358b265988"
Jul 27 15:52:02.699503 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:02.699469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:02.843738 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:02.843705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:03.026112 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.026034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:52:03.032405 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.032384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:52:03.133573 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133541    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.133730 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133586    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.133730 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133609    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.133809 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133786    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.133854 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.133899 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:52:03.133899 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133866    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.134034 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.133927    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwld7\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7\") pod \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\" (UID: \"ebbb77c0-d1b6-4ec2-8126-f5358b265988\") "
Jul 27 15:52:03.134153 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.134121    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:52:03.134236 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.134149    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:52:03.134279 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.134264    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-certificates\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.134317 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.134289    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebbb77c0-d1b6-4ec2-8126-f5358b265988-trusted-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.134317 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.134305    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebbb77c0-d1b6-4ec2-8126-f5358b265988-ca-trust-extracted\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.136105 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.136072    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:52:03.136105 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.136088    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7" (OuterVolumeSpecName: "kube-api-access-hwld7") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "kube-api-access-hwld7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:52:03.136241 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.136159    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:52:03.136241 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.136196    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ebbb77c0-d1b6-4ec2-8126-f5358b265988" (UID: "ebbb77c0-d1b6-4ec2-8126-f5358b265988"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:52:03.235609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.235568    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-image-registry-private-configuration\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.235609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.235602    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebbb77c0-d1b6-4ec2-8126-f5358b265988-installation-pull-secrets\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.235609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.235613    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwld7\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-kube-api-access-hwld7\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:03.235609 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:03.235623    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-bound-sa-token\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:04.028273 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:04.028244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbbb99794-9twgs"
Jul 27 15:52:04.062153 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:04.062125    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbbb99794-9twgs"]
Jul 27 15:52:04.065307 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:04.065283    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dbbb99794-9twgs"]
Jul 27 15:52:04.141719 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:04.141691    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebbb77c0-d1b6-4ec2-8126-f5358b265988-registry-tls\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:52:04.408948 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:04.408918    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebbb77c0-d1b6-4ec2-8126-f5358b265988" path="/var/lib/kubelet/pods/ebbb77c0-d1b6-4ec2-8126-f5358b265988/volumes"
Jul 27 15:52:06.363950 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:06.363891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:52:06.366369 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:06.366344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e6f39ea-2947-4718-aeff-f4ac06b851d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4qdfn\" (UID: \"5e6f39ea-2947-4718-aeff-f4ac06b851d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:52:06.606839 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:06.606802    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"
Jul 27 15:52:06.729950 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:06.729917    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn"]
Jul 27 15:52:06.733131 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:06.733098    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6f39ea_2947_4718_aeff_f4ac06b851d1.slice/crio-305982f1161b01980e119dd5d13897914ecae743ce7acf1356a8c0f6ea045c97 WatchSource:0}: Error finding container 305982f1161b01980e119dd5d13897914ecae743ce7acf1356a8c0f6ea045c97: Status 404 returned error can't find the container with id 305982f1161b01980e119dd5d13897914ecae743ce7acf1356a8c0f6ea045c97
Jul 27 15:52:07.037601 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:07.037513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn" event={"ID":"5e6f39ea-2947-4718-aeff-f4ac06b851d1","Type":"ContainerStarted","Data":"305982f1161b01980e119dd5d13897914ecae743ce7acf1356a8c0f6ea045c97"}
Jul 27 15:52:07.250102 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:07.250070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:07.387268 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:07.387211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:08.473878 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.473844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:08.575364 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.575328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:08.674876 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.674797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:08.838093 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.838057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:08.843977 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.843942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"]
Jul 27 15:52:08.846854 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.846839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:08.849344 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.849324    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 15:52:08.849438 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.849325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lblqf\""
Jul 27 15:52:08.857593 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.857571    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"]
Jul 27 15:52:08.982622 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:08.982535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b784fa71-ab87-4053-8a16-a5b24f557839-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-j8z6v\" (UID: \"b784fa71-ab87-4053-8a16-a5b24f557839\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:09.044296 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.044262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn" event={"ID":"5e6f39ea-2947-4718-aeff-f4ac06b851d1","Type":"ContainerStarted","Data":"aa1b13192676b35f273ea3fa54b9aea516d54d201cac611c52e7b194b1984f74"}
Jul 27 15:52:09.070796 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.070742    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4qdfn" podStartSLOduration=33.45913146 podStartE2EDuration="35.070723775s" totalImagesPullingTime="1.611592315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:09.070297816 +0000 UTC m=+231.156253559" watchObservedRunningTime="2026-07-27 15:52:09.070723775 +0000 UTC m=+231.156679485"
Jul 27 15:52:09.083574 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.083546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b784fa71-ab87-4053-8a16-a5b24f557839-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-j8z6v\" (UID: \"b784fa71-ab87-4053-8a16-a5b24f557839\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:09.085908 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.085882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b784fa71-ab87-4053-8a16-a5b24f557839-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-j8z6v\" (UID: \"b784fa71-ab87-4053-8a16-a5b24f557839\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:09.133719 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.133694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:09.155776 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.155743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:09.275731 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:09.275622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"]
Jul 27 15:52:09.279680 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:09.279648    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb784fa71_ab87_4053_8a16_a5b24f557839.slice/crio-6368784fbab3f5a66c87538c7fce71a5521505d8519d96435a14c2f8ac7a5d82 WatchSource:0}: Error finding container 6368784fbab3f5a66c87538c7fce71a5521505d8519d96435a14c2f8ac7a5d82: Status 404 returned error can't find the container with id 6368784fbab3f5a66c87538c7fce71a5521505d8519d96435a14c2f8ac7a5d82
Jul 27 15:52:10.048768 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:10.048736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v" event={"ID":"b784fa71-ab87-4053-8a16-a5b24f557839","Type":"ContainerStarted","Data":"6368784fbab3f5a66c87538c7fce71a5521505d8519d96435a14c2f8ac7a5d82"}
Jul 27 15:52:12.056891 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.056859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v" event={"ID":"b784fa71-ab87-4053-8a16-a5b24f557839","Type":"ContainerStarted","Data":"428bffdd60249696f599064934a6dcec66f285a8f4d813dc3b8c53a5a25fb469"}
Jul 27 15:52:12.057320 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.057082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:12.061770 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.061738    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v"
Jul 27 15:52:12.073347 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.073309    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-j8z6v" podStartSLOduration=2.124922644 podStartE2EDuration="4.073296141s" totalImagesPullingTime="1.948373497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:12.072614488 +0000 UTC m=+234.158570219" watchObservedRunningTime="2026-07-27 15:52:12.073296141 +0000 UTC m=+234.159251873"
Jul 27 15:52:12.509559 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.509522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:52:12.511727 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.511708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96bdbd86-6c2e-4c6a-9dee-4fadf6131e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49rf9\" (UID: \"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18\") " pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:52:12.759949 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.759863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-49rf9"
Jul 27 15:52:12.879363 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.879334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:12.913025 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.912991    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-49rf9"]
Jul 27 15:52:12.916238 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:12.916218    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bdbd86_6c2e_4c6a_9dee_4fadf6131e18.slice/crio-40cea6b7af709a6397f4328986f6431b6bea5caf4912ab8e2097372cf6d2591d WatchSource:0}: Error finding container 40cea6b7af709a6397f4328986f6431b6bea5caf4912ab8e2097372cf6d2591d: Status 404 returned error can't find the container with id 40cea6b7af709a6397f4328986f6431b6bea5caf4912ab8e2097372cf6d2591d
Jul 27 15:52:12.921837 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.921813    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"]
Jul 27 15:52:12.948547 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.948508    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"]
Jul 27 15:52:12.948703 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.948624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:12.960525 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.960505    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w7l7p\""
Jul 27 15:52:12.961523 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.961508    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 15:52:12.962775 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.962760    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 15:52:12.963003 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:12.962991    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 15:52:13.014086 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.014003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.014086 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.014050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aff19d2-df7d-401e-aab5-7a63aec0701e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.014283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.014107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.014283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.014137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpm5v\" (UniqueName: \"kubernetes.io/projected/8aff19d2-df7d-401e-aab5-7a63aec0701e-kube-api-access-rpm5v\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.032603 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.032576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:13.060298 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.060266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49rf9" event={"ID":"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18","Type":"ContainerStarted","Data":"40cea6b7af709a6397f4328986f6431b6bea5caf4912ab8e2097372cf6d2591d"}
Jul 27 15:52:13.110995 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.110947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:13.114966 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.114936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aff19d2-df7d-401e-aab5-7a63aec0701e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.115027 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.115010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.115060 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.115038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpm5v\" (UniqueName: \"kubernetes.io/projected/8aff19d2-df7d-401e-aab5-7a63aec0701e-kube-api-access-rpm5v\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.115093 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.115069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.115579 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.115559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aff19d2-df7d-401e-aab5-7a63aec0701e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.117453 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.117427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.117530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.117518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aff19d2-df7d-401e-aab5-7a63aec0701e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.124050 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.124031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpm5v\" (UniqueName: \"kubernetes.io/projected/8aff19d2-df7d-401e-aab5-7a63aec0701e-kube-api-access-rpm5v\") pod \"prometheus-operator-84d69f794d-hm6zs\" (UID: \"8aff19d2-df7d-401e-aab5-7a63aec0701e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.257893 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.257860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"
Jul 27 15:52:13.401860 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:13.401829    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hm6zs"]
Jul 27 15:52:13.404579 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:13.404555    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aff19d2_df7d_401e_aab5_7a63aec0701e.slice/crio-f5621bb4944cdf6dad9dab6f1438dd644184561dbe0a8fb66ea98ef7a6cd67c3 WatchSource:0}: Error finding container f5621bb4944cdf6dad9dab6f1438dd644184561dbe0a8fb66ea98ef7a6cd67c3: Status 404 returned error can't find the container with id f5621bb4944cdf6dad9dab6f1438dd644184561dbe0a8fb66ea98ef7a6cd67c3
Jul 27 15:52:14.064415 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:14.064376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs" event={"ID":"8aff19d2-df7d-401e-aab5-7a63aec0701e","Type":"ContainerStarted","Data":"f5621bb4944cdf6dad9dab6f1438dd644184561dbe0a8fb66ea98ef7a6cd67c3"}
Jul 27 15:52:19.334263 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:19.334228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:20.084792 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:20.084754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49rf9" event={"ID":"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18","Type":"ContainerStarted","Data":"a1d273e5aab7aab2f77d9c4eb5624111940664641c8a5a5b4f804320cb0217bd"}
Jul 27 15:52:20.086382 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:20.086358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs" event={"ID":"8aff19d2-df7d-401e-aab5-7a63aec0701e","Type":"ContainerStarted","Data":"13b51d1ba5fa3d62cfbbc8ee9f1a8fb18d1945688dcfd018479555342364b96f"}
Jul 27 15:52:20.086518 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:20.086398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs" event={"ID":"8aff19d2-df7d-401e-aab5-7a63aec0701e","Type":"ContainerStarted","Data":"8bd96562d6e020522bf034a61f98f796d2fc51ace7f8873ef507fe9147a1c128"}
Jul 27 15:52:20.106060 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:20.106019    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-hm6zs" podStartSLOduration=2.484694587 podStartE2EDuration="8.106005257s" totalImagesPullingTime="5.62131067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:20.105102942 +0000 UTC m=+242.191058675" watchObservedRunningTime="2026-07-27 15:52:20.106005257 +0000 UTC m=+242.191960988"
Jul 27 15:52:22.049079 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.049043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:22.289435 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.289402    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"]
Jul 27 15:52:22.315170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.315100    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"]
Jul 27 15:52:22.315170 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.315147    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"]
Jul 27 15:52:22.315337 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.315287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.317975 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.317939    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 15:52:22.318114 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.318005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 15:52:22.318114 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.318008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bgp59\""
Jul 27 15:52:22.320196 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.320174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.323631 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.323614    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 15:52:22.323790 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.323773    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 15:52:22.323889 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.323868    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7qztb\""
Jul 27 15:52:22.324733 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.324720    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 15:52:22.333289 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.333269    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"]
Jul 27 15:52:22.346467 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.346443    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bnrr7"]
Jul 27 15:52:22.349782 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.349759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.352756 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.352733    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 15:52:22.352756 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.352733    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 15:52:22.352908 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.352851    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 15:52:22.353243 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.353229    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t7cjz\""
Jul 27 15:52:22.389402 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.389569 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mds9j\" (UniqueName: \"kubernetes.io/projected/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-api-access-mds9j\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.389569 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.389569 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a8068e7-20b0-46f3-b81b-6bedd25648b0-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.389720 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2m5r\" (UniqueName: \"kubernetes.io/projected/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-kube-api-access-z2m5r\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.389720 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.389720 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.389720 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.389856 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.389856 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.389773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.491206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2m5r\" (UniqueName: \"kubernetes.io/projected/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-kube-api-access-z2m5r\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.491206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-metrics-client-ca\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9hd\" (UniqueName: \"kubernetes.io/projected/4ca62254-9505-4d94-8381-d19db3cefef0-kube-api-access-nv9hd\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-sys\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-wtmp\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:22.491625    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 15:52:22.491818 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:22.491702    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls podName:9a8068e7-20b0-46f3-b81b-6bedd25648b0 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:22.991676724 +0000 UTC m=+245.077632434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-2ptq5" (UID: "9a8068e7-20b0-46f3-b81b-6bedd25648b0") : secret "kube-state-metrics-tls" not found
Jul 27 15:52:22.492140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-textfile\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.492140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.491952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mds9j\" (UniqueName: \"kubernetes.io/projected/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-api-access-mds9j\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.492140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-root\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.492140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.492140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a8068e7-20b0-46f3-b81b-6bedd25648b0-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.492376 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.492557 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a8068e7-20b0-46f3-b81b-6bedd25648b0-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.492557 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.492484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.493084 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.493063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.494091 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.494072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.494196 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.494173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.494480 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.494458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.504550 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.504513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2m5r\" (UniqueName: \"kubernetes.io/projected/af7434e7-66c6-4c6e-a22e-872a1a3eebdc-kube-api-access-z2m5r\") pod \"openshift-state-metrics-b8f49f5c6-5swqc\" (UID: \"af7434e7-66c6-4c6e-a22e-872a1a3eebdc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.504714 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.504691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mds9j\" (UniqueName: \"kubernetes.io/projected/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-api-access-mds9j\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:22.593090 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-metrics-client-ca\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593291 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9hd\" (UniqueName: \"kubernetes.io/projected/4ca62254-9505-4d94-8381-d19db3cefef0-kube-api-access-nv9hd\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593381 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-sys\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593381 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593381 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-wtmp\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593511 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593511 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-textfile\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593583 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-root\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593676 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593656    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-metrics-client-ca\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593737 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593737 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-root\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593809 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:22.593773    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 15:52:22.593846 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-wtmp\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.593846 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:22.593825    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls podName:4ca62254-9505-4d94-8381-d19db3cefef0 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:23.093808076 +0000 UTC m=+245.179763801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls") pod "node-exporter-bnrr7" (UID: "4ca62254-9505-4d94-8381-d19db3cefef0") : secret "node-exporter-tls" not found
Jul 27 15:52:22.593999 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.593949    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ca62254-9505-4d94-8381-d19db3cefef0-sys\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.594236 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.594211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-textfile\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.596384 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.596363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.605514 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.605489    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9hd\" (UniqueName: \"kubernetes.io/projected/4ca62254-9505-4d94-8381-d19db3cefef0-kube-api-access-nv9hd\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:22.626632 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.626599    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"
Jul 27 15:52:22.998281 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:22.998175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:23.000716 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.000682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a8068e7-20b0-46f3-b81b-6bedd25648b0-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ptq5\" (UID: \"9a8068e7-20b0-46f3-b81b-6bedd25648b0\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:23.099131 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.099096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:23.101664 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.101642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ca62254-9505-4d94-8381-d19db3cefef0-node-exporter-tls\") pod \"node-exporter-bnrr7\" (UID: \"4ca62254-9505-4d94-8381-d19db3cefef0\") " pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:23.115530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.115503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:23.160104 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.160079    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc"]
Jul 27 15:52:23.162258 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:23.162229    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7434e7_66c6_4c6e_a22e_872a1a3eebdc.slice/crio-6ea00c75165c3520a555907dc0cbade3af109597bba73b544070dbf4b1738e68 WatchSource:0}: Error finding container 6ea00c75165c3520a555907dc0cbade3af109597bba73b544070dbf4b1738e68: Status 404 returned error can't find the container with id 6ea00c75165c3520a555907dc0cbade3af109597bba73b544070dbf4b1738e68
Jul 27 15:52:23.223869 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.223199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:23.231614 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.231595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"
Jul 27 15:52:23.258911 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.258889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnrr7"
Jul 27 15:52:23.270025 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:23.269994    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca62254_9505_4d94_8381_d19db3cefef0.slice/crio-77d0eeab6843e62287b118499b9ad866b756cfd74f80d3a4e544bf5a2964b4d1 WatchSource:0}: Error finding container 77d0eeab6843e62287b118499b9ad866b756cfd74f80d3a4e544bf5a2964b4d1: Status 404 returned error can't find the container with id 77d0eeab6843e62287b118499b9ad866b756cfd74f80d3a4e544bf5a2964b4d1
Jul 27 15:52:23.322264 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.322160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:23.359451 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.359411    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:52:23.364697 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.364662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.367501 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.367477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 15:52:23.367631 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.367477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 15:52:23.367631 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.367575    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 15:52:23.368108 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.367850    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 15:52:23.368108 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.367901    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 15:52:23.368108 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.368019    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 15:52:23.368379 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.368131    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tzjqd\""
Jul 27 15:52:23.369172 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.368836    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 15:52:23.369172 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.368879    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 15:52:23.369172 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.369049    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 15:52:23.382277 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.382180    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:52:23.413386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.413353    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5"]
Jul 27 15:52:23.416562 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:23.416529    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8068e7_20b0_46f3_b81b_6bedd25648b0.slice/crio-040b871c3cc66034ce5bb2d5a0e5c618eafbe6ecbefca8cd378d02802e99947c WatchSource:0}: Error finding container 040b871c3cc66034ce5bb2d5a0e5c618eafbe6ecbefca8cd378d02802e99947c: Status 404 returned error can't find the container with id 040b871c3cc66034ce5bb2d5a0e5c618eafbe6ecbefca8cd378d02802e99947c
Jul 27 15:52:23.417965 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.417932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:23.504133 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504133 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504133 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504104    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9pt\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504539 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504539 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504539 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504539 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.504539 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.504466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605122 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605297 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605496 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605496 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605496 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605496 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9pt\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.605749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.606019 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.605932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.607312 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:23.606151    2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 27 15:52:23.607312 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:23.606212    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls podName:e69326a4-de42-4be9-99bd-d547dea2c405 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:24.106192872 +0000 UTC m=+246.192148586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405") : secret "alertmanager-main-tls" not found
Jul 27 15:52:23.607312 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.607118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.608543 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.608487    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.609389 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.609348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.609389 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.609355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.609513 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.609485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.609740 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.609719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.609795 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.609773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.610672 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.610651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.610926 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.610906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.618484 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.618461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9pt\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:23.871364 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:23.871290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:24.105482 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.105440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnrr7" event={"ID":"4ca62254-9505-4d94-8381-d19db3cefef0","Type":"ContainerStarted","Data":"77d0eeab6843e62287b118499b9ad866b756cfd74f80d3a4e544bf5a2964b4d1"}
Jul 27 15:52:24.109240 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.109210    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc" event={"ID":"af7434e7-66c6-4c6e-a22e-872a1a3eebdc","Type":"ContainerStarted","Data":"758bda5ac4ce6e34d980a155ef6a33c2401c40d11370f13214162ffcb34c8904"}
Jul 27 15:52:24.109354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.109276    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc" event={"ID":"af7434e7-66c6-4c6e-a22e-872a1a3eebdc","Type":"ContainerStarted","Data":"f80b71224e35925bedd382eec1b6efb81ff8b68c8ec97857508ffbe58411ba42"}
Jul 27 15:52:24.109354 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.109308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc" event={"ID":"af7434e7-66c6-4c6e-a22e-872a1a3eebdc","Type":"ContainerStarted","Data":"6ea00c75165c3520a555907dc0cbade3af109597bba73b544070dbf4b1738e68"}
Jul 27 15:52:24.110462 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.110339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:24.112035 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.111971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49rf9" event={"ID":"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18","Type":"ContainerStarted","Data":"60f0942c3bbe9b6271e773706c0511a9e142487eea69f38ba79dbd29b1da7464"}
Jul 27 15:52:24.120892 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.119288    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:24.120892 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.120066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5" event={"ID":"9a8068e7-20b0-46f3-b81b-6bedd25648b0","Type":"ContainerStarted","Data":"040b871c3cc66034ce5bb2d5a0e5c618eafbe6ecbefca8cd378d02802e99947c"}
Jul 27 15:52:24.278474 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.278387    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:52:24.362511 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.362463    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"]
Jul 27 15:52:24.366747 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.366720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369682    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369705    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6bqad3p8q6n28\""
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f9wk4\""
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 15:52:24.369989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.369919    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 15:52:24.370356 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.370124    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 15:52:24.379081 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.378992    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"]
Jul 27 15:52:24.514457 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514624 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514624 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514767 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-grpc-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514767 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-metrics-client-ca\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514767 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskb6\" (UniqueName: \"kubernetes.io/projected/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-kube-api-access-bskb6\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.514915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.514823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616352 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616487 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616487 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-grpc-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616487 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-metrics-client-ca\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616640 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskb6\" (UniqueName: \"kubernetes.io/projected/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-kube-api-access-bskb6\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616640 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616640 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.616640 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.616608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.617657 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.617620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-metrics-client-ca\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.619921 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.619874    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.620975 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.620937    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.621818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.621773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.622166 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.622111    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-grpc-tls\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.623077 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.623021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.624697 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.624667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.627172 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.627132    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskb6\" (UniqueName: \"kubernetes.io/projected/25813c1d-b816-4cac-9d78-a35dd2f4d8ca-kube-api-access-bskb6\") pod \"thanos-querier-5ddb6c5ff9-htv2q\" (UID: \"25813c1d-b816-4cac-9d78-a35dd2f4d8ca\") " pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.681680 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.681535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:24.798206 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:24.798176    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69326a4_de42_4be9_99bd_d547dea2c405.slice/crio-d412e0e43369fe67f65c9e43c552a3a5954e662f4b9cb42ec75f1ea4c7149a4b WatchSource:0}: Error finding container d412e0e43369fe67f65c9e43c552a3a5954e662f4b9cb42ec75f1ea4c7149a4b: Status 404 returned error can't find the container with id d412e0e43369fe67f65c9e43c552a3a5954e662f4b9cb42ec75f1ea4c7149a4b
Jul 27 15:52:24.799100 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.799054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:52:24.845234 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:24.845205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"]
Jul 27 15:52:24.869903 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:24.869835    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25813c1d_b816_4cac_9d78_a35dd2f4d8ca.slice/crio-4c2fa5bf5c521654722a2a501d565f936aacd4b1968f34d49d20afa5051713fd WatchSource:0}: Error finding container 4c2fa5bf5c521654722a2a501d565f936aacd4b1968f34d49d20afa5051713fd: Status 404 returned error can't find the container with id 4c2fa5bf5c521654722a2a501d565f936aacd4b1968f34d49d20afa5051713fd
Jul 27 15:52:25.126196 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.126077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc" event={"ID":"af7434e7-66c6-4c6e-a22e-872a1a3eebdc","Type":"ContainerStarted","Data":"885c2a8012a5a0fb51c351cc4beae7abcfe0719f41c13f28e7d125aa0f218c07"}
Jul 27 15:52:25.128009 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.127912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"d412e0e43369fe67f65c9e43c552a3a5954e662f4b9cb42ec75f1ea4c7149a4b"}
Jul 27 15:52:25.129407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.129379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"4c2fa5bf5c521654722a2a501d565f936aacd4b1968f34d49d20afa5051713fd"}
Jul 27 15:52:25.131283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.131253    2573 generic.go:356] "Generic (PLEG): container finished" podID="4ca62254-9505-4d94-8381-d19db3cefef0" containerID="681dc7005dec12fdea2c58ff0bc6569741130a8d511839ecc4d58cc69f0e70f8" exitCode=0
Jul 27 15:52:25.131396 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.131298    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnrr7" event={"ID":"4ca62254-9505-4d94-8381-d19db3cefef0","Type":"ContainerDied","Data":"681dc7005dec12fdea2c58ff0bc6569741130a8d511839ecc4d58cc69f0e70f8"}
Jul 27 15:52:25.148984 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.148923    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-5swqc" podStartSLOduration=1.831685918 podStartE2EDuration="3.148907585s" totalImagesPullingTime="1.317221667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:25.148763458 +0000 UTC m=+247.234719190" watchObservedRunningTime="2026-07-27 15:52:25.148907585 +0000 UTC m=+247.234863319"
Jul 27 15:52:25.245809 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:25.245785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:26.129739 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:26.129674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:26.137659 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:26.137629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnrr7" event={"ID":"4ca62254-9505-4d94-8381-d19db3cefef0","Type":"ContainerStarted","Data":"1c9c9e9dd08f96bfac6c7df2ba1e88c91e3e95a5b69d099a55aaa6608feb1e23"}
Jul 27 15:52:26.137800 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:26.137689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnrr7" event={"ID":"4ca62254-9505-4d94-8381-d19db3cefef0","Type":"ContainerStarted","Data":"a6365597c5af9a68ae92f4e7083aae5409cf329641b4adc2e9cbc61667342b10"}
Jul 27 15:52:26.159546 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:26.159497    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bnrr7" podStartSLOduration=2.715534963 podStartE2EDuration="4.159480781s" totalImagesPullingTime="1.350960433s" totalInitContainerRuntime="92.985385ms" isStatefulPod=true podCreationTimestamp="2026-07-27 15:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:26.158937759 +0000 UTC m=+248.244893518" watchObservedRunningTime="2026-07-27 15:52:26.159480781 +0000 UTC m=+248.245436512"
Jul 27 15:52:26.233049 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:26.233015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:27.042205 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.042170    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"]
Jul 27 15:52:27.066189 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.066160    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"]
Jul 27 15:52:27.066350 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.066272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.068897 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.068872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 15:52:27.069041 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.068914    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6gdpj\""
Jul 27 15:52:27.242023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.241979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rht8j\" (UniqueName: \"kubernetes.io/projected/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-kube-api-access-rht8j\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.242436 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.242171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.342668 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.342637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.342841 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.342721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rht8j\" (UniqueName: \"kubernetes.io/projected/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-kube-api-access-rht8j\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.345402 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.345376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.353128 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.353102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rht8j\" (UniqueName: \"kubernetes.io/projected/fe9ed76e-037c-4c81-8ac9-0aa845ed69ab-kube-api-access-rht8j\") pod \"monitoring-plugin-68b7fc9574-k2rnq\" (UID: \"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.376872 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.376847    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:27.668118 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.668039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:27.768602 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.768577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:27.952706 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:27.952660    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"]
Jul 27 15:52:27.956728 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:27.956693    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9ed76e_037c_4c81_8ac9_0aa845ed69ab.slice/crio-4f2babb504d215d2b2d623e4499c89c1b83131f7c8f9eab9ad572d4ab55da0dd WatchSource:0}: Error finding container 4f2babb504d215d2b2d623e4499c89c1b83131f7c8f9eab9ad572d4ab55da0dd: Status 404 returned error can't find the container with id 4f2babb504d215d2b2d623e4499c89c1b83131f7c8f9eab9ad572d4ab55da0dd
Jul 27 15:52:28.148036 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.147996    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5" event={"ID":"9a8068e7-20b0-46f3-b81b-6bedd25648b0","Type":"ContainerStarted","Data":"281eb0e0f822a466c42e29624f9336c0cabb82561745cb83dfe195f5bd83363b"}
Jul 27 15:52:28.148220 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.148074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5" event={"ID":"9a8068e7-20b0-46f3-b81b-6bedd25648b0","Type":"ContainerStarted","Data":"1b4257e7cd2e01540a0643671c73034edbff5846a0fe9477628dc14a7ca17f1d"}
Jul 27 15:52:28.148220 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.148101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5" event={"ID":"9a8068e7-20b0-46f3-b81b-6bedd25648b0","Type":"ContainerStarted","Data":"26e1031605292f65daeaae9123ecf2518aa8afe6960fd429444831997d5e3582"}
Jul 27 15:52:28.149522 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.149496    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75" exitCode=0
Jul 27 15:52:28.149644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.149527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"}
Jul 27 15:52:28.150844 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.150762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq" event={"ID":"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab","Type":"ContainerStarted","Data":"4f2babb504d215d2b2d623e4499c89c1b83131f7c8f9eab9ad572d4ab55da0dd"}
Jul 27 15:52:28.152799 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.152779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49rf9" event={"ID":"96bdbd86-6c2e-4c6a-9dee-4fadf6131e18","Type":"ContainerStarted","Data":"e8385bf4ee39bef299b1284be8c996720e607eca86ddd9f2c4889177baa3616c"}
Jul 27 15:52:28.170445 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.170401    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ptq5" podStartSLOduration=1.813183813 podStartE2EDuration="6.170385484s" totalImagesPullingTime="4.357201671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:28.169330888 +0000 UTC m=+250.255286620" watchObservedRunningTime="2026-07-27 15:52:28.170385484 +0000 UTC m=+250.256341217"
Jul 27 15:52:28.190440 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.190360    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-49rf9" podStartSLOduration=33.454338328 podStartE2EDuration="48.190347923s" totalImagesPullingTime="14.736009595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:51:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:28.189105638 +0000 UTC m=+250.275061373" watchObservedRunningTime="2026-07-27 15:52:28.190347923 +0000 UTC m=+250.276303634"
Jul 27 15:52:28.530413 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:28.530320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:30.164051 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.163951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"d6aa7f916d144f09530be33f00d45c6afa0657632d6bbd39510246709953f58d"}
Jul 27 15:52:30.164412 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.164065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"19fa39629d20367ccae0ae343ce702235883fa458335301334ed7301100ddd1b"}
Jul 27 15:52:30.164412 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.164092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"745a37b350ecdf0baa3a72f15331f4bfa247a3e7ec775586956430c9ba513789"}
Jul 27 15:52:30.171412 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.171382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:52:30.174232 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.174204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec3b92-4fef-439d-8fa0-298eec85086c-metrics-certs\") pod \"network-metrics-daemon-fbmbs\" (UID: \"70ec3b92-4fef-439d-8fa0-298eec85086c\") " pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:52:30.211715 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.211690    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x92bc\""
Jul 27 15:52:30.217662 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.217646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbmbs"
Jul 27 15:52:30.356281 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.356251    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbmbs"]
Jul 27 15:52:30.359032 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:30.359002    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ec3b92_4fef_439d_8fa0_298eec85086c.slice/crio-382fd96690743d9f54d8ec10d91de619f5f8d2a81e2bbe7cb491a327f60f0c43 WatchSource:0}: Error finding container 382fd96690743d9f54d8ec10d91de619f5f8d2a81e2bbe7cb491a327f60f0c43: Status 404 returned error can't find the container with id 382fd96690743d9f54d8ec10d91de619f5f8d2a81e2bbe7cb491a327f60f0c43
Jul 27 15:52:30.779316 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.779207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:30.857135 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:30.857105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:31.169611 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:31.169578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbmbs" event={"ID":"70ec3b92-4fef-439d-8fa0-298eec85086c","Type":"ContainerStarted","Data":"382fd96690743d9f54d8ec10d91de619f5f8d2a81e2bbe7cb491a327f60f0c43"}
Jul 27 15:52:31.172088 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:31.172057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"}
Jul 27 15:52:31.172214 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:31.172134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"}
Jul 27 15:52:32.180618 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.180486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"}
Jul 27 15:52:32.180618 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.180563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"}
Jul 27 15:52:32.180618 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.180603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"}
Jul 27 15:52:32.181178 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.180639    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerStarted","Data":"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"}
Jul 27 15:52:32.183858 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.183835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"5db35c6bb2bd198effc469e6ff94c220491b61a4281fa0c9befb8c5d5356f426"}
Jul 27 15:52:32.183987 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.183900    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"3f714c5654a4224ef1ccf166362b42f263e60bde4bfbe6f3ee15d77078190d03"}
Jul 27 15:52:32.183987 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.183943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" event={"ID":"25813c1d-b816-4cac-9d78-a35dd2f4d8ca","Type":"ContainerStarted","Data":"a12756646f502270b123e9079c0178221b0fe7606f45b4b31784636fe557ee00"}
Jul 27 15:52:32.184136 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.184011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:32.185651 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.185628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq" event={"ID":"fe9ed76e-037c-4c81-8ac9-0aa845ed69ab","Type":"ContainerStarted","Data":"1d4179df8f56dbd3be4462708b11cb415dd263e8d0701aca599fb5abf948ce34"}
Jul 27 15:52:32.185823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.185806    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:32.191924 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.191903    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq"
Jul 27 15:52:32.210914 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.210862    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.021338827 podStartE2EDuration="9.210844526s" totalImagesPullingTime="6.164487025s" totalInitContainerRuntime="25.018674ms" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:32.20959481 +0000 UTC m=+254.295550542" watchObservedRunningTime="2026-07-27 15:52:32.210844526 +0000 UTC m=+254.296800259"
Jul 27 15:52:32.226647 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.226606    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k2rnq" podStartSLOduration=1.739250679 podStartE2EDuration="5.22658988s" totalImagesPullingTime="3.487339201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:32.225567895 +0000 UTC m=+254.311523627" watchObservedRunningTime="2026-07-27 15:52:32.22658988 +0000 UTC m=+254.312545615"
Jul 27 15:52:32.252058 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:32.251860    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q" podStartSLOduration=1.465586957 podStartE2EDuration="8.251228568s" totalImagesPullingTime="6.785641611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:32.250600205 +0000 UTC m=+254.336555936" watchObservedRunningTime="2026-07-27 15:52:32.251228568 +0000 UTC m=+254.337184301"
Jul 27 15:52:33.190517 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:33.190483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbmbs" event={"ID":"70ec3b92-4fef-439d-8fa0-298eec85086c","Type":"ContainerStarted","Data":"0eccb6dcdf76dbf10700ddb76ceb37276b135a5e1bc7d778a0ea58dad0a1bda7"}
Jul 27 15:52:33.190918 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:33.190537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbmbs" event={"ID":"70ec3b92-4fef-439d-8fa0-298eec85086c","Type":"ContainerStarted","Data":"eea40e6a7c00919873f3d4944dec4581b72e829f8a738473b236ae960ab74753"}
Jul 27 15:52:33.208815 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:33.208704    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbmbs" podStartSLOduration=253.026476303 podStartE2EDuration="4m15.208687454s" totalImagesPullingTime="2.182211151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:33.20839401 +0000 UTC m=+255.294349745" watchObservedRunningTime="2026-07-27 15:52:33.208687454 +0000 UTC m=+255.294643262"
Jul 27 15:52:33.310831 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:33.310740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:33.411208 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:33.411172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:34.266299 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.266264    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-rm5bb"]
Jul 27 15:52:34.269524 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.269508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:34.273124 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.273105    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 15:52:34.274818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.274800    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2gjm6\""
Jul 27 15:52:34.274890 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.274832    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 15:52:34.289181 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.289161    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rm5bb"]
Jul 27 15:52:34.308697 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.308670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662ss\" (UniqueName: \"kubernetes.io/projected/05c6984b-9053-4f07-899b-32866088c174-kube-api-access-662ss\") pod \"downloads-7c97dc4555-rm5bb\" (UID: \"05c6984b-9053-4f07-899b-32866088c174\") " pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:34.323323 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.323303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:34.410114 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.410081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662ss\" (UniqueName: \"kubernetes.io/projected/05c6984b-9053-4f07-899b-32866088c174-kube-api-access-662ss\") pod \"downloads-7c97dc4555-rm5bb\" (UID: \"05c6984b-9053-4f07-899b-32866088c174\") " pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:34.413665 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.413639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:34.420707 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.420685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-662ss\" (UniqueName: \"kubernetes.io/projected/05c6984b-9053-4f07-899b-32866088c174-kube-api-access-662ss\") pod \"downloads-7c97dc4555-rm5bb\" (UID: \"05c6984b-9053-4f07-899b-32866088c174\") " pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:34.548540 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.548455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:34.579060 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.579037    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:34.707953 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.707882    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rm5bb"]
Jul 27 15:52:34.710545 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:52:34.710519    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c6984b_9053_4f07_899b_32866088c174.slice/crio-4055ce3610fb1b74d5751756454187d2129a2e3113983aff3b04d46ac8eb37cf WatchSource:0}: Error finding container 4055ce3610fb1b74d5751756454187d2129a2e3113983aff3b04d46ac8eb37cf: Status 404 returned error can't find the container with id 4055ce3610fb1b74d5751756454187d2129a2e3113983aff3b04d46ac8eb37cf
Jul 27 15:52:34.739317 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.739293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:34.839470 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:34.839446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:35.126084 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:35.126004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:35.201638 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:35.201597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rm5bb" event={"ID":"05c6984b-9053-4f07-899b-32866088c174","Type":"ContainerStarted","Data":"4055ce3610fb1b74d5751756454187d2129a2e3113983aff3b04d46ac8eb37cf"}
Jul 27 15:52:35.220430 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:35.220375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:35.756991 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:35.756929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:35.945728 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:35.945697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:36.866948 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:36.866906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:37.078898 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:37.078862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:37.392487 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:37.392458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:37.493749 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:37.493712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:38.196873 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:38.196842    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5ddb6c5ff9-htv2q"
Jul 27 15:52:38.516836 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:38.516750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:38.618651 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:38.618611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:47.765075 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:47.764977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:47.840192 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:47.840151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:48.023036 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:48.022967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tpr4z_cd716f01-bac1-41c0-aaf6-b63bff3a2669/dns-node-resolver/0.log"
Jul 27 15:52:49.223321 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:49.223288    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkx4k_eca20836-d166-4b2e-9667-3852a70b397a/node-ca/0.log"
Jul 27 15:52:50.022702 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:50.022676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9rlq_3a24a7f9-a457-4f56-98aa-0d8849b4f0f2/serve-healthcheck-canary/0.log"
Jul 27 15:52:50.962825 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:50.962787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:51.022782 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:51.022750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:52.275487 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:52.275451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rm5bb" event={"ID":"05c6984b-9053-4f07-899b-32866088c174","Type":"ContainerStarted","Data":"9a79fe0e21ca4d905d7b9a36d7214c8ccb61c2c36207745fe2376a9e6e2b6a8a"}
Jul 27 15:52:52.275989 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:52.275835    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:52.295760 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:52.295731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-rm5bb"
Jul 27 15:52:52.297804 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:52.297752    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-rm5bb" podStartSLOduration=1.738717911 podStartE2EDuration="18.297736652s" totalImagesPullingTime="16.559018741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:52.295774398 +0000 UTC m=+274.381730131" watchObservedRunningTime="2026-07-27 15:52:52.297736652 +0000 UTC m=+274.383692385"
Jul 27 15:52:55.401010 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:55.400922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:55.467739 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:55.467705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:52:58.852168 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:52:58.852120    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjnsk" podUID="a0608a0a-5ed2-4645-a5f6-c48ad14aeb87"
Jul 27 15:52:59.322584 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:52:59.322555    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:01.684818 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:01.684777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:01.746722 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:01.746686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:02.771186 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:02.771151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:02.773330 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:02.773296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0608a0a-5ed2-4645-a5f6-c48ad14aeb87-metrics-tls\") pod \"dns-default-xjnsk\" (UID: \"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87\") " pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:02.927596 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:02.927561    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-748tg\""
Jul 27 15:53:02.934050 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:02.934033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:03.105677 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:03.105643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjnsk"]
Jul 27 15:53:03.107901 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:53:03.107875    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0608a0a_5ed2_4645_a5f6_c48ad14aeb87.slice/crio-f86e49dd0669465335e5d5210d5ea8ff7e46246e205473ef4256fd0532080f22 WatchSource:0}: Error finding container f86e49dd0669465335e5d5210d5ea8ff7e46246e205473ef4256fd0532080f22: Status 404 returned error can't find the container with id f86e49dd0669465335e5d5210d5ea8ff7e46246e205473ef4256fd0532080f22
Jul 27 15:53:03.340776 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:03.340742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjnsk" event={"ID":"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87","Type":"ContainerStarted","Data":"f86e49dd0669465335e5d5210d5ea8ff7e46246e205473ef4256fd0532080f22"}
Jul 27 15:53:06.354151 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:06.354109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjnsk" event={"ID":"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87","Type":"ContainerStarted","Data":"70dda9d847c0f2cd7fddfa47c404c76791cd4e369c6d1aaca348c64d61cb842e"}
Jul 27 15:53:06.354538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:06.354177    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjnsk" event={"ID":"a0608a0a-5ed2-4645-a5f6-c48ad14aeb87","Type":"ContainerStarted","Data":"ece18d7eebfa11851ab63042d797890f9216c3d595ffdb9810a13718cb15e34a"}
Jul 27 15:53:06.354538 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:06.354333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:06.374648 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:06.374600    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xjnsk" podStartSLOduration=251.763490771 podStartE2EDuration="4m14.374583023s" totalImagesPullingTime="2.611092252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:06.37351805 +0000 UTC m=+288.459473782" watchObservedRunningTime="2026-07-27 15:53:06.374583023 +0000 UTC m=+288.460538754"
Jul 27 15:53:08.733617 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:08.733575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:10.370309 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:10.370269    2573 generic.go:356] "Generic (PLEG): container finished" podID="efc6c6a0-6811-4e51-82b1-6093ed5d6ea5" containerID="9109c92c9530c4832421e0ad6c0f6ba841e9d68d3df961cf3000ec791208756c" exitCode=0
Jul 27 15:53:10.370689 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:10.370346    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd" event={"ID":"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5","Type":"ContainerDied","Data":"9109c92c9530c4832421e0ad6c0f6ba841e9d68d3df961cf3000ec791208756c"}
Jul 27 15:53:10.370730 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:10.370692    2573 scope.go:117] "RemoveContainer" containerID="9109c92c9530c4832421e0ad6c0f6ba841e9d68d3df961cf3000ec791208756c"
Jul 27 15:53:11.376268 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:11.376233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gxnsd" event={"ID":"efc6c6a0-6811-4e51-82b1-6093ed5d6ea5","Type":"ContainerStarted","Data":"baca04bd1f1834c528cfdf9396e0540f5a79569f7a64347a847d14a51a1b9c3c"}
Jul 27 15:53:16.360816 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:16.360783    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xjnsk"
Jul 27 15:53:18.291044 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:18.291017    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 15:53:18.344861 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:18.344821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:18.413582 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:18.413449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:23.286133 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:23.286102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:23.383489 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:23.379475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:24.161451 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:24.161414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:24.237359 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:24.237326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:25.901758 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:25.901727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:26.000158 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:26.000133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:26.932227 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:26.932195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:26.994690 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:26.994660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:28.274113 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:28.274081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:28.375734 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:28.375700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:28.462683 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:28.462649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:30.769145 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:30.769110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:30.942974 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:30.942938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:31.006547 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:31.006513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:32.944686 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:32.944659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:33.004305 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:33.004280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:37.911553 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:37.911514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:39.120710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:39.120675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:41.496616 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:41.496576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:41.715769 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:41.715715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:42.627560 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627525    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627815    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="alertmanager" containerID="cri-o://74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717" gracePeriod=120
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627854    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy" containerID="cri-o://5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320" gracePeriod=120
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627874    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="prom-label-proxy" containerID="cri-o://0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5" gracePeriod=120
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627918    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-metric" containerID="cri-o://6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f" gracePeriod=120
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627889    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-web" containerID="cri-o://809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926" gracePeriod=120
Jul 27 15:53:42.628004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:42.627891    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="config-reloader" containerID="cri-o://22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d" gracePeriod=120
Jul 27 15:53:43.511237 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511207    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5" exitCode=0
Jul 27 15:53:43.511237 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511232    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320" exitCode=0
Jul 27 15:53:43.511237 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511244    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d" exitCode=0
Jul 27 15:53:43.511477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511252    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717" exitCode=0
Jul 27 15:53:43.511477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"}
Jul 27 15:53:43.511477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"}
Jul 27 15:53:43.511477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"}
Jul 27 15:53:43.511477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.511388    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"}
Jul 27 15:53:43.862361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.862338    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:43.997800 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997769    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.997800 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997825    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997869    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.997989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9pt\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998062 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998017    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998073    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998101    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998243    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume\") pod \"e69326a4-de42-4be9-99bd-d547dea2c405\" (UID: \"e69326a4-de42-4be9-99bd-d547dea2c405\") "
Jul 27 15:53:43.998361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998286    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:43.998671 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.998488    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-metrics-client-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:43.999134 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.999074    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:53:43.999134 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:43.999092    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:44.000710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.000637    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out" (OuterVolumeSpecName: "config-out") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:53:44.000710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.000934    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:44.000710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.001269    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.001435 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.001376    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt" (OuterVolumeSpecName: "kube-api-access-jr9pt") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "kube-api-access-jr9pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:44.001638 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.001608    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.001893 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.001853    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.002511 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.002484    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.002994 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.002945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume" (OuterVolumeSpecName: "config-volume") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.005241 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.005221    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.011564 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.011541    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config" (OuterVolumeSpecName: "web-config") pod "e69326a4-de42-4be9-99bd-d547dea2c405" (UID: "e69326a4-de42-4be9-99bd-d547dea2c405"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:44.099044 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099016    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-web-config\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099044 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099041    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099052    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr9pt\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-kube-api-access-jr9pt\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099062    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099071    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-main-db\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099080    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e69326a4-de42-4be9-99bd-d547dea2c405-tls-assets\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099088    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-main-tls\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099096    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e69326a4-de42-4be9-99bd-d547dea2c405-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099104    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099112    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099119    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e69326a4-de42-4be9-99bd-d547dea2c405-cluster-tls-config\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.099201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.099128    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e69326a4-de42-4be9-99bd-d547dea2c405-config-out\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 15:53:44.518151 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518121    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f" exitCode=0
Jul 27 15:53:44.518151 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518144    2573 generic.go:356] "Generic (PLEG): container finished" podID="e69326a4-de42-4be9-99bd-d547dea2c405" containerID="809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926" exitCode=0
Jul 27 15:53:44.518332 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518199    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.518332 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"}
Jul 27 15:53:44.518332 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"}
Jul 27 15:53:44.518427 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e69326a4-de42-4be9-99bd-d547dea2c405","Type":"ContainerDied","Data":"d412e0e43369fe67f65c9e43c552a3a5954e662f4b9cb42ec75f1ea4c7149a4b"}
Jul 27 15:53:44.518427 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.518351    2573 scope.go:117] "RemoveContainer" containerID="0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"
Jul 27 15:53:44.526048 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.526032    2573 scope.go:117] "RemoveContainer" containerID="6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"
Jul 27 15:53:44.533034 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.533017    2573 scope.go:117] "RemoveContainer" containerID="5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"
Jul 27 15:53:44.539371 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.539354    2573 scope.go:117] "RemoveContainer" containerID="809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"
Jul 27 15:53:44.545840 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.545820    2573 scope.go:117] "RemoveContainer" containerID="22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"
Jul 27 15:53:44.547377 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.547155    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:44.553211 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.553193    2573 scope.go:117] "RemoveContainer" containerID="74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"
Jul 27 15:53:44.553594 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.553567    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:44.559820 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.559803    2573 scope.go:117] "RemoveContainer" containerID="ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"
Jul 27 15:53:44.566392 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.566376    2573 scope.go:117] "RemoveContainer" containerID="0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"
Jul 27 15:53:44.566650 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.566629    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5\": container with ID starting with 0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5 not found: ID does not exist" containerID="0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"
Jul 27 15:53:44.566701 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.566661    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"} err="failed to get container status \"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5\": rpc error: code = NotFound desc = could not find container \"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5\": container with ID starting with 0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5 not found: ID does not exist"
Jul 27 15:53:44.566701 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.566692    2573 scope.go:117] "RemoveContainer" containerID="6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"
Jul 27 15:53:44.566909 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.566891    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f\": container with ID starting with 6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f not found: ID does not exist" containerID="6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"
Jul 27 15:53:44.566952 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.566914    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"} err="failed to get container status \"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f\": rpc error: code = NotFound desc = could not find container \"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f\": container with ID starting with 6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f not found: ID does not exist"
Jul 27 15:53:44.566952 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.566929    2573 scope.go:117] "RemoveContainer" containerID="5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"
Jul 27 15:53:44.567183 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.567166    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320\": container with ID starting with 5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320 not found: ID does not exist" containerID="5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"
Jul 27 15:53:44.567222 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567188    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"} err="failed to get container status \"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320\": rpc error: code = NotFound desc = could not find container \"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320\": container with ID starting with 5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320 not found: ID does not exist"
Jul 27 15:53:44.567222 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567202    2573 scope.go:117] "RemoveContainer" containerID="809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"
Jul 27 15:53:44.567421 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.567407    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926\": container with ID starting with 809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926 not found: ID does not exist" containerID="809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"
Jul 27 15:53:44.567460 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567424    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"} err="failed to get container status \"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926\": rpc error: code = NotFound desc = could not find container \"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926\": container with ID starting with 809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926 not found: ID does not exist"
Jul 27 15:53:44.567460 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567436    2573 scope.go:117] "RemoveContainer" containerID="22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"
Jul 27 15:53:44.567634 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.567618    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d\": container with ID starting with 22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d not found: ID does not exist" containerID="22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"
Jul 27 15:53:44.567674 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567637    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"} err="failed to get container status \"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d\": rpc error: code = NotFound desc = could not find container \"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d\": container with ID starting with 22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d not found: ID does not exist"
Jul 27 15:53:44.567674 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567648    2573 scope.go:117] "RemoveContainer" containerID="74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"
Jul 27 15:53:44.567828 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.567814    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717\": container with ID starting with 74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717 not found: ID does not exist" containerID="74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"
Jul 27 15:53:44.567866 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567832    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"} err="failed to get container status \"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717\": rpc error: code = NotFound desc = could not find container \"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717\": container with ID starting with 74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717 not found: ID does not exist"
Jul 27 15:53:44.567866 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.567844    2573 scope.go:117] "RemoveContainer" containerID="ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"
Jul 27 15:53:44.568057 ip-10-0-141-100 kubenswrapper[2573]: E0727 15:53:44.568041    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75\": container with ID starting with ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75 not found: ID does not exist" containerID="ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"
Jul 27 15:53:44.568105 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568061    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"} err="failed to get container status \"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75\": rpc error: code = NotFound desc = could not find container \"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75\": container with ID starting with ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75 not found: ID does not exist"
Jul 27 15:53:44.568105 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568086    2573 scope.go:117] "RemoveContainer" containerID="0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"
Jul 27 15:53:44.568282 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568266    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5"} err="failed to get container status \"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5\": rpc error: code = NotFound desc = could not find container \"0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5\": container with ID starting with 0b4ad68b82e07bf8ea916fa109074ba399f92065331b99ffb79e91d3bae052e5 not found: ID does not exist"
Jul 27 15:53:44.568328 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568283    2573 scope.go:117] "RemoveContainer" containerID="6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"
Jul 27 15:53:44.568483 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568466    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f"} err="failed to get container status \"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f\": rpc error: code = NotFound desc = could not find container \"6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f\": container with ID starting with 6a3a9192e24653be1f0dcc33179222062eb6fa4cc29bf023b5691ffaaa18927f not found: ID does not exist"
Jul 27 15:53:44.568524 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568483    2573 scope.go:117] "RemoveContainer" containerID="5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"
Jul 27 15:53:44.568717 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568697    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320"} err="failed to get container status \"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320\": rpc error: code = NotFound desc = could not find container \"5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320\": container with ID starting with 5d9cf2ef5c5b70d63c2de2e21832c1ad261dcf90bc8fc181c54d71b7e72e9320 not found: ID does not exist"
Jul 27 15:53:44.568791 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568720    2573 scope.go:117] "RemoveContainer" containerID="809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"
Jul 27 15:53:44.568930 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568913    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926"} err="failed to get container status \"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926\": rpc error: code = NotFound desc = could not find container \"809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926\": container with ID starting with 809481d061d0aa3605f8e61884ddedce45376bd56abe93c57439285ae21c9926 not found: ID does not exist"
Jul 27 15:53:44.568995 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.568931    2573 scope.go:117] "RemoveContainer" containerID="22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"
Jul 27 15:53:44.569166 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.569143    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d"} err="failed to get container status \"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d\": rpc error: code = NotFound desc = could not find container \"22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d\": container with ID starting with 22c03043fbbaecb02648e5b5a87e1f447b66076d5fd460335ac209f7502b663d not found: ID does not exist"
Jul 27 15:53:44.569166 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.569165    2573 scope.go:117] "RemoveContainer" containerID="74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"
Jul 27 15:53:44.569366 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.569352    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717"} err="failed to get container status \"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717\": rpc error: code = NotFound desc = could not find container \"74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717\": container with ID starting with 74a9bd3142320fcd2944d19c542d88a1bd9929c5e31a9e07d5daee43b5600717 not found: ID does not exist"
Jul 27 15:53:44.569366 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.569366    2573 scope.go:117] "RemoveContainer" containerID="ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"
Jul 27 15:53:44.569546 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.569528    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75"} err="failed to get container status \"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75\": rpc error: code = NotFound desc = could not find container \"ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75\": container with ID starting with ac93a19d0b206eb4b18896be558e28ce54a410e45835e947d983e22b86bdca75 not found: ID does not exist"
Jul 27 15:53:44.589869 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.589844    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:44.590159 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590147    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="config-reloader"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590161    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="config-reloader"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590169    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-web"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590175    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-web"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590189    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="init-config-reloader"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590194    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="init-config-reloader"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590202    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy"
Jul 27 15:53:44.590210 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590207    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590215    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-metric"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590222    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-metric"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590228    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="prom-label-proxy"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590233    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="prom-label-proxy"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590242    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="alertmanager"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590247    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="alertmanager"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590296    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-web"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590303    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="config-reloader"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590311    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy-metric"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590316    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="prom-label-proxy"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590322    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="alertmanager"
Jul 27 15:53:44.590407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.590328    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" containerName="kube-rbac-proxy"
Jul 27 15:53:44.594057 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.594038    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.596694 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.596669    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 15:53:44.597147 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597066    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 15:53:44.597147 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597098    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 15:53:44.597147 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597065    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 15:53:44.597338 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597114    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 15:53:44.597338 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597173    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 15:53:44.597338 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tzjqd\""
Jul 27 15:53:44.597480 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597463    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 15:53:44.597518 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.597463    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 15:53:44.603576 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.603554    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 15:53:44.615917 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.611988    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:44.704898 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.704871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.704904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.704923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-web-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.704948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jn2z\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-kube-api-access-2jn2z\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705148 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705148 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705148 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705148 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705265 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705265 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-out\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705265 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.705265 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.705239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806044 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806164 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806164 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-web-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806164 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jn2z\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-kube-api-access-2jn2z\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806164 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806164 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-out\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.806411 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.807025 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.806999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.807558 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.807528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.808201 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.808156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e29ba71-8f62-4e8f-9346-3ad68a72158c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.809325 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.809268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.809325 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.809299    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.809460 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.809377    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-web-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.809893 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.809875    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-out\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.810021 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.809997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.810021 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.810015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.810240 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.810218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.810333 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.810317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.810972 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.810943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e29ba71-8f62-4e8f-9346-3ad68a72158c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.815773 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.815754    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jn2z\" (UniqueName: \"kubernetes.io/projected/0e29ba71-8f62-4e8f-9346-3ad68a72158c-kube-api-access-2jn2z\") pod \"alertmanager-main-0\" (UID: \"0e29ba71-8f62-4e8f-9346-3ad68a72158c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:44.904844 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:44.904819    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:53:45.039283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.039244    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:53:45.042854 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:53:45.042827    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e29ba71_8f62_4e8f_9346_3ad68a72158c.slice/crio-a86302a01febdcdce7a2c546961b102ceead9a7fd9a4a2e510931ac1142e5b3c WatchSource:0}: Error finding container a86302a01febdcdce7a2c546961b102ceead9a7fd9a4a2e510931ac1142e5b3c: Status 404 returned error can't find the container with id a86302a01febdcdce7a2c546961b102ceead9a7fd9a4a2e510931ac1142e5b3c
Jul 27 15:53:45.525257 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.525226    2573 generic.go:356] "Generic (PLEG): container finished" podID="0e29ba71-8f62-4e8f-9346-3ad68a72158c" containerID="ef93274266cf66a90d80be36f036188db814a266c289344a9e4d39808ddb3036" exitCode=0
Jul 27 15:53:45.525406 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.525276    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerDied","Data":"ef93274266cf66a90d80be36f036188db814a266c289344a9e4d39808ddb3036"}
Jul 27 15:53:45.525406 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.525326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"a86302a01febdcdce7a2c546961b102ceead9a7fd9a4a2e510931ac1142e5b3c"}
Jul 27 15:53:45.866098 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.866065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:45.966938 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:45.966908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:46.411190 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.411156    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69326a4-de42-4be9-99bd-d547dea2c405" path="/var/lib/kubelet/pods/e69326a4-de42-4be9-99bd-d547dea2c405/volumes"
Jul 27 15:53:46.533465 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"6eb1fbbf93d0f7ffdedcc2f0c7c66b230162e32737bd92cf10eb86f9080ace59"}
Jul 27 15:53:46.533644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"7ed9cf4e4cf0dab0315ef9236df472e04f2d3fb84c94119966e282efdedb417f"}
Jul 27 15:53:46.533644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"c2045b2707f9a5206489edc0a04392ce753f63316d490c860d4d6d014583e71e"}
Jul 27 15:53:46.533644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"733569f11dd38928399e3f2b78ea544d9195b2f880dab8b2d7b291aa76427d32"}
Jul 27 15:53:46.533644 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"b29ed2f073f97cfadb207a501d5f6c87e9c915f834b7e54f3a16658ff55697f6"}
Jul 27 15:53:46.533843 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.533649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e29ba71-8f62-4e8f-9346-3ad68a72158c","Type":"ContainerStarted","Data":"3db5f798b68517252cb7e9e32200daf299abf201f58546a70b50a3e47e69b808"}
Jul 27 15:53:46.568059 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.568004    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.554070289 podStartE2EDuration="2.567982341s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.912052ms" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:46.564698323 +0000 UTC m=+328.650654048" watchObservedRunningTime="2026-07-27 15:53:46.567982341 +0000 UTC m=+328.653938074"
Jul 27 15:53:46.579308 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.579274    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79cb7b947b-28mdl"]
Jul 27 15:53:46.582507 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.582483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.585172 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585147    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 15:53:46.585351 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 15:53:46.585477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mddvc\""
Jul 27 15:53:46.585634 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585601    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 15:53:46.585634 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585610    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 15:53:46.585851 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.585832    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 15:53:46.596198 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.596171    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 15:53:46.603084 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.603058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79cb7b947b-28mdl"]
Jul 27 15:53:46.693700 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.693624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:46.723192 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-metrics-client-ca\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-federate-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-serving-certs-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723386 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723574 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.723574 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.723451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7x2m\" (UniqueName: \"kubernetes.io/projected/acd8aa91-cabd-448c-8e03-4d7610075d57-kube-api-access-n7x2m\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.795978 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.795925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:46.824200 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-federate-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-serving-certs-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824596 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7x2m\" (UniqueName: \"kubernetes.io/projected/acd8aa91-cabd-448c-8e03-4d7610075d57-kube-api-access-n7x2m\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.824596 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.824441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-metrics-client-ca\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.825358 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.825304    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-serving-certs-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.825475 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.825369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.825475 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.825414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acd8aa91-cabd-448c-8e03-4d7610075d57-metrics-client-ca\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.827358 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.827330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-telemeter-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.827542 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.827509    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.827542 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.827528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-federate-client-tls\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.827650 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.827554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acd8aa91-cabd-448c-8e03-4d7610075d57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.834707 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.834679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7x2m\" (UniqueName: \"kubernetes.io/projected/acd8aa91-cabd-448c-8e03-4d7610075d57-kube-api-access-n7x2m\") pod \"telemeter-client-79cb7b947b-28mdl\" (UID: \"acd8aa91-cabd-448c-8e03-4d7610075d57\") " pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:46.896662 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:46.896630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl"
Jul 27 15:53:47.052665 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:47.052639    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79cb7b947b-28mdl"]
Jul 27 15:53:47.054796 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:53:47.054767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd8aa91_cabd_448c_8e03_4d7610075d57.slice/crio-4c01f8f34f317c86889bc6af632bf976162ee9301410b9da68eb4d10f32ee0fa WatchSource:0}: Error finding container 4c01f8f34f317c86889bc6af632bf976162ee9301410b9da68eb4d10f32ee0fa: Status 404 returned error can't find the container with id 4c01f8f34f317c86889bc6af632bf976162ee9301410b9da68eb4d10f32ee0fa
Jul 27 15:53:47.056881 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:47.056851    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:53:47.540887 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:47.540854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl" event={"ID":"acd8aa91-cabd-448c-8e03-4d7610075d57","Type":"ContainerStarted","Data":"4c01f8f34f317c86889bc6af632bf976162ee9301410b9da68eb4d10f32ee0fa"}
Jul 27 15:53:50.555380 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:50.555341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl" event={"ID":"acd8aa91-cabd-448c-8e03-4d7610075d57","Type":"ContainerStarted","Data":"da6b548a7ce0ae23932b4e40ccd235c143c9caf328645672a5b8411db6796fde"}
Jul 27 15:53:50.555760 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:50.555399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl" event={"ID":"acd8aa91-cabd-448c-8e03-4d7610075d57","Type":"ContainerStarted","Data":"d98d11b58b4f20f17b8246074783f5dfbc116136454c632fc590fb762ed32188"}
Jul 27 15:53:50.555760 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:50.555418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl" event={"ID":"acd8aa91-cabd-448c-8e03-4d7610075d57","Type":"ContainerStarted","Data":"8076b35d865587afb430fbb45bf275dbcc6b54fc47835c8df598d4bb5b0c40a1"}
Jul 27 15:53:50.580364 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:50.580316    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79cb7b947b-28mdl" podStartSLOduration=1.747546071 podStartE2EDuration="4.580298722s" totalImagesPullingTime="2.832752651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:50.579721576 +0000 UTC m=+332.665677307" watchObservedRunningTime="2026-07-27 15:53:50.580298722 +0000 UTC m=+332.666254455"
Jul 27 15:53:52.752685 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:52.752639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:52.826693 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:52.826659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:52.894892 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:52.894862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:53:53.758915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:53:53.758874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:01.700867 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:01.700836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:02.111451 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:02.111420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:04.170145 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:04.170111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:04.266015 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:04.265983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:04.372114 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:04.372086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:16.319003 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:16.318903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:56.841845 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:56.841813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:54:56.901532 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:54:56.901489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:08.812813 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:08.812777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:08.891321 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:08.891287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.408666 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.408629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.509345 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.509315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.610471 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.610432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.712097 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.712005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.785897 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.785868    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:16.955850 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:16.955815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:17.155031 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:17.155000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:17.256637 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:17.256603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:18.412767 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:18.412720    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:27.414012 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:27.413975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:27.520643 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:27.520608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:55:27.617450 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:55:27.617418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:11.353126 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:11.353094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:11.455449 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:11.455417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:26.307247 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:26.307210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:38.280799 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:38.280764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:39.074367 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:39.074335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:41.888489 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:41.888451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:41.988532 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:41.988503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:42.918764 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:42.918737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:43.029492 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:43.029456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:44.045023 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.044988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:44.355189 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.355151    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wv5l5"]
Jul 27 15:56:44.358526 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.358508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.361202 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.361165    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 15:56:44.361202 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.361175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x9f5x\""
Jul 27 15:56:44.361202 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.361205    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 15:56:44.366111 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.366091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wv5l5"]
Jul 27 15:56:44.473004 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.472948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.473169 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.473099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7kd\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-kube-api-access-br7kd\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.573920 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.573884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.574106 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.573945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br7kd\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-kube-api-access-br7kd\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.583420 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.583387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.583615 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.583593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7kd\" (UniqueName: \"kubernetes.io/projected/212f5766-e990-49b6-8427-38fd67e2c531-kube-api-access-br7kd\") pod \"cert-manager-webhook-6486ffd997-wv5l5\" (UID: \"212f5766-e990-49b6-8427-38fd67e2c531\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.677555 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.677465    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:44.809595 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.809550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wv5l5"]
Jul 27 15:56:44.878677 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:44.878645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:45.242085 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:45.242051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5" event={"ID":"212f5766-e990-49b6-8427-38fd67e2c531","Type":"ContainerStarted","Data":"b71e5de2b7eb72ef5b9c4409aacddfd39ad8a0bce2e97f19f17f748a0e1d4ff7"}
Jul 27 15:56:46.256206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:46.256170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:46.470635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:46.470601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:48.258138 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:48.258103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5" event={"ID":"212f5766-e990-49b6-8427-38fd67e2c531","Type":"ContainerStarted","Data":"8c03cad652b34d563e7e6f15c69dfe500020c9aa3344d6d926b832ddccf4808d"}
Jul 27 15:56:48.258496 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:48.258219    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:48.276640 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:48.276598    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5" podStartSLOduration=0.972842858 podStartE2EDuration="4.276584976s" totalImagesPullingTime="3.303742118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:56:48.274418857 +0000 UTC m=+510.360374588" watchObservedRunningTime="2026-07-27 15:56:48.276584976 +0000 UTC m=+510.362540708"
Jul 27 15:56:48.690836 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:48.690804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:48.793605 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:48.793563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:54.264980 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:54.264929    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wv5l5"
Jul 27 15:56:55.071530 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:55.071494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:55.173140 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:55.173108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:56:56.941163 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.941128    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"]
Jul 27 15:56:56.944630 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.944614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:56.947377 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.947342    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 15:56:56.947498 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.947385    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:56:56.948482 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.948464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-62lvx\""
Jul 27 15:56:56.953814 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:56.953794    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"]
Jul 27 15:56:57.089384 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.089348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.089564 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.089392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgfq\" (UniqueName: \"kubernetes.io/projected/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-kube-api-access-wpgfq\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.189897 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.189866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.190066 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.189907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgfq\" (UniqueName: \"kubernetes.io/projected/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-kube-api-access-wpgfq\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.190273 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.190255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.204087 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.204030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgfq\" (UniqueName: \"kubernetes.io/projected/0c2dca4c-d515-4d28-8ab9-47679c9b2ac0-kube-api-access-wpgfq\") pod \"openshift-lws-operator-fd8ccff4c-m8x52\" (UID: \"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.254167 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.254128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"
Jul 27 15:56:57.385312 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:57.385289    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52"]
Jul 27 15:56:57.387745 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:56:57.387719    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c2dca4c_d515_4d28_8ab9_47679c9b2ac0.slice/crio-cc8579acde106f1349f52f6265d3c199c0b22bd5ddf8275a493d09d4c90d1f37 WatchSource:0}: Error finding container cc8579acde106f1349f52f6265d3c199c0b22bd5ddf8275a493d09d4c90d1f37: Status 404 returned error can't find the container with id cc8579acde106f1349f52f6265d3c199c0b22bd5ddf8275a493d09d4c90d1f37
Jul 27 15:56:58.300779 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:56:58.300735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52" event={"ID":"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0","Type":"ContainerStarted","Data":"cc8579acde106f1349f52f6265d3c199c0b22bd5ddf8275a493d09d4c90d1f37"}
Jul 27 15:57:00.317835 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:00.317737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52" event={"ID":"0c2dca4c-d515-4d28-8ab9-47679c9b2ac0","Type":"ContainerStarted","Data":"7c0c192b6dd3a312157c365cf79eb737723a1de86a0ec22e939cbd4c04fb42b5"}
Jul 27 15:57:00.336428 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:00.336381    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m8x52" podStartSLOduration=1.792589096 podStartE2EDuration="4.336363014s" totalImagesPullingTime="2.543773918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:00.335728238 +0000 UTC m=+522.421683970" watchObservedRunningTime="2026-07-27 15:57:00.336363014 +0000 UTC m=+522.422318750"
Jul 27 15:57:01.088391 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:01.088358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:04.588772 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.588739    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jgbbt"]
Jul 27 15:57:04.592233 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.592217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.594594 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.594579    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t2l94\""
Jul 27 15:57:04.601826 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.601805    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jgbbt"]
Jul 27 15:57:04.657635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.657601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.657769 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.657673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gt6m\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-kube-api-access-2gt6m\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.759034 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.758988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.759191 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.759091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gt6m\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-kube-api-access-2gt6m\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.768207 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.768182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.768269 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.768242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gt6m\" (UniqueName: \"kubernetes.io/projected/64414736-1966-4f9d-a7b9-8f060110a0a3-kube-api-access-2gt6m\") pod \"cert-manager-55b4d954d5-jgbbt\" (UID: \"64414736-1966-4f9d-a7b9-8f060110a0a3\") " pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.901769 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.901685    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jgbbt"
Jul 27 15:57:04.972556 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:04.972526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:05.037177 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:05.037148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jgbbt"]
Jul 27 15:57:05.039894 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:57:05.039868    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64414736_1966_4f9d_a7b9_8f060110a0a3.slice/crio-d1c8d478ab195060b8d393541bfce65f62c2b6a7e3a5a50e3aeb914954a9cb32 WatchSource:0}: Error finding container d1c8d478ab195060b8d393541bfce65f62c2b6a7e3a5a50e3aeb914954a9cb32: Status 404 returned error can't find the container with id d1c8d478ab195060b8d393541bfce65f62c2b6a7e3a5a50e3aeb914954a9cb32
Jul 27 15:57:05.338994 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:05.338943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jgbbt" event={"ID":"64414736-1966-4f9d-a7b9-8f060110a0a3","Type":"ContainerStarted","Data":"523af8b22ae884fb6b0855e21d48918751340fc3c1bc4d066ec5c1ab54acd391"}
Jul 27 15:57:05.339183 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:05.339003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jgbbt" event={"ID":"64414736-1966-4f9d-a7b9-8f060110a0a3","Type":"ContainerStarted","Data":"d1c8d478ab195060b8d393541bfce65f62c2b6a7e3a5a50e3aeb914954a9cb32"}
Jul 27 15:57:05.355066 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:05.355026    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jgbbt" podStartSLOduration=1.355013022 podStartE2EDuration="1.355013022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:05.354727073 +0000 UTC m=+527.440682807" watchObservedRunningTime="2026-07-27 15:57:05.355013022 +0000 UTC m=+527.440968753"
Jul 27 15:57:17.693263 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:17.693188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:17.811407 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:17.811372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:18.331447 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.331418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:18.553860 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.553828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:18.657300 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.657221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:18.742915 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.742884    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"]
Jul 27 15:57:18.749601 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.749580    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.752173 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.752141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 15:57:18.752282 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.752169    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 15:57:18.752282 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.752207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2p7wq\""
Jul 27 15:57:18.752282 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.752169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 15:57:18.752282 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.752252    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 15:57:18.760214 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.760194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"]
Jul 27 15:57:18.782911 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.782888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.783029 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.782918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n298n\" (UniqueName: \"kubernetes.io/projected/e261352c-e1a5-48c1-960d-48ccab32fe1d-kube-api-access-n298n\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.783029 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.782946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.783112 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.783065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.783155 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.783115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.879768 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.879736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:18.883704 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.883680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.883789 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.883714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n298n\" (UniqueName: \"kubernetes.io/projected/e261352c-e1a5-48c1-960d-48ccab32fe1d-kube-api-access-n298n\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.883789 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.883737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.883789 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.883772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.883912 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.883805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.884242 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.884217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.886069 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.886049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e261352c-e1a5-48c1-960d-48ccab32fe1d-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.886415 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.886394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.886463 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.886394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e261352c-e1a5-48c1-960d-48ccab32fe1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.892263 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.892243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n298n\" (UniqueName: \"kubernetes.io/projected/e261352c-e1a5-48c1-960d-48ccab32fe1d-kube-api-access-n298n\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-w98z8\" (UID: \"e261352c-e1a5-48c1-960d-48ccab32fe1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:18.971631 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:18.971535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:19.059938 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.059901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:19.070978 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.070930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:19.171284 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.171244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:19.200516 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.200491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"]
Jul 27 15:57:19.203049 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:57:19.203013    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode261352c_e1a5_48c1_960d_48ccab32fe1d.slice/crio-8542af03cd0191db6fffdc9af0c7616eb169c675cc8ed3321cc8a390d0833f42 WatchSource:0}: Error finding container 8542af03cd0191db6fffdc9af0c7616eb169c675cc8ed3321cc8a390d0833f42: Status 404 returned error can't find the container with id 8542af03cd0191db6fffdc9af0c7616eb169c675cc8ed3321cc8a390d0833f42
Jul 27 15:57:19.242779 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.242715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:19.341227 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.341193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:19.402858 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:19.402824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8" event={"ID":"e261352c-e1a5-48c1-960d-48ccab32fe1d","Type":"ContainerStarted","Data":"8542af03cd0191db6fffdc9af0c7616eb169c675cc8ed3321cc8a390d0833f42"}
Jul 27 15:57:23.422998 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:23.422952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8" event={"ID":"e261352c-e1a5-48c1-960d-48ccab32fe1d","Type":"ContainerStarted","Data":"2b01755603b9cc1adba58d067352650e9036e07db251151c0ed915a6f4490116"}
Jul 27 15:57:25.432552 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:25.432520    2573 generic.go:356] "Generic (PLEG): container finished" podID="e261352c-e1a5-48c1-960d-48ccab32fe1d" containerID="2b01755603b9cc1adba58d067352650e9036e07db251151c0ed915a6f4490116" exitCode=0
Jul 27 15:57:25.432919 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:25.432592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8" event={"ID":"e261352c-e1a5-48c1-960d-48ccab32fe1d","Type":"ContainerDied","Data":"2b01755603b9cc1adba58d067352650e9036e07db251151c0ed915a6f4490116"}
Jul 27 15:57:26.438813 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:26.438780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8" event={"ID":"e261352c-e1a5-48c1-960d-48ccab32fe1d","Type":"ContainerStarted","Data":"0174fe8e291463065151c399257f122c0d209f033eb33521798c913b733a18a2"}
Jul 27 15:57:26.439255 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:26.439004    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:26.462076 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:26.462031    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8" podStartSLOduration=2.916984532 podStartE2EDuration="8.462016505s" totalImagesPullingTime="4.510687338s" totalInitContainerRuntime="1.034344635s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:26.459269493 +0000 UTC m=+548.545225226" watchObservedRunningTime="2026-07-27 15:57:26.462016505 +0000 UTC m=+548.547972236"
Jul 27 15:57:32.573477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:32.573443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:32.648020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:32.647950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:36.103857 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:36.103824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:36.170553 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:36.170525    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:37.444952 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:37.444924    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-w98z8"
Jul 27 15:57:39.028418 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:39.028384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:39.148116 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:39.148077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:39.705177 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:39.705144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:39.802984 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:39.802925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:39.906503 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:39.906471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:40.220466 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:40.220435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:40.493841 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:40.493755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:44.976202 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:44.976169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:45.015812 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.015785    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"]
Jul 27 15:57:45.019148 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.019126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.021791 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.021767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2pn9\""
Jul 27 15:57:45.022091 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.021815    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 15:57:45.022091 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.021888    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 15:57:45.022856 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.022840    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 15:57:45.022902 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.022840    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 15:57:45.027849 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.027827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"]
Jul 27 15:57:45.114226 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.114193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tls-certs\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.114372 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.114261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tmp\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.114372 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.114337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8rc\" (UniqueName: \"kubernetes.io/projected/abe552a1-fbf8-4004-8b4e-ef1038dd8914-kube-api-access-sl8rc\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.180968 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.180934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:45.215246 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.215224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tmp\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.215341 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.215259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8rc\" (UniqueName: \"kubernetes.io/projected/abe552a1-fbf8-4004-8b4e-ef1038dd8914-kube-api-access-sl8rc\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.215341 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.215291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tls-certs\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.217503 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.217478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tmp\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.217704 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.217688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe552a1-fbf8-4004-8b4e-ef1038dd8914-tls-certs\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.230635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.230581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8rc\" (UniqueName: \"kubernetes.io/projected/abe552a1-fbf8-4004-8b4e-ef1038dd8914-kube-api-access-sl8rc\") pod \"kube-auth-proxy-5f7696b457-bms4l\" (UID: \"abe552a1-fbf8-4004-8b4e-ef1038dd8914\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.329549 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.329523    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"
Jul 27 15:57:45.462440 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.462383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-bms4l"]
Jul 27 15:57:45.464993 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:57:45.464945    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe552a1_fbf8_4004_8b4e_ef1038dd8914.slice/crio-f50213fd0abc3b6dc345cbd6fe8f2e9a4377c891eb7fff51f34e61eb21c938ea WatchSource:0}: Error finding container f50213fd0abc3b6dc345cbd6fe8f2e9a4377c891eb7fff51f34e61eb21c938ea: Status 404 returned error can't find the container with id f50213fd0abc3b6dc345cbd6fe8f2e9a4377c891eb7fff51f34e61eb21c938ea
Jul 27 15:57:45.517801 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:45.517738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l" event={"ID":"abe552a1-fbf8-4004-8b4e-ef1038dd8914","Type":"ContainerStarted","Data":"f50213fd0abc3b6dc345cbd6fe8f2e9a4377c891eb7fff51f34e61eb21c938ea"}
Jul 27 15:57:46.606400 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:46.606330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:46.729283 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:46.729243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:47.147836 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.147796    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"]
Jul 27 15:57:47.151558 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.151535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.160747 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.160527    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 15:57:47.161706 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.161684    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 15:57:47.161819 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.161683    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8vvzg\""
Jul 27 15:57:47.161983 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.161950    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 15:57:47.169824 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.169800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"]
Jul 27 15:57:47.334523 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.334477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vj4n\" (UniqueName: \"kubernetes.io/projected/2785442d-55be-480b-aab4-3e82844504a6-kube-api-access-4vj4n\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.334752 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.334721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-metrics-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.334851 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.334782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.334895 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.334845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2785442d-55be-480b-aab4-3e82844504a6-manager-config\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.435930 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.435850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-metrics-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.435930 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.435895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.435930 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.435928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2785442d-55be-480b-aab4-3e82844504a6-manager-config\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.436206 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.435999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vj4n\" (UniqueName: \"kubernetes.io/projected/2785442d-55be-480b-aab4-3e82844504a6-kube-api-access-4vj4n\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.436669 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.436644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2785442d-55be-480b-aab4-3e82844504a6-manager-config\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.438477 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.438441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-metrics-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.438672 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.438648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2785442d-55be-480b-aab4-3e82844504a6-cert\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.450458 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.450435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vj4n\" (UniqueName: \"kubernetes.io/projected/2785442d-55be-480b-aab4-3e82844504a6-kube-api-access-4vj4n\") pod \"lws-controller-manager-7c7d956869-vmxqc\" (UID: \"2785442d-55be-480b-aab4-3e82844504a6\") " pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.463194 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.463173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:47.630817 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:47.630780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"]
Jul 27 15:57:47.633632 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:57:47.633605    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2785442d_55be_480b_aab4_3e82844504a6.slice/crio-6487257cedad3bfe183579882382d5d957ab9e3ee0331b976aa60b3eaa680490 WatchSource:0}: Error finding container 6487257cedad3bfe183579882382d5d957ab9e3ee0331b976aa60b3eaa680490: Status 404 returned error can't find the container with id 6487257cedad3bfe183579882382d5d957ab9e3ee0331b976aa60b3eaa680490
Jul 27 15:57:48.540392 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:48.540350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc" event={"ID":"2785442d-55be-480b-aab4-3e82844504a6","Type":"ContainerStarted","Data":"6487257cedad3bfe183579882382d5d957ab9e3ee0331b976aa60b3eaa680490"}
Jul 27 15:57:49.156010 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:49.155876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:49.547204 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:49.547106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l" event={"ID":"abe552a1-fbf8-4004-8b4e-ef1038dd8914","Type":"ContainerStarted","Data":"1a69de73bf0568f9be9e1feedd48ea6a2ebc8342df4b3dfbdcd665b16a2adafd"}
Jul 27 15:57:49.567823 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:49.567770    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f7696b457-bms4l" podStartSLOduration=2.166085363 podStartE2EDuration="5.567754161s" totalImagesPullingTime="3.401668798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:49.565909993 +0000 UTC m=+571.651865726" watchObservedRunningTime="2026-07-27 15:57:49.567754161 +0000 UTC m=+571.653709893"
Jul 27 15:57:50.380100 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:50.380066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:50.492635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:50.492593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:50.552318 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:50.552285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc" event={"ID":"2785442d-55be-480b-aab4-3e82844504a6","Type":"ContainerStarted","Data":"5d4952640708f3bce5502eff7867e7303371a19b1a760d4e16e4749e88af02d6"}
Jul 27 15:57:50.572900 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:50.572849    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc" podStartSLOduration=1.489429323 podStartE2EDuration="3.572835041s" totalImagesPullingTime="2.083405718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:50.571171183 +0000 UTC m=+572.657126916" watchObservedRunningTime="2026-07-27 15:57:50.572835041 +0000 UTC m=+572.658790772"
Jul 27 15:57:51.155745 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.155700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:51.268041 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.267998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:51.463307 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.463207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:51.556828 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.556802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:57:51.720208 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.720111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:51.975261 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:51.975155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:52.229757 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:52.229663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:53.248267 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:53.248234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:53.383020 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:53.382990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:57:54.050591 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:57:54.050548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:02.563913 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:02.563883    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c7d956869-vmxqc"
Jul 27 15:58:25.247607 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:25.247578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:25.304036 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:25.303993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:40.529751 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:40.529675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:40.636710 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:40.636678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:40.736491 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:40.736457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:41.459880 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:41.459830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:41.663028 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:41.662999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:58.567511 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:58.567476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:58.629680 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:58.629650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:58.901677 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:58.901644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:59.002554 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:59.002520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:59.304324 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:59.304246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:58:59.366001 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:58:59.365946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:09.153606 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:09.153570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:09.434277 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:09.434194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:09.537663 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:09.537629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:09.632361 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:09.632328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:12.595248 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:12.595216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:14.561727 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:14.561693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:16.409138 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:16.409102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:16.553459 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:16.553432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:18.815656 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:18.815612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:18.993348 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:18.993311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:19.768698 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:19.768670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:21.226094 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:21.226060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:23.189001 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.188972    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"]
Jul 27 15:59:23.192365 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.192343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.195478 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.195458    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 15:59:23.195478 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.195461    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r6t56\""
Jul 27 15:59:23.195635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.195475    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:59:23.195635 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.195597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 15:59:23.195779 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.195597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:59:23.208602 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.203868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"]
Jul 27 15:59:23.211267 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.211244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:23.296941 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.296904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:23.354817 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.354790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.354938 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.354823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.354938 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.354861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25hbq\" (UniqueName: \"kubernetes.io/projected/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-kube-api-access-25hbq\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.455485 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.455411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25hbq\" (UniqueName: \"kubernetes.io/projected/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-kube-api-access-25hbq\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.455600 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.455491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.455600 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.455526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.456117 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.456097    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.457863 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.457836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.465766 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.465745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25hbq\" (UniqueName: \"kubernetes.io/projected/5ea8a7a5-a689-4883-b6ec-36a37f53ee61-kube-api-access-25hbq\") pod \"kuadrant-console-plugin-66b5774985-xcjq9\" (UID: \"5ea8a7a5-a689-4883-b6ec-36a37f53ee61\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.502546 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.502525    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"
Jul 27 15:59:23.634167 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.634136    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9"]
Jul 27 15:59:23.637594 ip-10-0-141-100 kubenswrapper[2573]: W0727 15:59:23.637568    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ea8a7a5_a689_4883_b6ec_36a37f53ee61.slice/crio-b7b9e1451745cbc4c246ee167c6bd7a422ca6eaac456eff398907363c2804976 WatchSource:0}: Error finding container b7b9e1451745cbc4c246ee167c6bd7a422ca6eaac456eff398907363c2804976: Status 404 returned error can't find the container with id b7b9e1451745cbc4c246ee167c6bd7a422ca6eaac456eff398907363c2804976
Jul 27 15:59:23.638911 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.638894    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:59:23.984466 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:23.984428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9" event={"ID":"5ea8a7a5-a689-4883-b6ec-36a37f53ee61","Type":"ContainerStarted","Data":"b7b9e1451745cbc4c246ee167c6bd7a422ca6eaac456eff398907363c2804976"}
Jul 27 15:59:24.178078 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:24.178040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:24.392431 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:24.392395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:31.816994 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:31.816935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:31.924012 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:31.923981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:34.283610 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:34.283565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:34.382255 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:34.382216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:36.656587 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:36.656455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:36.776507 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:36.776471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:41.774580 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:41.774544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:41.873820 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:41.873749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:45.574862 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:45.574824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:45.640142 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:45.640104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:47.107360 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:47.107322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9" event={"ID":"5ea8a7a5-a689-4883-b6ec-36a37f53ee61","Type":"ContainerStarted","Data":"71fcb0dbb9606b85c86c99454fa50826be3739a9e10bff74135ac9617914c268"}
Jul 27 15:59:47.134486 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:47.134439    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xcjq9" podStartSLOduration=1.418504475 podStartE2EDuration="24.134423863s" totalImagesPullingTime="22.715919388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:47.132952176 +0000 UTC m=+689.218907908" watchObservedRunningTime="2026-07-27 15:59:47.134423863 +0000 UTC m=+689.220379594"
Jul 27 15:59:52.778556 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:52.778525    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:52.878561 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:52.878524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:57.018372 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:57.018344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 15:59:57.124362 ip-10-0-141-100 kubenswrapper[2573]: I0727 15:59:57.124329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:01.921973 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:01.921909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:02.075890 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:02.075851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:03.717165 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:03.717129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:04.639164 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:04.639131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:06.118375 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.118337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:06.580075 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.580045    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:06.716178 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.716140    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:06.716338 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.716242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:06.719098 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.719074    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5cxqh\""
Jul 27 16:00:06.754471 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.754442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ck2h\" (UniqueName: \"kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h\") pod \"authorino-58cd955675-s7m4l\" (UID: \"d7f33975-ec81-4594-9aa9-29d7baca2336\") " pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:06.772220 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.772200    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:06.797671 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.797648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:06.804776 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.804746    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:06.804849 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.804831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:06.855209 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.855147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ck2h\" (UniqueName: \"kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h\") pod \"authorino-58cd955675-s7m4l\" (UID: \"d7f33975-ec81-4594-9aa9-29d7baca2336\") " pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:06.855209 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.855185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhktt\" (UniqueName: \"kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt\") pod \"authorino-75d556bd77-7czpj\" (UID: \"64a00bee-e37f-412b-bb95-fd56d3d08700\") " pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:06.864435 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.864414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ck2h\" (UniqueName: \"kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h\") pod \"authorino-58cd955675-s7m4l\" (UID: \"d7f33975-ec81-4594-9aa9-29d7baca2336\") " pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:06.900753 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.900719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:06.955604 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.955572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhktt\" (UniqueName: \"kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt\") pod \"authorino-75d556bd77-7czpj\" (UID: \"64a00bee-e37f-412b-bb95-fd56d3d08700\") " pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:06.965309 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:06.965286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhktt\" (UniqueName: \"kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt\") pod \"authorino-75d556bd77-7czpj\" (UID: \"64a00bee-e37f-412b-bb95-fd56d3d08700\") " pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:07.026060 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:07.026031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:07.113280 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:07.113213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:07.205446 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:07.205422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:07.207745 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:00:07.207722    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7f33975_ec81_4594_9aa9_29d7baca2336.slice/crio-904951f5eb6366211727777902e70913b828c73f1abc9fdcb94adcb14a8c7055 WatchSource:0}: Error finding container 904951f5eb6366211727777902e70913b828c73f1abc9fdcb94adcb14a8c7055: Status 404 returned error can't find the container with id 904951f5eb6366211727777902e70913b828c73f1abc9fdcb94adcb14a8c7055
Jul 27 16:00:07.267261 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:07.267238    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:07.269378 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:00:07.269353    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64a00bee_e37f_412b_bb95_fd56d3d08700.slice/crio-02c095b7a0a34a126d4fb0dda3576b0d22a31853c0c08b4e50e584cbbdd4acc9 WatchSource:0}: Error finding container 02c095b7a0a34a126d4fb0dda3576b0d22a31853c0c08b4e50e584cbbdd4acc9: Status 404 returned error can't find the container with id 02c095b7a0a34a126d4fb0dda3576b0d22a31853c0c08b4e50e584cbbdd4acc9
Jul 27 16:00:08.207216 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:08.207180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7m4l" event={"ID":"d7f33975-ec81-4594-9aa9-29d7baca2336","Type":"ContainerStarted","Data":"904951f5eb6366211727777902e70913b828c73f1abc9fdcb94adcb14a8c7055"}
Jul 27 16:00:08.208421 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:08.208396    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7czpj" event={"ID":"64a00bee-e37f-412b-bb95-fd56d3d08700","Type":"ContainerStarted","Data":"02c095b7a0a34a126d4fb0dda3576b0d22a31853c0c08b4e50e584cbbdd4acc9"}
Jul 27 16:00:13.239349 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:13.239315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7m4l" event={"ID":"d7f33975-ec81-4594-9aa9-29d7baca2336","Type":"ContainerStarted","Data":"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"}
Jul 27 16:00:13.240797 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:13.240771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7czpj" event={"ID":"64a00bee-e37f-412b-bb95-fd56d3d08700","Type":"ContainerStarted","Data":"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"}
Jul 27 16:00:13.272170 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:13.272115    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7czpj" podStartSLOduration=2.307772412 podStartE2EDuration="7.272092151s" totalImagesPullingTime="4.964319739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:13.271839228 +0000 UTC m=+715.357794961" watchObservedRunningTime="2026-07-27 16:00:13.272092151 +0000 UTC m=+715.358047884"
Jul 27 16:00:13.272452 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:13.272425    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-s7m4l" podStartSLOduration=2.235595681 podStartE2EDuration="7.27241847s" totalImagesPullingTime="5.036822789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:13.255851726 +0000 UTC m=+715.341807459" watchObservedRunningTime="2026-07-27 16:00:13.27241847 +0000 UTC m=+715.358374203"
Jul 27 16:00:13.304000 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:13.303950    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:15.235093 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.235059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:15.248896 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.248860    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-s7m4l" podUID="d7f33975-ec81-4594-9aa9-29d7baca2336" containerName="authorino" containerID="cri-o://4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5" gracePeriod=30
Jul 27 16:00:15.495156 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.495102    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:15.518169 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.518145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ck2h\" (UniqueName: \"kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h\") pod \"d7f33975-ec81-4594-9aa9-29d7baca2336\" (UID: \"d7f33975-ec81-4594-9aa9-29d7baca2336\") "
Jul 27 16:00:15.520344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.520309    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h" (OuterVolumeSpecName: "kube-api-access-9ck2h") pod "d7f33975-ec81-4594-9aa9-29d7baca2336" (UID: "d7f33975-ec81-4594-9aa9-29d7baca2336"). InnerVolumeSpecName "kube-api-access-9ck2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:15.544241 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.544215    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:15.619275 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:15.619247    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ck2h\" (UniqueName: \"kubernetes.io/projected/d7f33975-ec81-4594-9aa9-29d7baca2336-kube-api-access-9ck2h\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:00:16.254562 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.254524    2573 generic.go:356] "Generic (PLEG): container finished" podID="d7f33975-ec81-4594-9aa9-29d7baca2336" containerID="4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5" exitCode=0
Jul 27 16:00:16.255051 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.254590    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7m4l"
Jul 27 16:00:16.255051 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.254617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7m4l" event={"ID":"d7f33975-ec81-4594-9aa9-29d7baca2336","Type":"ContainerDied","Data":"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"}
Jul 27 16:00:16.255051 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.254668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7m4l" event={"ID":"d7f33975-ec81-4594-9aa9-29d7baca2336","Type":"ContainerDied","Data":"904951f5eb6366211727777902e70913b828c73f1abc9fdcb94adcb14a8c7055"}
Jul 27 16:00:16.255051 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.254686    2573 scope.go:117] "RemoveContainer" containerID="4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"
Jul 27 16:00:16.264205 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.264189    2573 scope.go:117] "RemoveContainer" containerID="4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"
Jul 27 16:00:16.264456 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:16.264438    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5\": container with ID starting with 4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5 not found: ID does not exist" containerID="4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"
Jul 27 16:00:16.264519 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.264463    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5"} err="failed to get container status \"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5\": rpc error: code = NotFound desc = could not find container \"4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5\": container with ID starting with 4703ab4c759094563f95eebf784989e3659b585e64b7ee53aae56345cc1147e5 not found: ID does not exist"
Jul 27 16:00:16.276923 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.276901    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:16.279078 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.279061    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7m4l"]
Jul 27 16:00:16.412410 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:16.412371    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f33975-ec81-4594-9aa9-29d7baca2336" path="/var/lib/kubelet/pods/d7f33975-ec81-4594-9aa9-29d7baca2336/volumes"
Jul 27 16:00:27.902303 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:27.902259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:28.057662 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:28.057616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:28.426337 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:28.426301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:39.978078 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:39.978040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:40.078265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:40.078236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:41.067809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.067762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:41.293197 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.293165    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:41.293578 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.293565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f33975-ec81-4594-9aa9-29d7baca2336" containerName="authorino"
Jul 27 16:00:41.293635 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.293581    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f33975-ec81-4594-9aa9-29d7baca2336" containerName="authorino"
Jul 27 16:00:41.293669 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.293636    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f33975-ec81-4594-9aa9-29d7baca2336" containerName="authorino"
Jul 27 16:00:41.359950 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.359923    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:41.360115 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.360034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:41.443325 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.443292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnkh5\" (UniqueName: \"kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5\") pod \"authorino-5d4b67c446-wfqvc\" (UID: \"cdc321d4-fc39-44da-8d14-01f8ecdefe3c\") " pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:41.543754 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.543716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkh5\" (UniqueName: \"kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5\") pod \"authorino-5d4b67c446-wfqvc\" (UID: \"cdc321d4-fc39-44da-8d14-01f8ecdefe3c\") " pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:41.557481 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.557448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnkh5\" (UniqueName: \"kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5\") pod \"authorino-5d4b67c446-wfqvc\" (UID: \"cdc321d4-fc39-44da-8d14-01f8ecdefe3c\") " pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:41.565643 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.565618    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:41.565910 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.565895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:41.596543 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.596518    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77c446db97-p7l8d"]
Jul 27 16:00:41.600015 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.599997    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:41.609739 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.609711    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77c446db97-p7l8d"]
Jul 27 16:00:41.646637 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.646608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:41.700401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.700376    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:41.702389 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:00:41.702361    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdc321d4_fc39_44da_8d14_01f8ecdefe3c.slice/crio-ad659ccdfe349a60063dea7a096e168a240ef22d6ca1a1b6d84a2e606ea1356f WatchSource:0}: Error finding container ad659ccdfe349a60063dea7a096e168a240ef22d6ca1a1b6d84a2e606ea1356f: Status 404 returned error can't find the container with id ad659ccdfe349a60063dea7a096e168a240ef22d6ca1a1b6d84a2e606ea1356f
Jul 27 16:00:41.745562 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.745533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cf24\" (UniqueName: \"kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24\") pod \"authorino-77c446db97-p7l8d\" (UID: \"c84c6c54-db55-4c01-a738-70d21f94ac74\") " pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:41.797983 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.797943    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77c446db97-p7l8d"]
Jul 27 16:00:41.798250 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:41.798229    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5cf24], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-77c446db97-p7l8d" podUID="c84c6c54-db55-4c01-a738-70d21f94ac74"
Jul 27 16:00:41.828612 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.828584    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:00:41.832022 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.832006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:41.834621 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.834602    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 16:00:41.839528 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.839509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:00:41.846458 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.846439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cf24\" (UniqueName: \"kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24\") pod \"authorino-77c446db97-p7l8d\" (UID: \"c84c6c54-db55-4c01-a738-70d21f94ac74\") " pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:41.858196 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.858177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cf24\" (UniqueName: \"kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24\") pod \"authorino-77c446db97-p7l8d\" (UID: \"c84c6c54-db55-4c01-a738-70d21f94ac74\") " pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:41.947169 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.947105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:41.947169 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:41.947136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mss2\" (UniqueName: \"kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.048285 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.048254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.048285 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.048286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mss2\" (UniqueName: \"kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.050591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.050572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.056973 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.056940    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mss2\" (UniqueName: \"kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2\") pod \"authorino-67f8f5bb8f-np99q\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") " pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.142383 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.142352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:00:42.270481 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.270450    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:00:42.273378 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:00:42.273353    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb73e867_0d33_498b_abae_9f05a0de2061.slice/crio-99b49dd1b365aea0221dde201f7a312619655368d9e8e6dd2b4a96464a1404c3 WatchSource:0}: Error finding container 99b49dd1b365aea0221dde201f7a312619655368d9e8e6dd2b4a96464a1404c3: Status 404 returned error can't find the container with id 99b49dd1b365aea0221dde201f7a312619655368d9e8e6dd2b4a96464a1404c3
Jul 27 16:00:42.380456 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.380418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" event={"ID":"bb73e867-0d33-498b-abae-9f05a0de2061","Type":"ContainerStarted","Data":"99b49dd1b365aea0221dde201f7a312619655368d9e8e6dd2b4a96464a1404c3"}
Jul 27 16:00:42.381609 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.381582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" event={"ID":"cdc321d4-fc39-44da-8d14-01f8ecdefe3c","Type":"ContainerStarted","Data":"ad659ccdfe349a60063dea7a096e168a240ef22d6ca1a1b6d84a2e606ea1356f"}
Jul 27 16:00:42.381609 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.381606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:42.389524 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.389505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:42.551938 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.551911    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cf24\" (UniqueName: \"kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24\") pod \"c84c6c54-db55-4c01-a738-70d21f94ac74\" (UID: \"c84c6c54-db55-4c01-a738-70d21f94ac74\") "
Jul 27 16:00:42.554069 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.554034    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24" (OuterVolumeSpecName: "kube-api-access-5cf24") pod "c84c6c54-db55-4c01-a738-70d21f94ac74" (UID: "c84c6c54-db55-4c01-a738-70d21f94ac74"). InnerVolumeSpecName "kube-api-access-5cf24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:42.653009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:42.652948    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cf24\" (UniqueName: \"kubernetes.io/projected/c84c6c54-db55-4c01-a738-70d21f94ac74-kube-api-access-5cf24\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:00:43.388149 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.388115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" event={"ID":"cdc321d4-fc39-44da-8d14-01f8ecdefe3c","Type":"ContainerStarted","Data":"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"}
Jul 27 16:00:43.388687 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.388164    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" podUID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" containerName="authorino" containerID="cri-o://2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca" gracePeriod=30
Jul 27 16:00:43.389769 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.389749    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c446db97-p7l8d"
Jul 27 16:00:43.389880 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.389753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" event={"ID":"bb73e867-0d33-498b-abae-9f05a0de2061","Type":"ContainerStarted","Data":"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"}
Jul 27 16:00:43.405977 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.405921    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" podStartSLOduration=1.6544981220000001 podStartE2EDuration="2.405907669s" totalImagesPullingTime="751.409547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:43.404526936 +0000 UTC m=+745.490482669" watchObservedRunningTime="2026-07-27 16:00:43.405907669 +0000 UTC m=+745.491863400"
Jul 27 16:00:43.429850 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.429808    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77c446db97-p7l8d"]
Jul 27 16:00:43.431518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.431501    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77c446db97-p7l8d"]
Jul 27 16:00:43.448327 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.448282    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" podStartSLOduration=1.750796958 podStartE2EDuration="2.448268189s" totalImagesPullingTime="697.471231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:43.446900524 +0000 UTC m=+745.532856257" watchObservedRunningTime="2026-07-27 16:00:43.448268189 +0000 UTC m=+745.534223921"
Jul 27 16:00:43.473681 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.473652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:43.473886 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.473837    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7czpj" podUID="64a00bee-e37f-412b-bb95-fd56d3d08700" containerName="authorino" containerID="cri-o://59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b" gracePeriod=30
Jul 27 16:00:43.759896 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.759875    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:43.762731 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.762712    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:43.864091 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.864063    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnkh5\" (UniqueName: \"kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5\") pod \"cdc321d4-fc39-44da-8d14-01f8ecdefe3c\" (UID: \"cdc321d4-fc39-44da-8d14-01f8ecdefe3c\") "
Jul 27 16:00:43.864251 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.864110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhktt\" (UniqueName: \"kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt\") pod \"64a00bee-e37f-412b-bb95-fd56d3d08700\" (UID: \"64a00bee-e37f-412b-bb95-fd56d3d08700\") "
Jul 27 16:00:43.866240 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.866212    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt" (OuterVolumeSpecName: "kube-api-access-nhktt") pod "64a00bee-e37f-412b-bb95-fd56d3d08700" (UID: "64a00bee-e37f-412b-bb95-fd56d3d08700"). InnerVolumeSpecName "kube-api-access-nhktt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:43.866351 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.866246    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5" (OuterVolumeSpecName: "kube-api-access-hnkh5") pod "cdc321d4-fc39-44da-8d14-01f8ecdefe3c" (UID: "cdc321d4-fc39-44da-8d14-01f8ecdefe3c"). InnerVolumeSpecName "kube-api-access-hnkh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:43.964684 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.964616    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnkh5\" (UniqueName: \"kubernetes.io/projected/cdc321d4-fc39-44da-8d14-01f8ecdefe3c-kube-api-access-hnkh5\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:00:43.964684 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:43.964643    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhktt\" (UniqueName: \"kubernetes.io/projected/64a00bee-e37f-412b-bb95-fd56d3d08700-kube-api-access-nhktt\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:00:44.395226 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.395187    2573 generic.go:356] "Generic (PLEG): container finished" podID="64a00bee-e37f-412b-bb95-fd56d3d08700" containerID="59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b" exitCode=0
Jul 27 16:00:44.395663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.395252    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7czpj"
Jul 27 16:00:44.395663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.395279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7czpj" event={"ID":"64a00bee-e37f-412b-bb95-fd56d3d08700","Type":"ContainerDied","Data":"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"}
Jul 27 16:00:44.395663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.395335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7czpj" event={"ID":"64a00bee-e37f-412b-bb95-fd56d3d08700","Type":"ContainerDied","Data":"02c095b7a0a34a126d4fb0dda3576b0d22a31853c0c08b4e50e584cbbdd4acc9"}
Jul 27 16:00:44.395663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.395353    2573 scope.go:117] "RemoveContainer" containerID="59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"
Jul 27 16:00:44.396832 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.396809    2573 generic.go:356] "Generic (PLEG): container finished" podID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" containerID="2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca" exitCode=0
Jul 27 16:00:44.396942 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.396864    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wfqvc"
Jul 27 16:00:44.396942 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.396921    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" event={"ID":"cdc321d4-fc39-44da-8d14-01f8ecdefe3c","Type":"ContainerDied","Data":"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"}
Jul 27 16:00:44.397079 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.396976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wfqvc" event={"ID":"cdc321d4-fc39-44da-8d14-01f8ecdefe3c","Type":"ContainerDied","Data":"ad659ccdfe349a60063dea7a096e168a240ef22d6ca1a1b6d84a2e606ea1356f"}
Jul 27 16:00:44.404392 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.404357    2573 scope.go:117] "RemoveContainer" containerID="59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"
Jul 27 16:00:44.404712 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:44.404689    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b\": container with ID starting with 59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b not found: ID does not exist" containerID="59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"
Jul 27 16:00:44.404809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.404721    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b"} err="failed to get container status \"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b\": rpc error: code = NotFound desc = could not find container \"59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b\": container with ID starting with 59b8a5080b1e2cf1b5a8b30e0978faa3accfd7663c9981db69b38dc00217497b not found: ID does not exist"
Jul 27 16:00:44.404809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.404738    2573 scope.go:117] "RemoveContainer" containerID="2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"
Jul 27 16:00:44.411842 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.411815    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c84c6c54-db55-4c01-a738-70d21f94ac74" path="/var/lib/kubelet/pods/c84c6c54-db55-4c01-a738-70d21f94ac74/volumes"
Jul 27 16:00:44.413242 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.413222    2573 scope.go:117] "RemoveContainer" containerID="2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"
Jul 27 16:00:44.413514 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:44.413491    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca\": container with ID starting with 2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca not found: ID does not exist" containerID="2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"
Jul 27 16:00:44.413599 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.413524    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca"} err="failed to get container status \"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca\": rpc error: code = NotFound desc = could not find container \"2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca\": container with ID starting with 2bfed6e20a6f88de781918bd0c940eae65d2a427308f0ab9a9e08b9d013e89ca not found: ID does not exist"
Jul 27 16:00:44.422181 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.422163    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:44.427714 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.427695    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7czpj"]
Jul 27 16:00:44.441004 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.440982    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:44.447259 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:44.447237    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wfqvc"]
Jul 27 16:00:46.411868 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:46.411838    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a00bee-e37f-412b-bb95-fd56d3d08700" path="/var/lib/kubelet/pods/64a00bee-e37f-412b-bb95-fd56d3d08700/volumes"
Jul 27 16:00:46.412246 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:46.412153    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" path="/var/lib/kubelet/pods/cdc321d4-fc39-44da-8d14-01f8ecdefe3c/volumes"
Jul 27 16:00:48.282375 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.282344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:48.301234 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301204    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:00:48.301593 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301580    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a00bee-e37f-412b-bb95-fd56d3d08700" containerName="authorino"
Jul 27 16:00:48.301632 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301595    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a00bee-e37f-412b-bb95-fd56d3d08700" containerName="authorino"
Jul 27 16:00:48.301632 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301604    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" containerName="authorino"
Jul 27 16:00:48.301632 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301610    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" containerName="authorino"
Jul 27 16:00:48.301725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301685    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc321d4-fc39-44da-8d14-01f8ecdefe3c" containerName="authorino"
Jul 27 16:00:48.301725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.301696    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a00bee-e37f-412b-bb95-fd56d3d08700" containerName="authorino"
Jul 27 16:00:48.306092 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.306075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:48.309127 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.309105    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 16:00:48.309224 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.309133    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v4948\""
Jul 27 16:00:48.310121 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.310106    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 16:00:48.315668 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.315646    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:00:48.406475 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.406437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:48.406627 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.406585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khpq4\" (UniqueName: \"kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:48.507150 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.507108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:48.507333 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.507228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khpq4\" (UniqueName: \"kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:48.507333 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:48.507252    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 16:00:48.507460 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:00:48.507346    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert podName:46b01307-98c5-4356-8845-912e1fc717d2 nodeName:}" failed. No retries permitted until 2026-07-27 16:00:49.007325871 +0000 UTC m=+751.093281606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert") pod "maas-controller-7f54f58d59-tq2z7" (UID: "46b01307-98c5-4356-8845-912e1fc717d2") : secret "maas-controller-webhook-cert" not found
Jul 27 16:00:48.519257 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:48.519226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khpq4\" (UniqueName: \"kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:49.010908 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.010875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:49.013383 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.013358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") pod \"maas-controller-7f54f58d59-tq2z7\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") " pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:49.123141 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.123108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:49.217539 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.217505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:49.221953 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.221928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:49.353214 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.352728    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:00:49.359855 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:00:49.359827    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b01307_98c5_4356_8845_912e1fc717d2.slice/crio-24c4aa55be71f078abd33d6b03c4d67e4140dd792072d29cdae6a18f4b005573 WatchSource:0}: Error finding container 24c4aa55be71f078abd33d6b03c4d67e4140dd792072d29cdae6a18f4b005573: Status 404 returned error can't find the container with id 24c4aa55be71f078abd33d6b03c4d67e4140dd792072d29cdae6a18f4b005573
Jul 27 16:00:49.424838 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:49.424796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" event={"ID":"46b01307-98c5-4356-8845-912e1fc717d2","Type":"ContainerStarted","Data":"24c4aa55be71f078abd33d6b03c4d67e4140dd792072d29cdae6a18f4b005573"}
Jul 27 16:00:52.094099 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:52.094066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:52.195197 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:52.195163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:00:54.450267 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:54.450232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" event={"ID":"46b01307-98c5-4356-8845-912e1fc717d2","Type":"ContainerStarted","Data":"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"}
Jul 27 16:00:54.450634 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:54.450364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:00:54.469771 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:00:54.469725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" podStartSLOduration=1.84564683 podStartE2EDuration="6.46971128s" totalImagesPullingTime="4.62406445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:54.468552103 +0000 UTC m=+756.554507836" watchObservedRunningTime="2026-07-27 16:00:54.46971128 +0000 UTC m=+756.555667012"
Jul 27 16:01:03.844087 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:03.844054    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:01:03.844498 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:03.844263    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" podUID="46b01307-98c5-4356-8845-912e1fc717d2" containerName="manager" containerID="cri-o://1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657" gracePeriod=30
Jul 27 16:01:03.845986 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:03.845943    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:01:04.091591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.091567    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:01:04.143833 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.143770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khpq4\" (UniqueName: \"kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4\") pod \"46b01307-98c5-4356-8845-912e1fc717d2\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") "
Jul 27 16:01:04.144007 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.143978    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") pod \"46b01307-98c5-4356-8845-912e1fc717d2\" (UID: \"46b01307-98c5-4356-8845-912e1fc717d2\") "
Jul 27 16:01:04.145930 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.145907    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4" (OuterVolumeSpecName: "kube-api-access-khpq4") pod "46b01307-98c5-4356-8845-912e1fc717d2" (UID: "46b01307-98c5-4356-8845-912e1fc717d2"). InnerVolumeSpecName "kube-api-access-khpq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:01:04.146028 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.145924    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46b01307-98c5-4356-8845-912e1fc717d2" (UID: "46b01307-98c5-4356-8845-912e1fc717d2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 16:01:04.244711 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.244679    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b01307-98c5-4356-8845-912e1fc717d2-webhook-cert\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:01:04.244711 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.244705    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khpq4\" (UniqueName: \"kubernetes.io/projected/46b01307-98c5-4356-8845-912e1fc717d2-kube-api-access-khpq4\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:01:04.497236 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.497204    2573 generic.go:356] "Generic (PLEG): container finished" podID="46b01307-98c5-4356-8845-912e1fc717d2" containerID="1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657" exitCode=0
Jul 27 16:01:04.497395 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.497242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" event={"ID":"46b01307-98c5-4356-8845-912e1fc717d2","Type":"ContainerDied","Data":"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"}
Jul 27 16:01:04.497395 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.497296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f54f58d59-tq2z7" event={"ID":"46b01307-98c5-4356-8845-912e1fc717d2","Type":"ContainerDied","Data":"24c4aa55be71f078abd33d6b03c4d67e4140dd792072d29cdae6a18f4b005573"}
Jul 27 16:01:04.497395 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.497319    2573 scope.go:117] "RemoveContainer" containerID="1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"
Jul 27 16:01:04.497395 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.497249    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f54f58d59-tq2z7"
Jul 27 16:01:04.507214 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.507197    2573 scope.go:117] "RemoveContainer" containerID="1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"
Jul 27 16:01:04.507455 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:01:04.507434    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657\": container with ID starting with 1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657 not found: ID does not exist" containerID="1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"
Jul 27 16:01:04.507513 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.507462    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657"} err="failed to get container status \"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657\": rpc error: code = NotFound desc = could not find container \"1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657\": container with ID starting with 1c32a503e1096a9bd469f762c725af057b84814820d0588823e684170c5ea657 not found: ID does not exist"
Jul 27 16:01:04.532416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.532396    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:01:04.536138 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:04.536119    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f54f58d59-tq2z7"]
Jul 27 16:01:06.411291 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:06.411256    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b01307-98c5-4356-8845-912e1fc717d2" path="/var/lib/kubelet/pods/46b01307-98c5-4356-8845-912e1fc717d2/volumes"
Jul 27 16:01:23.876774 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:23.876731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:23.973572 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:23.973542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:24.420035 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.420001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:24.478694 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.478664    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"]
Jul 27 16:01:24.479042 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.479027    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b01307-98c5-4356-8845-912e1fc717d2" containerName="manager"
Jul 27 16:01:24.479095 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.479044    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b01307-98c5-4356-8845-912e1fc717d2" containerName="manager"
Jul 27 16:01:24.479133 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.479118    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b01307-98c5-4356-8845-912e1fc717d2" containerName="manager"
Jul 27 16:01:24.485265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.485245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.489898 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.489876    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 16:01:24.490131 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.490114    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 16:01:24.490207 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.490116    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 16:01:24.498368 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.498344    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"]
Jul 27 16:01:24.628167 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.628135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c002fb17-00cf-4af3-8274-4800a9fab2d9-maas-api-tls\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.628337 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.628218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5bd8\" (UniqueName: \"kubernetes.io/projected/c002fb17-00cf-4af3-8274-4800a9fab2d9-kube-api-access-g5bd8\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.628337 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.628240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c002fb17-00cf-4af3-8274-4800a9fab2d9-openshift-service-ca\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.652884 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.652858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:24.729344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.729275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5bd8\" (UniqueName: \"kubernetes.io/projected/c002fb17-00cf-4af3-8274-4800a9fab2d9-kube-api-access-g5bd8\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.729344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.729310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c002fb17-00cf-4af3-8274-4800a9fab2d9-openshift-service-ca\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.729344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.729334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c002fb17-00cf-4af3-8274-4800a9fab2d9-maas-api-tls\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.729890 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.729870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c002fb17-00cf-4af3-8274-4800a9fab2d9-openshift-service-ca\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.731708 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.731688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c002fb17-00cf-4af3-8274-4800a9fab2d9-maas-api-tls\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.740875 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.740856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5bd8\" (UniqueName: \"kubernetes.io/projected/c002fb17-00cf-4af3-8274-4800a9fab2d9-kube-api-access-g5bd8\") pod \"maas-api-d95987bcf-zg9w7\" (UID: \"c002fb17-00cf-4af3-8274-4800a9fab2d9\") " pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.795236 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.795214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:24.930832 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:24.930802    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"]
Jul 27 16:01:24.934397 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:01:24.934371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc002fb17_00cf_4af3_8274_4800a9fab2d9.slice/crio-817f53ed2eeaf9c97b43954d7e56c3ba12f0119b5c94bbd1098a84c71dbea69d WatchSource:0}: Error finding container 817f53ed2eeaf9c97b43954d7e56c3ba12f0119b5c94bbd1098a84c71dbea69d: Status 404 returned error can't find the container with id 817f53ed2eeaf9c97b43954d7e56c3ba12f0119b5c94bbd1098a84c71dbea69d
Jul 27 16:01:25.002059 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.001979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:25.103916 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.103885    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:25.169088 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.169056    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"]
Jul 27 16:01:25.174413 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.174388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.178680 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.178658    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g2ppj\""
Jul 27 16:01:25.178786 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.178759    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 16:01:25.185801 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.185781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"]
Jul 27 16:01:25.334821 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.334790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llvc\" (UniqueName: \"kubernetes.io/projected/e2c331a5-e6ed-4793-84fc-35b3c276a583-kube-api-access-7llvc\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.335023 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.334860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c331a5-e6ed-4793-84fc-35b3c276a583-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.435357 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.435324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llvc\" (UniqueName: \"kubernetes.io/projected/e2c331a5-e6ed-4793-84fc-35b3c276a583-kube-api-access-7llvc\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.435511 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.435372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c331a5-e6ed-4793-84fc-35b3c276a583-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.436023 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.436006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c331a5-e6ed-4793-84fc-35b3c276a583-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.447496 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.447476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llvc\" (UniqueName: \"kubernetes.io/projected/e2c331a5-e6ed-4793-84fc-35b3c276a583-kube-api-access-7llvc\") pod \"payload-pre-processing-687dbb6cf6-2sfgr\" (UID: \"e2c331a5-e6ed-4793-84fc-35b3c276a583\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.486449 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.486425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:25.595133 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.595059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7" event={"ID":"c002fb17-00cf-4af3-8274-4800a9fab2d9","Type":"ContainerStarted","Data":"817f53ed2eeaf9c97b43954d7e56c3ba12f0119b5c94bbd1098a84c71dbea69d"}
Jul 27 16:01:25.620338 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:25.620314    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"]
Jul 27 16:01:25.622332 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:01:25.622303    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c331a5_e6ed_4793_84fc_35b3c276a583.slice/crio-a43d7c6355e5b710a5b70a53ab93b24e7303acf230bc789be2744e6f961435ed WatchSource:0}: Error finding container a43d7c6355e5b710a5b70a53ab93b24e7303acf230bc789be2744e6f961435ed: Status 404 returned error can't find the container with id a43d7c6355e5b710a5b70a53ab93b24e7303acf230bc789be2744e6f961435ed
Jul 27 16:01:26.603370 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:26.603336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr" event={"ID":"e2c331a5-e6ed-4793-84fc-35b3c276a583","Type":"ContainerStarted","Data":"a43d7c6355e5b710a5b70a53ab93b24e7303acf230bc789be2744e6f961435ed"}
Jul 27 16:01:27.610394 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:27.610355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7" event={"ID":"c002fb17-00cf-4af3-8274-4800a9fab2d9","Type":"ContainerStarted","Data":"7cdf27513a05fe9959c56692b71c2a28b178ef4b44f1e14fc2bafde94c242820"}
Jul 27 16:01:27.610830 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:27.610490    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:27.631712 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:27.631658    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7" podStartSLOduration=1.484183464 podStartE2EDuration="3.631641502s" totalImagesPullingTime="2.147458038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:27.630443658 +0000 UTC m=+789.716399390" watchObservedRunningTime="2026-07-27 16:01:27.631641502 +0000 UTC m=+789.717597234"
Jul 27 16:01:28.616827 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:28.616756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr" event={"ID":"e2c331a5-e6ed-4793-84fc-35b3c276a583","Type":"ContainerStarted","Data":"ab33f54f66b04986670712518205e8143e1a6d1521d762bd1b666921c844640d"}
Jul 27 16:01:28.617335 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:28.616979    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:28.635999 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:28.635939    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr" podStartSLOduration=1.202541243 podStartE2EDuration="3.635922969s" totalImagesPullingTime="2.433381726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:28.633939915 +0000 UTC m=+790.719895648" watchObservedRunningTime="2026-07-27 16:01:28.635922969 +0000 UTC m=+790.721878700"
Jul 27 16:01:33.622398 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:33.622359    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d95987bcf-zg9w7"
Jul 27 16:01:34.695572 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:34.695535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:34.878753 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:34.878720    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:39.623326 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:39.623288    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2sfgr"
Jul 27 16:01:44.986396 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.986318    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"]
Jul 27 16:01:44.989679 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.989659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:44.994015 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.993994    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 16:01:44.994139 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.994081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9b5nx\""
Jul 27 16:01:44.994139 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.994117    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 16:01:44.994139 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:44.994125    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 16:01:45.005635 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.005733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsrs\" (UniqueName: \"kubernetes.io/projected/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-kube-api-access-lwsrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.005733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.005844 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.005844 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.005925 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.005872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.013547 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.013526    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"]
Jul 27 16:01:45.077285 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.077252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:45.106416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106592 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106592 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsrs\" (UniqueName: \"kubernetes.io/projected/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-kube-api-access-lwsrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106592 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106592 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106592 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.106946 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106916    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.107046 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.106930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.107046 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.107016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.108717 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.108695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.109789 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.109767    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.117073 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.117042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsrs\" (UniqueName: \"kubernetes.io/projected/5e3b48d6-06ba-4ac8-a23a-9ceebca38804-kube-api-access-lwsrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8\" (UID: \"5e3b48d6-06ba-4ac8-a23a-9ceebca38804\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.300122 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.300037    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:45.448126 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.448102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"]
Jul 27 16:01:45.451008 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:01:45.450979    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3b48d6_06ba_4ac8_a23a_9ceebca38804.slice/crio-1c0378169854344c368b20d755788a76069562b9677f8092330fa4789e28ab23 WatchSource:0}: Error finding container 1c0378169854344c368b20d755788a76069562b9677f8092330fa4789e28ab23: Status 404 returned error can't find the container with id 1c0378169854344c368b20d755788a76069562b9677f8092330fa4789e28ab23
Jul 27 16:01:45.697983 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:45.697931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8" event={"ID":"5e3b48d6-06ba-4ac8-a23a-9ceebca38804","Type":"ContainerStarted","Data":"1c0378169854344c368b20d755788a76069562b9677f8092330fa4789e28ab23"}
Jul 27 16:01:47.711552 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:47.711512    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8" event={"ID":"5e3b48d6-06ba-4ac8-a23a-9ceebca38804","Type":"ContainerStarted","Data":"8bcb1dded686959af3071a39117c71be69f3318b187ad489550b2f9f3a4a204f"}
Jul 27 16:01:47.734998 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:47.734921    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8" podStartSLOduration=2.406310027 podStartE2EDuration="3.734904904s" totalImagesPullingTime="1.328594877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:47.732719614 +0000 UTC m=+809.818675347" watchObservedRunningTime="2026-07-27 16:01:47.734904904 +0000 UTC m=+809.820860637"
Jul 27 16:01:53.343002 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:53.342941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:01:55.301133 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:55.301095    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:55.301511 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:55.301168    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:55.313430 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:55.313407    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:01:55.759923 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:01:55.759896    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8"
Jul 27 16:02:05.398844 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.398806    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"]
Jul 27 16:02:05.403638 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.403622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.406570 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.406546    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 16:02:05.414009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.413953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"]
Jul 27 16:02:05.429581 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.429553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:02:05.494485 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.494667 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.494667 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.494667 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.494805 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.494805 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.494768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ng5\" (UniqueName: \"kubernetes.io/projected/dc76b14a-9f60-4d50-b060-1efd86cd42f1-kube-api-access-x7ng5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.595748 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.595748 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ng5\" (UniqueName: \"kubernetes.io/projected/dc76b14a-9f60-4d50-b060-1efd86cd42f1-kube-api-access-x7ng5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.595914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596260 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.596240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596323 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.596287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.596381 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.596361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.598000 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.597975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc76b14a-9f60-4d50-b060-1efd86cd42f1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.598307 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.598290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc76b14a-9f60-4d50-b060-1efd86cd42f1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.604435 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.604407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ng5\" (UniqueName: \"kubernetes.io/projected/dc76b14a-9f60-4d50-b060-1efd86cd42f1-kube-api-access-x7ng5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p9rtg\" (UID: \"dc76b14a-9f60-4d50-b060-1efd86cd42f1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.714530 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.714444    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:05.853235 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:05.852977    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"]
Jul 27 16:02:05.862168 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:02:05.862136    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc76b14a_9f60_4d50_b060_1efd86cd42f1.slice/crio-af37ad8fa685d70aea59f260a770257994675903052d75bc39694494c6cf3f0e WatchSource:0}: Error finding container af37ad8fa685d70aea59f260a770257994675903052d75bc39694494c6cf3f0e: Status 404 returned error can't find the container with id af37ad8fa685d70aea59f260a770257994675903052d75bc39694494c6cf3f0e
Jul 27 16:02:06.809209 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:06.809169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg" event={"ID":"dc76b14a-9f60-4d50-b060-1efd86cd42f1","Type":"ContainerStarted","Data":"da02dda1822ac72a9df54f83b6e01ac5931075c1114102671cd2e35cb76ff8c5"}
Jul 27 16:02:06.809601 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:06.809232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg" event={"ID":"dc76b14a-9f60-4d50-b060-1efd86cd42f1","Type":"ContainerStarted","Data":"af37ad8fa685d70aea59f260a770257994675903052d75bc39694494c6cf3f0e"}
Jul 27 16:02:06.832913 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:06.832842    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg" podStartSLOduration=1.090706867 podStartE2EDuration="1.832820831s" totalImagesPullingTime="742.113964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:02:06.831944301 +0000 UTC m=+828.917900024" watchObservedRunningTime="2026-07-27 16:02:06.832820831 +0000 UTC m=+828.918776563"
Jul 27 16:02:15.715402 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:15.715360    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:15.715885 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:15.715433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:15.727782 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:15.727761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:15.866277 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:15.866249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p9rtg"
Jul 27 16:02:19.051931 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:19.051893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:02:26.027377 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:02:26.027342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:12.420765 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:12.420672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:50.894808 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:50.894745    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b486cbc88-6wwpw"]
Jul 27 16:03:50.898063 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:50.898048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:50.907057 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:50.907028    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b486cbc88-6wwpw"]
Jul 27 16:03:51.038504 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.038473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzzk\" (UniqueName: \"kubernetes.io/projected/c1a4adec-2956-4be1-97ca-b398ea2b9d77-kube-api-access-4gzzk\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.038504 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.038507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1a4adec-2956-4be1-97ca-b398ea2b9d77-tls-cert\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.139616 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.139584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzzk\" (UniqueName: \"kubernetes.io/projected/c1a4adec-2956-4be1-97ca-b398ea2b9d77-kube-api-access-4gzzk\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.139616 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.139618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1a4adec-2956-4be1-97ca-b398ea2b9d77-tls-cert\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.142112 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.142090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1a4adec-2956-4be1-97ca-b398ea2b9d77-tls-cert\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.150633 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.150572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzzk\" (UniqueName: \"kubernetes.io/projected/c1a4adec-2956-4be1-97ca-b398ea2b9d77-kube-api-access-4gzzk\") pod \"authorino-6b486cbc88-6wwpw\" (UID: \"c1a4adec-2956-4be1-97ca-b398ea2b9d77\") " pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.207580 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.207554    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b486cbc88-6wwpw"
Jul 27 16:03:51.320652 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.320615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:51.348809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.348780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b486cbc88-6wwpw"]
Jul 27 16:03:51.351384 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:03:51.351358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1a4adec_2956_4be1_97ca_b398ea2b9d77.slice/crio-5ee4f6a53f436b769167996da10d9f3fce2dde81739295fe1ebe63bbcbd6a1eb WatchSource:0}: Error finding container 5ee4f6a53f436b769167996da10d9f3fce2dde81739295fe1ebe63bbcbd6a1eb: Status 404 returned error can't find the container with id 5ee4f6a53f436b769167996da10d9f3fce2dde81739295fe1ebe63bbcbd6a1eb
Jul 27 16:03:51.416488 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:51.416386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:52.320855 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:52.320820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b486cbc88-6wwpw" event={"ID":"c1a4adec-2956-4be1-97ca-b398ea2b9d77","Type":"ContainerStarted","Data":"5ee4f6a53f436b769167996da10d9f3fce2dde81739295fe1ebe63bbcbd6a1eb"}
Jul 27 16:03:54.262250 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:54.262210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:54.362493 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:54.362443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:03:55.337582 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.337539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b486cbc88-6wwpw" event={"ID":"c1a4adec-2956-4be1-97ca-b398ea2b9d77","Type":"ContainerStarted","Data":"21644c5897c15cfc3df4e15668f6ab3982c2aa62bc8f3a37710b9e4cc681db2f"}
Jul 27 16:03:55.362827 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.362772    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b486cbc88-6wwpw" podStartSLOduration=1.977695049 podStartE2EDuration="5.36275289s" totalImagesPullingTime="3.385057841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:03:55.360292237 +0000 UTC m=+937.446247970" watchObservedRunningTime="2026-07-27 16:03:55.36275289 +0000 UTC m=+937.448708622"
Jul 27 16:03:55.394318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.394280    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:03:55.394517 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.394465    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" podUID="bb73e867-0d33-498b-abae-9f05a0de2061" containerName="authorino" containerID="cri-o://a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b" gracePeriod=30
Jul 27 16:03:55.646936 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.646912    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:03:55.785595 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.785554    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mss2\" (UniqueName: \"kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2\") pod \"bb73e867-0d33-498b-abae-9f05a0de2061\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") "
Jul 27 16:03:55.785768 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.785605    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert\") pod \"bb73e867-0d33-498b-abae-9f05a0de2061\" (UID: \"bb73e867-0d33-498b-abae-9f05a0de2061\") "
Jul 27 16:03:55.787698 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.787668    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2" (OuterVolumeSpecName: "kube-api-access-4mss2") pod "bb73e867-0d33-498b-abae-9f05a0de2061" (UID: "bb73e867-0d33-498b-abae-9f05a0de2061"). InnerVolumeSpecName "kube-api-access-4mss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:03:55.796467 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.796432    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bb73e867-0d33-498b-abae-9f05a0de2061" (UID: "bb73e867-0d33-498b-abae-9f05a0de2061"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 16:03:55.886568 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.886486    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mss2\" (UniqueName: \"kubernetes.io/projected/bb73e867-0d33-498b-abae-9f05a0de2061-kube-api-access-4mss2\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:03:55.886568 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:55.886515    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb73e867-0d33-498b-abae-9f05a0de2061-tls-cert\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:03:56.344065 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.344025    2573 generic.go:356] "Generic (PLEG): container finished" podID="bb73e867-0d33-498b-abae-9f05a0de2061" containerID="a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b" exitCode=0
Jul 27 16:03:56.344065 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.344064    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8f5bb8f-np99q"
Jul 27 16:03:56.344598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.344102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" event={"ID":"bb73e867-0d33-498b-abae-9f05a0de2061","Type":"ContainerDied","Data":"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"}
Jul 27 16:03:56.344598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.344147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8f5bb8f-np99q" event={"ID":"bb73e867-0d33-498b-abae-9f05a0de2061","Type":"ContainerDied","Data":"99b49dd1b365aea0221dde201f7a312619655368d9e8e6dd2b4a96464a1404c3"}
Jul 27 16:03:56.344598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.344166    2573 scope.go:117] "RemoveContainer" containerID="a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"
Jul 27 16:03:56.354652 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.354629    2573 scope.go:117] "RemoveContainer" containerID="a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"
Jul 27 16:03:56.354910 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:03:56.354890    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b\": container with ID starting with a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b not found: ID does not exist" containerID="a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"
Jul 27 16:03:56.355023 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.354917    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b"} err="failed to get container status \"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b\": rpc error: code = NotFound desc = could not find container \"a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b\": container with ID starting with a0f610e6a3f31036b4a6426c85a899febb8c06bb5f11d228bad484553f8f184b not found: ID does not exist"
Jul 27 16:03:56.373091 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.373063    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:03:56.379096 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.379068    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67f8f5bb8f-np99q"]
Jul 27 16:03:56.413139 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:03:56.413106    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb73e867-0d33-498b-abae-9f05a0de2061" path="/var/lib/kubelet/pods/bb73e867-0d33-498b-abae-9f05a0de2061/volumes"
Jul 27 16:04:29.666599 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:04:29.666557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:05:40.818753 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.818717    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:05:40.819293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.819179    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb73e867-0d33-498b-abae-9f05a0de2061" containerName="authorino"
Jul 27 16:05:40.819293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.819193    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb73e867-0d33-498b-abae-9f05a0de2061" containerName="authorino"
Jul 27 16:05:40.819293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.819268    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb73e867-0d33-498b-abae-9f05a0de2061" containerName="authorino"
Jul 27 16:05:40.822414 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.822398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:40.825572 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.825550    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v4948\""
Jul 27 16:05:40.826730 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.826710    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 16:05:40.826816 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.826796    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 16:05:40.839939 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.839914    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:05:40.914866 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.914839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:40.915035 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:40.914910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4bvr\" (UniqueName: \"kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.015891 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.015846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4bvr\" (UniqueName: \"kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.016069 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.015940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.018395 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.018372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.025787 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.025761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4bvr\" (UniqueName: \"kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr\") pod \"maas-controller-7bf786f7f9-vtkv2\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") " pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.132296 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.132260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:41.270943 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.270919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:05:41.273325 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:05:41.273289    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4a6663_625c_4ece_bf8b_fe271340368a.slice/crio-7af92df8145721a4b28c304e6483e05bd8d52cd9832106c2e50a7e0fb509e397 WatchSource:0}: Error finding container 7af92df8145721a4b28c304e6483e05bd8d52cd9832106c2e50a7e0fb509e397: Status 404 returned error can't find the container with id 7af92df8145721a4b28c304e6483e05bd8d52cd9832106c2e50a7e0fb509e397
Jul 27 16:05:41.274971 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.274939    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 16:05:41.842683 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:41.842649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" event={"ID":"ea4a6663-625c-4ece-bf8b-fe271340368a","Type":"ContainerStarted","Data":"7af92df8145721a4b28c304e6483e05bd8d52cd9832106c2e50a7e0fb509e397"}
Jul 27 16:05:44.858536 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:44.858506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" event={"ID":"ea4a6663-625c-4ece-bf8b-fe271340368a","Type":"ContainerStarted","Data":"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"}
Jul 27 16:05:44.858887 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:44.858565    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:05:44.883949 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:44.883904    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" podStartSLOduration=1.488489461 podStartE2EDuration="4.883889455s" totalImagesPullingTime="3.395399994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:05:44.882613631 +0000 UTC m=+1046.968569363" watchObservedRunningTime="2026-07-27 16:05:44.883889455 +0000 UTC m=+1046.969845187"
Jul 27 16:05:55.865522 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:05:55.865490    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:06:00.470155 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.470104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:00.539123 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.539090    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:06:00.539329 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.539308    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" podUID="ea4a6663-625c-4ece-bf8b-fe271340368a" containerName="manager" containerID="cri-o://96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7" gracePeriod=30
Jul 27 16:06:00.784638 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.784615    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:06:00.897249 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.897217    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4bvr\" (UniqueName: \"kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr\") pod \"ea4a6663-625c-4ece-bf8b-fe271340368a\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") "
Jul 27 16:06:00.897403 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.897270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert\") pod \"ea4a6663-625c-4ece-bf8b-fe271340368a\" (UID: \"ea4a6663-625c-4ece-bf8b-fe271340368a\") "
Jul 27 16:06:00.899319 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.899291    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ea4a6663-625c-4ece-bf8b-fe271340368a" (UID: "ea4a6663-625c-4ece-bf8b-fe271340368a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 16:06:00.899438 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.899363    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr" (OuterVolumeSpecName: "kube-api-access-m4bvr") pod "ea4a6663-625c-4ece-bf8b-fe271340368a" (UID: "ea4a6663-625c-4ece-bf8b-fe271340368a"). InnerVolumeSpecName "kube-api-access-m4bvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:06:00.936859 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.936833    2573 generic.go:356] "Generic (PLEG): container finished" podID="ea4a6663-625c-4ece-bf8b-fe271340368a" containerID="96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7" exitCode=0
Jul 27 16:06:00.937009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.936886    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2"
Jul 27 16:06:00.937009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.936920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" event={"ID":"ea4a6663-625c-4ece-bf8b-fe271340368a","Type":"ContainerDied","Data":"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"}
Jul 27 16:06:00.937009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.936984    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-vtkv2" event={"ID":"ea4a6663-625c-4ece-bf8b-fe271340368a","Type":"ContainerDied","Data":"7af92df8145721a4b28c304e6483e05bd8d52cd9832106c2e50a7e0fb509e397"}
Jul 27 16:06:00.937009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.937007    2573 scope.go:117] "RemoveContainer" containerID="96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"
Jul 27 16:06:00.945902 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.945884    2573 scope.go:117] "RemoveContainer" containerID="96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"
Jul 27 16:06:00.946172 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:06:00.946152    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7\": container with ID starting with 96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7 not found: ID does not exist" containerID="96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"
Jul 27 16:06:00.946229 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.946180    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7"} err="failed to get container status \"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7\": rpc error: code = NotFound desc = could not find container \"96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7\": container with ID starting with 96736e9e0dde043b311082ad01be104e996cd3c48ba6c140daac5c90ac589dc7 not found: ID does not exist"
Jul 27 16:06:00.961822 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.961795    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:06:00.966702 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.966681    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-vtkv2"]
Jul 27 16:06:00.998233 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.998211    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4bvr\" (UniqueName: \"kubernetes.io/projected/ea4a6663-625c-4ece-bf8b-fe271340368a-kube-api-access-m4bvr\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:06:00.998233 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:00.998231    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea4a6663-625c-4ece-bf8b-fe271340368a-webhook-cert\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:06:01.677835 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.677801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:01.802038 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.802000    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-zlcqj"]
Jul 27 16:06:01.802488 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.802469    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4a6663-625c-4ece-bf8b-fe271340368a" containerName="manager"
Jul 27 16:06:01.802584 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.802490    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4a6663-625c-4ece-bf8b-fe271340368a" containerName="manager"
Jul 27 16:06:01.802638 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.802597    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4a6663-625c-4ece-bf8b-fe271340368a" containerName="manager"
Jul 27 16:06:01.806826 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.806803    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:01.809560 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.809537    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 16:06:01.810651 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.810635    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v4948\""
Jul 27 16:06:01.810740 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.810693    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 16:06:01.818228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.818207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-zlcqj"]
Jul 27 16:06:01.907338 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.907282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d152b16-7724-4b23-b748-5307ce6274fc-webhook-cert\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:01.907522 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:01.907368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpq4\" (UniqueName: \"kubernetes.io/projected/4d152b16-7724-4b23-b748-5307ce6274fc-kube-api-access-xdpq4\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.008598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.008495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d152b16-7724-4b23-b748-5307ce6274fc-webhook-cert\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.008598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.008589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpq4\" (UniqueName: \"kubernetes.io/projected/4d152b16-7724-4b23-b748-5307ce6274fc-kube-api-access-xdpq4\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.010993 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.010973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d152b16-7724-4b23-b748-5307ce6274fc-webhook-cert\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.023739 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.023716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpq4\" (UniqueName: \"kubernetes.io/projected/4d152b16-7724-4b23-b748-5307ce6274fc-kube-api-access-xdpq4\") pod \"maas-controller-7bf786f7f9-zlcqj\" (UID: \"4d152b16-7724-4b23-b748-5307ce6274fc\") " pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.117327 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.117293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:02.254698 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.254669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-zlcqj"]
Jul 27 16:06:02.257008 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:06:02.256980    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d152b16_7724_4b23_b748_5307ce6274fc.slice/crio-de800c721710d9593c29be18ea58989a3fa648657f9c9fb04be4b608479ecab5 WatchSource:0}: Error finding container de800c721710d9593c29be18ea58989a3fa648657f9c9fb04be4b608479ecab5: Status 404 returned error can't find the container with id de800c721710d9593c29be18ea58989a3fa648657f9c9fb04be4b608479ecab5
Jul 27 16:06:02.412630 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.412596    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4a6663-625c-4ece-bf8b-fe271340368a" path="/var/lib/kubelet/pods/ea4a6663-625c-4ece-bf8b-fe271340368a/volumes"
Jul 27 16:06:02.949336 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:02.949304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj" event={"ID":"4d152b16-7724-4b23-b748-5307ce6274fc","Type":"ContainerStarted","Data":"de800c721710d9593c29be18ea58989a3fa648657f9c9fb04be4b608479ecab5"}
Jul 27 16:06:11.993172 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:11.993131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj" event={"ID":"4d152b16-7724-4b23-b748-5307ce6274fc","Type":"ContainerStarted","Data":"57b707f715a5b6876d4e136e000fccc74399432017af0b47a9fea58ff9d49946"}
Jul 27 16:06:11.993654 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:11.993324    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:12.014201 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:12.014153    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj" podStartSLOduration=1.822095825 podStartE2EDuration="11.014138505s" totalImagesPullingTime="9.19204268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:06:12.012984069 +0000 UTC m=+1074.098939803" watchObservedRunningTime="2026-07-27 16:06:12.014138505 +0000 UTC m=+1074.100094236"
Jul 27 16:06:13.550846 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:13.550811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:13.620693 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:13.620660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:23.001009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:23.000947    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf786f7f9-zlcqj"
Jul 27 16:06:35.324249 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:35.324201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:44.370253 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:44.370215    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:44.556857 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:44.556806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:44.659229 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:44.659144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:51.056622 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:51.056584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:51.158301 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:51.158262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:51.416973 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:51.416931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:51.523344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:51.523301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:55.874519 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:55.874480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:57.330712 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:57.330673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:06:57.403215 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:06:57.403175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:07:18.604374 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:07:18.604339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:07:18.665005 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:07:18.664954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:11:47.095019 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:11:47.094985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:13:00.359497 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:13:00.359459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:13:00.420559 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:13:00.420521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:13:17.778383 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:13:17.778346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:14:46.334947 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:14:46.334909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:15:02.310339 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:15:02.310302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:15:34.193061 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:15:34.192979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:15:35.024871 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:15:35.024840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:18:42.400861 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:18:42.400814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:03.874265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:03.874228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:06.947613 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:06.947579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:07.051465 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:07.051435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:07.489555 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:07.489521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:13.750377 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:13.750336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:13.848653 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:13.848622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:14.001431 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:14.001353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:14.405933 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:14.405898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:15.044550 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:15.044521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:16.798575 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:16.798537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:16.889195 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:16.889162    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:16.973913 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:16.973881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:17.256953 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:17.256917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:17.512531 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:17.512444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:17.612405 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:17.612365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:42.359227 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.359141    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"]
Jul 27 16:19:42.362556 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.362535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:42.365379 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.365352    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:19:42.371064 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.370548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"]
Jul 27 16:19:42.415263 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.415229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw\" (UID: \"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:42.516751 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.516706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw\" (UID: \"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:42.517407 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.517380    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw\" (UID: \"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:42.675732 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.675641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:42.812032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.812006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"]
Jul 27 16:19:42.813770 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:19:42.813741    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9c98bf_3e6e_48f4_a48b_48d4b5a63629.slice/crio-8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351 WatchSource:0}: Error finding container 8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351: Status 404 returned error can't find the container with id 8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351
Jul 27 16:19:42.815514 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:42.815497    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 16:19:43.018187 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:43.018098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw" event={"ID":"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629","Type":"ContainerStarted","Data":"8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351"}
Jul 27 16:19:46.035014 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:46.034913    2573 generic.go:356] "Generic (PLEG): container finished" podID="ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" containerID="c16cf6da323a3189faa45d6ad72c2ddb2ce3289a2c9b26e29b0c625191ae7ad4" exitCode=0
Jul 27 16:19:46.035014 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:46.034948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw" event={"ID":"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629","Type":"ContainerDied","Data":"c16cf6da323a3189faa45d6ad72c2ddb2ce3289a2c9b26e29b0c625191ae7ad4"}
Jul 27 16:19:47.174615 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:47.174584    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:47.259016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:47.258987    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca\") pod \"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629\" (UID: \"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629\") "
Jul 27 16:19:47.259312 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:47.259291    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" (UID: "ac9c98bf-3e6e-48f4-a48b-48d4b5a63629"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:19:47.360351 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:47.360311    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629-maas-api-service-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:19:48.046538 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:48.046508    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"
Jul 27 16:19:48.046706 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:48.046544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw" event={"ID":"ac9c98bf-3e6e-48f4-a48b-48d4b5a63629","Type":"ContainerDied","Data":"8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351"}
Jul 27 16:19:48.046706 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:48.046620    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a757e6fcd8a7af16ee1c87684721e07d59304680e20770793c04a303a2da351"
Jul 27 16:19:53.031384 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:53.031347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:53.101277 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:53.101243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:57.428561 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:57.428526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:57.429180 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:57.429158    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"]
Jul 27 16:19:57.431531 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:57.431506    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ab13729-sz8qw"]
Jul 27 16:19:57.587045 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:57.587015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:57.841948 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:57.841916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:58.106026 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:58.105930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:58.197793 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:58.197758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:58.324285 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:58.324254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:58.412774 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:58.412693    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" path="/var/lib/kubelet/pods/ac9c98bf-3e6e-48f4-a48b-48d4b5a63629/volumes"
Jul 27 16:19:58.689275 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:58.689191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:19:59.080459 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:19:59.080419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:01.157499 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:01.157469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:01.285148 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:01.285113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:01.822140 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:01.822106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:01.988204 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:01.988171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:02.457993 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:02.457939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:36.667824 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:36.667793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:36.819371 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:36.819339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:36.907883 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:36.907849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:38.910312 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:38.910278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:41.254260 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:41.254224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:41.413609 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:41.413574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:41.665995 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:41.665943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:41.907625 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:41.907587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:42.259467 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:42.259434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:42.501318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:42.501282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:42.892202 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:42.892172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:42.993057 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:42.993023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:44.367671 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:44.367631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:44.472827 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:44.472790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:44.703398 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:44.703281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:45.146718 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:45.146686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:45.393032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:45.392998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:45.499876 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:45.499783    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:46.434537 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:46.434504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:20:46.530302 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:20:46.530264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:10.200486 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.200451    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"]
Jul 27 16:21:10.201136 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.201115    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" containerName="revoke-keys"
Jul 27 16:21:10.201227 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.201139    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" containerName="revoke-keys"
Jul 27 16:21:10.201280 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.201239    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac9c98bf-3e6e-48f4-a48b-48d4b5a63629" containerName="revoke-keys"
Jul 27 16:21:10.204384 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.204361    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:10.207114 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.207094    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:21:10.212244 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.212101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"]
Jul 27 16:21:10.312334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.312246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6\" (UID: \"76bb8da9-c8e5-470e-8291-960fd0382365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:10.413786 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.413746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6\" (UID: \"76bb8da9-c8e5-470e-8291-960fd0382365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:10.414882 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.414856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6\" (UID: \"76bb8da9-c8e5-470e-8291-960fd0382365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:10.516534 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.516456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:10.652049 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:10.652021    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"]
Jul 27 16:21:10.653892 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:21:10.653864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bb8da9_c8e5_470e_8291_960fd0382365.slice/crio-1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3 WatchSource:0}: Error finding container 1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3: Status 404 returned error can't find the container with id 1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3
Jul 27 16:21:11.450619 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:11.450588    2573 generic.go:356] "Generic (PLEG): container finished" podID="76bb8da9-c8e5-470e-8291-960fd0382365" containerID="9ddf9ae38b969267bf10003bb3f7a6be94f29ab7163d9e67dc0e8e8887375ff4" exitCode=0
Jul 27 16:21:11.450986 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:11.450674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6" event={"ID":"76bb8da9-c8e5-470e-8291-960fd0382365","Type":"ContainerDied","Data":"9ddf9ae38b969267bf10003bb3f7a6be94f29ab7163d9e67dc0e8e8887375ff4"}
Jul 27 16:21:11.450986 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:11.450729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6" event={"ID":"76bb8da9-c8e5-470e-8291-960fd0382365","Type":"ContainerStarted","Data":"1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3"}
Jul 27 16:21:12.595435 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:12.595411    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:12.629864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:12.629838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca\") pod \"76bb8da9-c8e5-470e-8291-960fd0382365\" (UID: \"76bb8da9-c8e5-470e-8291-960fd0382365\") "
Jul 27 16:21:12.630199 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:12.630176    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76bb8da9-c8e5-470e-8291-960fd0382365" (UID: "76bb8da9-c8e5-470e-8291-960fd0382365"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:12.730912 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:12.730833    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76bb8da9-c8e5-470e-8291-960fd0382365-maas-api-service-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:21:13.460709 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:13.460676    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"
Jul 27 16:21:13.460709 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:13.460691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6" event={"ID":"76bb8da9-c8e5-470e-8291-960fd0382365","Type":"ContainerDied","Data":"1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3"}
Jul 27 16:21:13.460938 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:13.460759    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1465aecce632f7dc0c2f9db9eccab23a946e69209a23ed80efb97a85c81e83e3"
Jul 27 16:21:13.496143 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:21:13.496100    2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bb8da9_c8e5_470e_8291_960fd0382365.slice\": RecentStats: unable to find data in memory cache]"
Jul 27 16:21:20.781746 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:20.781707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:20.886649 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:20.886610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:20.984596 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:20.984561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:25.417817 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:25.417778    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"]
Jul 27 16:21:25.420975 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:25.420934    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-09433aa9-wrzt6"]
Jul 27 16:21:25.422455 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:25.422430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:26.411229 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:26.411193    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76bb8da9-c8e5-470e-8291-960fd0382365" path="/var/lib/kubelet/pods/76bb8da9-c8e5-470e-8291-960fd0382365/volumes"
Jul 27 16:21:26.783538 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:26.783456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:26.998849 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:26.998815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:27.280690 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:27.280652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:27.685945 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:27.685913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:27.913416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:27.913384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:29.600550 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:29.600514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:29.745570 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:29.745537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:29.846070 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:29.846038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:29.947632 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:29.947560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:30.472738 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:30.472709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:30.597891 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:30.597861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:50.796331 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:50.796290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:50.882038 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:50.882000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:53.322079 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:53.322048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:55.494091 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:55.494054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:55.594505 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:55.594476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:21:57.012606 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:21:57.012571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:04.670414 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:04.670375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:04.779987 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:04.779931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:04.877194 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:04.877147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:04.969420 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:04.969321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:05.447754 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:05.447714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:24.827010 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:24.826973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:31.456785 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:31.456751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:38.839639 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:38.839595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:40.788103 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:40.788022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:40.850099 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:40.850067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:22:54.966546 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:22:54.966513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:01.188816 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:01.188776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:01.286675 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:01.286639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:01.385796 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:01.385757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:11.931985 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:11.931926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:12.758835 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:12.758800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:19.608564 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:19.608530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:19.741085 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:19.741054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:21.632089 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:21.632057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:21.702974 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:21.702931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:22.525366 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:22.525334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:29.381737 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:29.381700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:29.455669 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:29.455636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:30.039022 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:30.038985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:36.578490 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:36.578439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:36.923076 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:36.922975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:36.996797 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:36.996763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:37.157345 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:37.157317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:37.443897 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:37.443859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:39.873386 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:39.873351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:39.968327 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:39.968294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:40.151501 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:40.151414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:40.283841 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:40.283806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:40.774072 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:40.774040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:40.856804 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:40.856767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:44.391478 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:44.391442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:45.027079 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:45.027050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:45.125623 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:45.125594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:45.472087 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:45.472056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:51.916747 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.916705    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"]
Jul 27 16:23:51.917167 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.917153    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb8da9-c8e5-470e-8291-960fd0382365" containerName="revoke-keys"
Jul 27 16:23:51.917211 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.917168    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb8da9-c8e5-470e-8291-960fd0382365" containerName="revoke-keys"
Jul 27 16:23:51.917246 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.917228    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb8da9-c8e5-470e-8291-960fd0382365" containerName="revoke-keys"
Jul 27 16:23:51.920291 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.920274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:51.923552 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.923532    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:23:51.929477 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:51.929452    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"]
Jul 27 16:23:52.013970 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:52.013936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43178a25-kqmd7\" (UID: \"4651d6d1-6c0c-4d67-8c73-16986aff6f2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:52.115485 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:52.115461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43178a25-kqmd7\" (UID: \"4651d6d1-6c0c-4d67-8c73-16986aff6f2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:52.116134 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:52.116109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43178a25-kqmd7\" (UID: \"4651d6d1-6c0c-4d67-8c73-16986aff6f2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:52.232104 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:52.232036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:52.368506 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:52.368483    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"]
Jul 27 16:23:52.370360 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:23:52.370334    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4651d6d1_6c0c_4d67_8c73_16986aff6f2f.slice/crio-e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69 WatchSource:0}: Error finding container e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69: Status 404 returned error can't find the container with id e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69
Jul 27 16:23:53.283665 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:53.283631    2573 generic.go:356] "Generic (PLEG): container finished" podID="4651d6d1-6c0c-4d67-8c73-16986aff6f2f" containerID="917b0cd88bf8076f2ff01d078e0a589d90060343216115146299859ecd2fb315" exitCode=0
Jul 27 16:23:53.284061 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:53.283723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7" event={"ID":"4651d6d1-6c0c-4d67-8c73-16986aff6f2f","Type":"ContainerDied","Data":"917b0cd88bf8076f2ff01d078e0a589d90060343216115146299859ecd2fb315"}
Jul 27 16:23:53.284061 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:53.283817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7" event={"ID":"4651d6d1-6c0c-4d67-8c73-16986aff6f2f","Type":"ContainerStarted","Data":"e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69"}
Jul 27 16:23:53.429889 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:53.429860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:23:54.420485 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:54.420459    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:54.435902 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:54.435877    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca\") pod \"4651d6d1-6c0c-4d67-8c73-16986aff6f2f\" (UID: \"4651d6d1-6c0c-4d67-8c73-16986aff6f2f\") "
Jul 27 16:23:54.436196 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:54.436176    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4651d6d1-6c0c-4d67-8c73-16986aff6f2f" (UID: "4651d6d1-6c0c-4d67-8c73-16986aff6f2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:23:54.537224 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:54.537194    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4651d6d1-6c0c-4d67-8c73-16986aff6f2f-maas-api-service-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:23:55.296109 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:55.296075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7" event={"ID":"4651d6d1-6c0c-4d67-8c73-16986aff6f2f","Type":"ContainerDied","Data":"e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69"}
Jul 27 16:23:55.296109 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:55.296107    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"
Jul 27 16:23:55.296316 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:55.296125    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9e3f9a20dcc6f4f9f5e6cc02b803922532cf592f2e982398c1c09c478a62f69"
Jul 27 16:23:56.069189 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:23:56.069143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:02.547069 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:02.547027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:02.613204 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:02.613171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:06.984866 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:06.984825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:06.985259 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:06.985075    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"]
Jul 27 16:24:06.988578 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:06.988553    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43178a25-kqmd7"]
Jul 27 16:24:07.388905 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:07.388871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:08.412084 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:08.412050    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4651d6d1-6c0c-4d67-8c73-16986aff6f2f" path="/var/lib/kubelet/pods/4651d6d1-6c0c-4d67-8c73-16986aff6f2f/volumes"
Jul 27 16:24:13.498067 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:13.497992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:14.044663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:14.044604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:14.150693 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:14.150661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:14.246514 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:14.246479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:14.384973 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:14.384936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:20.259171 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:20.259133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:20.368687 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:20.368656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:20.462236 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:20.462203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:20.622348 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:20.622293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:26.751345 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:26.751306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:26.853794 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:26.853759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:33.638110 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:33.638076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:33.948286 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:33.948205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:34.127218 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:34.127188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:37.272494 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:37.272457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:37.365215 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:37.365178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:37.434201 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:37.434169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:37.986233 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:37.986199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:38.092457 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:38.092428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:38.191297 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:38.191271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:41.770571 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:41.770537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:24:59.007342 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:24:59.007311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:13.319426 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:13.319390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:21.605377 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.605331    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"]
Jul 27 16:25:21.605856 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.605731    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4651d6d1-6c0c-4d67-8c73-16986aff6f2f" containerName="revoke-keys"
Jul 27 16:25:21.605856 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.605743    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4651d6d1-6c0c-4d67-8c73-16986aff6f2f" containerName="revoke-keys"
Jul 27 16:25:21.605856 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.605821    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4651d6d1-6c0c-4d67-8c73-16986aff6f2f" containerName="revoke-keys"
Jul 27 16:25:21.608875 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.608854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:21.611992 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.611973    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:25:21.618418 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.618382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg\" (UID: \"d31164bb-1d7d-4142-bf45-ceae13b08f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:21.619078 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.619056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"]
Jul 27 16:25:21.719077 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.719045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg\" (UID: \"d31164bb-1d7d-4142-bf45-ceae13b08f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:21.719867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.719833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg\" (UID: \"d31164bb-1d7d-4142-bf45-ceae13b08f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:21.920627 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:21.920538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:22.057772 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:22.057726    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"]
Jul 27 16:25:22.061127 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:25:22.061020    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31164bb_1d7d_4142_bf45_ceae13b08f01.slice/crio-bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad WatchSource:0}: Error finding container bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad: Status 404 returned error can't find the container with id bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad
Jul 27 16:25:22.734566 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:22.734530    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg" event={"ID":"d31164bb-1d7d-4142-bf45-ceae13b08f01","Type":"ContainerStarted","Data":"823ce0063ec7999a888980628d05aac4e0f75c35a0ab94b969806137630e1927"}
Jul 27 16:25:22.734987 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:22.734611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg" event={"ID":"d31164bb-1d7d-4142-bf45-ceae13b08f01","Type":"ContainerStarted","Data":"bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad"}
Jul 27 16:25:22.752096 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:22.752052    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg" podStartSLOduration=1.752039277 podStartE2EDuration="1.752039277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:22.751200911 +0000 UTC m=+2224.837156643" watchObservedRunningTime="2026-07-27 16:25:22.752039277 +0000 UTC m=+2224.837995008"
Jul 27 16:25:23.741144 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:23.741104    2573 generic.go:356] "Generic (PLEG): container finished" podID="d31164bb-1d7d-4142-bf45-ceae13b08f01" containerID="823ce0063ec7999a888980628d05aac4e0f75c35a0ab94b969806137630e1927" exitCode=0
Jul 27 16:25:23.741508 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:23.741165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg" event={"ID":"d31164bb-1d7d-4142-bf45-ceae13b08f01","Type":"ContainerDied","Data":"823ce0063ec7999a888980628d05aac4e0f75c35a0ab94b969806137630e1927"}
Jul 27 16:25:24.878293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:24.878269    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:24.948113 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:24.948088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca\") pod \"d31164bb-1d7d-4142-bf45-ceae13b08f01\" (UID: \"d31164bb-1d7d-4142-bf45-ceae13b08f01\") "
Jul 27 16:25:24.948425 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:24.948402    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d31164bb-1d7d-4142-bf45-ceae13b08f01" (UID: "d31164bb-1d7d-4142-bf45-ceae13b08f01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:25:25.049064 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:25.048996    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d31164bb-1d7d-4142-bf45-ceae13b08f01-maas-api-service-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:25:25.753654 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:25.753623    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"
Jul 27 16:25:25.753816 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:25.753623    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg" event={"ID":"d31164bb-1d7d-4142-bf45-ceae13b08f01","Type":"ContainerDied","Data":"bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad"}
Jul 27 16:25:25.753816 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:25.753756    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb4c60ba9646e99245a3c925216990c820112c98cc9e949cffc2b8ea1c36d6ad"
Jul 27 16:25:37.099247 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:37.099213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:37.181772 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:37.181735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:37.260725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:37.260693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:41.684495 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:41.684406    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"]
Jul 27 16:25:41.686887 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:41.686849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:41.687272 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:41.687252    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1cdb3d5-x6pvg"]
Jul 27 16:25:42.411762 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:42.411731    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31164bb-1d7d-4142-bf45-ceae13b08f01" path="/var/lib/kubelet/pods/d31164bb-1d7d-4142-bf45-ceae13b08f01/volumes"
Jul 27 16:25:45.157203 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:45.157163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:25:50.241659 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:25:50.241621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:18.570966 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:18.570934    2573 scope.go:117] "RemoveContainer" containerID="c16cf6da323a3189faa45d6ad72c2ddb2ce3289a2c9b26e29b0c625191ae7ad4"
Jul 27 16:26:18.637704 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:18.637678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:26.949934 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:26.949899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:27.928348 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:27.928310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:34.294939 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:34.294904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:34.396470 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:34.396435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:34.583214 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:34.583181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:34.871295 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:34.871206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:35.938150 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:35.938117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:36.032120 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:36.032089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:36.133016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:36.132981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:39.903919 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:39.903877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:40.010975 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:40.010920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:40.108143 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:40.108099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:44.997261 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:44.997224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:45.098377 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:45.098340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:45.708613 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:45.708582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:52.180394 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:52.180323    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:55.060643 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:55.060611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:26:55.162643 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:26:55.162609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:02.941102 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:02.941072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:03.313386 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:03.313297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:18.591290 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:18.591204    2573 scope.go:117] "RemoveContainer" containerID="9ddf9ae38b969267bf10003bb3f7a6be94f29ab7163d9e67dc0e8e8887375ff4"
Jul 27 16:27:24.259864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:24.259829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:31.058082 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:31.058045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:31.153221 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:31.153183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:31.418215 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:31.418185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:31.745578 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:31.745485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:31.942810 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:31.942772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:32.043052 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:32.042943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:35.183793 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:35.183752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:35.285454 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:35.285420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:35.416132 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:35.416099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:35.728634 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:35.728599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:35.887980 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:35.887924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:36.004016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:36.003898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:39.693952 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:39.693913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:40.028857 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:40.028755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:40.423176 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:40.423143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:40.796183 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:40.796102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:43.231600 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:43.231569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:43.335843 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:43.335813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:43.434437 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:43.434403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:43.648655 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:43.648626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:44.018941 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.018859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:44.093900 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.093867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:44.126869 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.126838    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:27:44.127265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.127251    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31164bb-1d7d-4142-bf45-ceae13b08f01" containerName="revoke-keys"
Jul 27 16:27:44.127326 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.127267    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31164bb-1d7d-4142-bf45-ceae13b08f01" containerName="revoke-keys"
Jul 27 16:27:44.127368 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.127359    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31164bb-1d7d-4142-bf45-ceae13b08f01" containerName="revoke-keys"
Jul 27 16:27:44.130361 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.130346    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.132941 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.132918    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-f385e1-dockercfg-tksv4\""
Jul 27 16:27:44.133055 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.132923    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-f385e1\""
Jul 27 16:27:44.140050 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.140030    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:27:44.216980 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.216928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz58d\" (UniqueName: \"kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.217139 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.216987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.318354 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.318272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz58d\" (UniqueName: \"kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.318354 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.318310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.319037 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.319015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.327344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.327324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz58d\" (UniqueName: \"kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d\") pod \"payload-processing-e2e-inf-b-f385e1-859755876-xqjvq\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.442173 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.442132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:44.786451 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:44.786223    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:27:44.789503 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:27:44.789472    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5072b7_7d08_4cd7_badb_d2d5429386ff.slice/crio-b301e852f1868fbaf6939d2bc7f8e275991fa437a5ecb6cfce5e7fbe409ec4ec WatchSource:0}: Error finding container b301e852f1868fbaf6939d2bc7f8e275991fa437a5ecb6cfce5e7fbe409ec4ec: Status 404 returned error can't find the container with id b301e852f1868fbaf6939d2bc7f8e275991fa437a5ecb6cfce5e7fbe409ec4ec
Jul 27 16:27:45.468363 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:45.468323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" event={"ID":"aa5072b7-7d08-4cd7-badb-d2d5429386ff","Type":"ContainerStarted","Data":"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"}
Jul 27 16:27:45.468780 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:45.468388    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" event={"ID":"aa5072b7-7d08-4cd7-badb-d2d5429386ff","Type":"ContainerStarted","Data":"b301e852f1868fbaf6939d2bc7f8e275991fa437a5ecb6cfce5e7fbe409ec4ec"}
Jul 27 16:27:45.468780 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:45.468568    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:45.487339 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:45.487296    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" podStartSLOduration=1.487281621 podStartE2EDuration="1.487281621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:45.486354291 +0000 UTC m=+2367.572310024" watchObservedRunningTime="2026-07-27 16:27:45.487281621 +0000 UTC m=+2367.573237352"
Jul 27 16:27:47.736609 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:47.736547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:27:56.475405 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:56.475368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:27:59.527416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:27:59.527381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:28:04.911877 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:28:04.911842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:28:04.984853 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:28:04.984805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:28:44.874704 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:28:44.874612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:28:50.473411 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:28:50.473376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:28:50.546675 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:28:50.546644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:28.202246 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:28.202202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:29.204130 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.204090    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"]
Jul 27 16:29:29.207729 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.207706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:29.210330 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.210310    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:29:29.215749 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.215727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"]
Jul 27 16:29:29.259576 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.259551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7\" (UID: \"958a4bc9-e99b-46ed-9df3-7e45825dcd66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:29.360612 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.360574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7\" (UID: \"958a4bc9-e99b-46ed-9df3-7e45825dcd66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:29.361327 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.361289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7\" (UID: \"958a4bc9-e99b-46ed-9df3-7e45825dcd66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:29.521039 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.520942    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:29.654346 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.654321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"]
Jul 27 16:29:29.656554 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:29:29.656519    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958a4bc9_e99b_46ed_9df3_7e45825dcd66.slice/crio-c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478 WatchSource:0}: Error finding container c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478: Status 404 returned error can't find the container with id c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478
Jul 27 16:29:29.989265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.989233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7" event={"ID":"958a4bc9-e99b-46ed-9df3-7e45825dcd66","Type":"ContainerStarted","Data":"9052ff81e6e1410d38c9b7a16211f329c37dc6d3eaae7914bd5544aeb1d03ca5"}
Jul 27 16:29:29.989391 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:29.989287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7" event={"ID":"958a4bc9-e99b-46ed-9df3-7e45825dcd66","Type":"ContainerStarted","Data":"c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478"}
Jul 27 16:29:30.007845 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:30.007804    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7" podStartSLOduration=1.007788398 podStartE2EDuration="1.007788398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:30.006041561 +0000 UTC m=+2472.091997319" watchObservedRunningTime="2026-07-27 16:29:30.007788398 +0000 UTC m=+2472.093744130"
Jul 27 16:29:30.995553 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:30.995517    2573 generic.go:356] "Generic (PLEG): container finished" podID="958a4bc9-e99b-46ed-9df3-7e45825dcd66" containerID="9052ff81e6e1410d38c9b7a16211f329c37dc6d3eaae7914bd5544aeb1d03ca5" exitCode=0
Jul 27 16:29:30.995939 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:30.995616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7" event={"ID":"958a4bc9-e99b-46ed-9df3-7e45825dcd66","Type":"ContainerDied","Data":"9052ff81e6e1410d38c9b7a16211f329c37dc6d3eaae7914bd5544aeb1d03ca5"}
Jul 27 16:29:31.394910 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:31.394875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:32.136858 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:32.136831    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:32.186898 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:32.186869    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca\") pod \"958a4bc9-e99b-46ed-9df3-7e45825dcd66\" (UID: \"958a4bc9-e99b-46ed-9df3-7e45825dcd66\") "
Jul 27 16:29:32.187191 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:32.187168    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "958a4bc9-e99b-46ed-9df3-7e45825dcd66" (UID: "958a4bc9-e99b-46ed-9df3-7e45825dcd66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:29:32.288024 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:32.287929    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/958a4bc9-e99b-46ed-9df3-7e45825dcd66-maas-api-service-ca\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:29:33.006071 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:33.006045    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"
Jul 27 16:29:33.006238 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:33.006041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7" event={"ID":"958a4bc9-e99b-46ed-9df3-7e45825dcd66","Type":"ContainerDied","Data":"c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478"}
Jul 27 16:29:33.006238 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:33.006171    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c15486dc7db21f51c97dc8476b4f6ab767d416c99371cded8b298774ca77c478"
Jul 27 16:29:39.636712 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:39.636679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:39.735176 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:39.735128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:39.836897 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:39.836866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:44.303339 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:44.303308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:44.315504 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:44.315474    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"]
Jul 27 16:29:44.325326 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:44.325299    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cec93-95rd7"]
Jul 27 16:29:44.412420 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:44.412389    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="958a4bc9-e99b-46ed-9df3-7e45825dcd66" path="/var/lib/kubelet/pods/958a4bc9-e99b-46ed-9df3-7e45825dcd66/volumes"
Jul 27 16:29:44.723811 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:44.723780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:51.041809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:51.041771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:51.141525 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:51.141490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:51.322447 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:51.322359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:29:51.564773 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:29:51.564733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:02.178105 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.178066    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:30:02.178625 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.178321    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" podUID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" containerName="payload-processing" containerID="cri-o://a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690" gracePeriod=30
Jul 27 16:30:02.432281 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.432229    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:30:02.456497 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.456470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:02.457346 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.457325    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz58d\" (UniqueName: \"kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d\") pod \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") "
Jul 27 16:30:02.457447 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.457437    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume\") pod \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\" (UID: \"aa5072b7-7d08-4cd7-badb-d2d5429386ff\") "
Jul 27 16:30:02.457805 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.457780    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa5072b7-7d08-4cd7-badb-d2d5429386ff" (UID: "aa5072b7-7d08-4cd7-badb-d2d5429386ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:30:02.459575 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.459554    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d" (OuterVolumeSpecName: "kube-api-access-qz58d") pod "aa5072b7-7d08-4cd7-badb-d2d5429386ff" (UID: "aa5072b7-7d08-4cd7-badb-d2d5429386ff"). InnerVolumeSpecName "kube-api-access-qz58d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:02.531245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.531214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:02.558468 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.558442    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5072b7-7d08-4cd7-badb-d2d5429386ff-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:30:02.558468 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:02.558467    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz58d\" (UniqueName: \"kubernetes.io/projected/aa5072b7-7d08-4cd7-badb-d2d5429386ff-kube-api-access-qz58d\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:30:03.157691 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.157651    2573 generic.go:356] "Generic (PLEG): container finished" podID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" containerID="a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690" exitCode=0
Jul 27 16:30:03.157865 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.157697    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"
Jul 27 16:30:03.157865 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.157743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" event={"ID":"aa5072b7-7d08-4cd7-badb-d2d5429386ff","Type":"ContainerDied","Data":"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"}
Jul 27 16:30:03.157865 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.157786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq" event={"ID":"aa5072b7-7d08-4cd7-badb-d2d5429386ff","Type":"ContainerDied","Data":"b301e852f1868fbaf6939d2bc7f8e275991fa437a5ecb6cfce5e7fbe409ec4ec"}
Jul 27 16:30:03.157865 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.157807    2573 scope.go:117] "RemoveContainer" containerID="a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"
Jul 27 16:30:03.167373 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.167350    2573 scope.go:117] "RemoveContainer" containerID="a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"
Jul 27 16:30:03.167617 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:30:03.167597    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690\": container with ID starting with a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690 not found: ID does not exist" containerID="a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"
Jul 27 16:30:03.167684 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.167627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690"} err="failed to get container status \"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690\": rpc error: code = NotFound desc = could not find container \"a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690\": container with ID starting with a0b8aa817ef0503230e889a20c8e1a6ca6b17a1dafbcfbe244424b6c35b4e690 not found: ID does not exist"
Jul 27 16:30:03.181297 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.181272    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:30:03.185813 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:03.185789    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f385e1-859755876-xqjvq"]
Jul 27 16:30:04.411315 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:04.411283    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" path="/var/lib/kubelet/pods/aa5072b7-7d08-4cd7-badb-d2d5429386ff/volumes"
Jul 27 16:30:06.762867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:06.762832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:07.149613 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:07.149581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:13.876848 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:13.876764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:13.982363 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:13.982332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:14.163862 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:14.163785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:14.479863 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:14.479779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:14.787636 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:14.787550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:15.160374 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:15.160339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:15.666213 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:15.666184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.184233 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.184196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.268124 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.268083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.344253 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.344214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.625293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.625258    2573 scope.go:117] "RemoveContainer" containerID="917b0cd88bf8076f2ff01d078e0a589d90060343216115146299859ecd2fb315"
Jul 27 16:30:18.649266 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.649227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.862711 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.862681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:18.957544 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:18.957454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:22.670545 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:22.670491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:23.161809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:23.161777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:23.500594 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:23.500512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:24.201843 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:24.201808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:26.198510 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:26.198476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:26.311483 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:26.311453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:26.396981 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:26.396926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:26.625474 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:26.625438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:27.113386 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.113348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:27.212834 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.212802    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:30:27.213228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213214    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958a4bc9-e99b-46ed-9df3-7e45825dcd66" containerName="revoke-keys"
Jul 27 16:30:27.213228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213229    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="958a4bc9-e99b-46ed-9df3-7e45825dcd66" containerName="revoke-keys"
Jul 27 16:30:27.213318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213239    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" containerName="payload-processing"
Jul 27 16:30:27.213318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213245    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" containerName="payload-processing"
Jul 27 16:30:27.213318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213306    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5072b7-7d08-4cd7-badb-d2d5429386ff" containerName="payload-processing"
Jul 27 16:30:27.213318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.213315    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="958a4bc9-e99b-46ed-9df3-7e45825dcd66" containerName="revoke-keys"
Jul 27 16:30:27.216338 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.216322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.219491 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.219471    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-478f20\""
Jul 27 16:30:27.219627 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.219531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-478f20-dockercfg-k96z7\""
Jul 27 16:30:27.225778 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.225753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:30:27.281454 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.281416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.281624 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.281472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqcl\" (UniqueName: \"kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.383081 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.383001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.383081 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.383046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqcl\" (UniqueName: \"kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.383769 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.383746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.392244 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.392219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqcl\" (UniqueName: \"kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl\") pod \"payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.527603 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.527563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:27.704270 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:27.704246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:30:27.706299 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:30:27.706264    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc255e0f3_fa4d_4d5b_b0d6_99a1ffa1e9f5.slice/crio-c1a69ff691850507233b99ae228d7bb07b4bf629850362121b5cca55066ee2b4 WatchSource:0}: Error finding container c1a69ff691850507233b99ae228d7bb07b4bf629850362121b5cca55066ee2b4: Status 404 returned error can't find the container with id c1a69ff691850507233b99ae228d7bb07b4bf629850362121b5cca55066ee2b4
Jul 27 16:30:28.243605 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:28.243571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:28.297271 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:28.297234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" event={"ID":"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5","Type":"ContainerStarted","Data":"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"}
Jul 27 16:30:28.297447 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:28.297302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:28.297447 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:28.297324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" event={"ID":"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5","Type":"ContainerStarted","Data":"c1a69ff691850507233b99ae228d7bb07b4bf629850362121b5cca55066ee2b4"}
Jul 27 16:30:28.318175 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:28.318126    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" podStartSLOduration=1.318111219 podStartE2EDuration="1.318111219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:28.316116356 +0000 UTC m=+2530.402072090" watchObservedRunningTime="2026-07-27 16:30:28.318111219 +0000 UTC m=+2530.404066951"
Jul 27 16:30:30.689532 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:30.689481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:39.304136 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:39.304103    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:30:54.556663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:54.556624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:54.657861 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:54.657826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:58.911065 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:58.911030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:30:59.296785 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:30:59.296691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:05.509725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:05.509686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:05.610063 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:05.610029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:05.787397 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:05.787320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:06.041416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:06.041336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:21.798620 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:21.798577    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:31:21.799228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:21.798902    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" podUID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" containerName="payload-pre-processing" containerID="cri-o://aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219" gracePeriod=30
Jul 27 16:31:21.947875 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:21.947833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:22.024939 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.024907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:22.059867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.059784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:31:22.159703 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.159666    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnqcl\" (UniqueName: \"kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl\") pod \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") "
Jul 27 16:31:22.159905 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.159744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume\") pod \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\" (UID: \"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5\") "
Jul 27 16:31:22.160143 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.160118    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" (UID: "c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:31:22.161944 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.161916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl" (OuterVolumeSpecName: "kube-api-access-tnqcl") pod "c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" (UID: "c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5"). InnerVolumeSpecName "kube-api-access-tnqcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:22.260799 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.260764    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:31:22.260799 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.260792    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnqcl\" (UniqueName: \"kubernetes.io/projected/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5-kube-api-access-tnqcl\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:31:22.568325 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.568293    2573 generic.go:356] "Generic (PLEG): container finished" podID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" containerID="aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219" exitCode=0
Jul 27 16:31:22.568518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.568335    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"
Jul 27 16:31:22.568518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.568381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" event={"ID":"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5","Type":"ContainerDied","Data":"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"}
Jul 27 16:31:22.568518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.568442    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t" event={"ID":"c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5","Type":"ContainerDied","Data":"c1a69ff691850507233b99ae228d7bb07b4bf629850362121b5cca55066ee2b4"}
Jul 27 16:31:22.568518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.568472    2573 scope.go:117] "RemoveContainer" containerID="aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"
Jul 27 16:31:22.577408 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.577386    2573 scope.go:117] "RemoveContainer" containerID="aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"
Jul 27 16:31:22.577665 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:31:22.577646    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219\": container with ID starting with aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219 not found: ID does not exist" containerID="aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"
Jul 27 16:31:22.577728 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.577671    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219"} err="failed to get container status \"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219\": rpc error: code = NotFound desc = could not find container \"aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219\": container with ID starting with aee4731aae9cf7c56f04f92a863a904dbf3ac2e024118b12d5733c6457fc2219 not found: ID does not exist"
Jul 27 16:31:22.586854 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.586830    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:31:22.591168 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:22.591141    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-478f20-cb6ccc7cb-l478t"]
Jul 27 16:31:24.410979 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:24.410931    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" path="/var/lib/kubelet/pods/c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5/volumes"
Jul 27 16:31:26.233976 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:26.233931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:26.853369 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:26.853327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:32.984451 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:32.984399    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:33.051832 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:33.051798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:33.392949 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:33.392915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:33.522437 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:33.522404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:33.857611 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:33.857576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:34.206581 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:34.206497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:34.437243 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:34.437194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:34.537282 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:34.537188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:37.668047 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:37.668010    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:37.757255 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:37.757220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:37.877233 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:37.877199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:38.215947 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:38.215912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:38.312659 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:38.312628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:41.049664 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:41.049580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:42.173319 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:42.173279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:42.603818 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:42.603784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:42.823248 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:42.823219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:42.966879 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:42.966793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:45.901251 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:45.901218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:46.001541 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.001503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:46.280918 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.280840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:46.370235 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.370203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:46.431725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.431694    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:31:46.432104 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.432091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" containerName="payload-pre-processing"
Jul 27 16:31:46.432157 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.432106    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" containerName="payload-pre-processing"
Jul 27 16:31:46.432193 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.432183    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c255e0f3-fa4d-4d5b-b0d6-99a1ffa1e9f5" containerName="payload-pre-processing"
Jul 27 16:31:46.435156 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.435135    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.437810 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.437785    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1f21d6\""
Jul 27 16:31:46.437919 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.437785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1f21d6-dockercfg-mqmsv\""
Jul 27 16:31:46.456793 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.456760    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:31:46.480412 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.480376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.480566 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.480424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctq95\" (UniqueName: \"kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.581319 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.581290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.581319 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.581326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctq95\" (UniqueName: \"kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.582027 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.582004    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.590003 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.589980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctq95\" (UniqueName: \"kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95\") pod \"payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.745889 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.745848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:46.886126 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:46.886100    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:31:46.888680 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:31:46.888651    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd99841_d2e9_4236_a29a_c780f16dca9d.slice/crio-d9b02fb50f664e741ec365211ff6acd468e78bde2e3182df343938e4e07d2a69 WatchSource:0}: Error finding container d9b02fb50f664e741ec365211ff6acd468e78bde2e3182df343938e4e07d2a69: Status 404 returned error can't find the container with id d9b02fb50f664e741ec365211ff6acd468e78bde2e3182df343938e4e07d2a69
Jul 27 16:31:47.695104 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:47.695064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" event={"ID":"2bd99841-d2e9-4236-a29a-c780f16dca9d","Type":"ContainerStarted","Data":"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"}
Jul 27 16:31:47.695526 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:47.695145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" event={"ID":"2bd99841-d2e9-4236-a29a-c780f16dca9d","Type":"ContainerStarted","Data":"d9b02fb50f664e741ec365211ff6acd468e78bde2e3182df343938e4e07d2a69"}
Jul 27 16:31:47.695526 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:47.695212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:31:47.713655 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:47.713607    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" podStartSLOduration=1.7135905729999998 podStartE2EDuration="1.713590573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:47.711173754 +0000 UTC m=+2609.797129499" watchObservedRunningTime="2026-07-27 16:31:47.713590573 +0000 UTC m=+2609.799546304"
Jul 27 16:31:50.177851 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:50.177815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:58.051791 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:58.051757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:31:58.702530 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:31:58.702500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:32:18.346796 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:32:18.346758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:32:18.656640 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:32:18.656550    2573 scope.go:117] "RemoveContainer" containerID="823ce0063ec7999a888980628d05aac4e0f75c35a0ab94b969806137630e1927"
Jul 27 16:32:33.320103 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:32:33.320063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:32:43.793770 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:32:43.793738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:33:18.753664 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:33:18.753587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:33:19.837551 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:33:19.837521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:36:18.702284 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:36:18.702200    2573 scope.go:117] "RemoveContainer" containerID="9052ff81e6e1410d38c9b7a16211f329c37dc6d3eaae7914bd5544aeb1d03ca5"
Jul 27 16:36:59.486932 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:36:59.486891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:37:01.198611 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:37:01.198579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:37:05.917598 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:37:05.917563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:37:06.825489 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:37:06.825454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:37:15.936464 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:37:15.936432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:37:30.832046 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:37:30.832012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:38:35.594054 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:38:35.594018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:38:36.497696 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:38:36.497669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:38:42.627553 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:38:42.627509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:39:23.419217 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:39:23.419184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:39:36.722505 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:39:36.722469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:39:36.821450 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:39:36.821414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:01.021009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:01.020940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:35.716591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:35.716557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:36.609516 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:36.609483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:37.835670 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:37.835634    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912609943216"]
Jul 27 16:40:37.839271 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:37.839246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:37.842005 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:37.841982    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4rm9g\""
Jul 27 16:40:37.845282 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:37.845257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912609943216"]
Jul 27 16:40:37.905617 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:37.905594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlsj\" (UniqueName: \"kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj\") pod \"test-curl-7262-139912609943216\" (UID: \"8b8a54c2-3a5c-4811-8350-69a2209973a4\") " pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:38.006529 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.006490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlsj\" (UniqueName: \"kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj\") pod \"test-curl-7262-139912609943216\" (UID: \"8b8a54c2-3a5c-4811-8350-69a2209973a4\") " pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:38.016148 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.016119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlsj\" (UniqueName: \"kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj\") pod \"test-curl-7262-139912609943216\" (UID: \"8b8a54c2-3a5c-4811-8350-69a2209973a4\") " pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:38.150136 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.150059    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:38.281547 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.281521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912609943216"]
Jul 27 16:40:38.283738 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:38.283706    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b8a54c2_3a5c_4811_8350_69a2209973a4.slice/crio-54498158f359a585330fff9874793ff803347dbe5fccc915bdc2eb8c9d601858 WatchSource:0}: Error finding container 54498158f359a585330fff9874793ff803347dbe5fccc915bdc2eb8c9d601858: Status 404 returned error can't find the container with id 54498158f359a585330fff9874793ff803347dbe5fccc915bdc2eb8c9d601858
Jul 27 16:40:38.285165 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.285144    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 16:40:38.311148 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:38.311124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912609943216" event={"ID":"8b8a54c2-3a5c-4811-8350-69a2209973a4","Type":"ContainerStarted","Data":"54498158f359a585330fff9874793ff803347dbe5fccc915bdc2eb8c9d601858"}
Jul 27 16:40:39.317112 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:39.317028    2573 generic.go:356] "Generic (PLEG): container finished" podID="8b8a54c2-3a5c-4811-8350-69a2209973a4" containerID="92141eda1f34e3e740811a6d5f10d948e9c7048eea044384c8c1a4a9bbfc804c" exitCode=0
Jul 27 16:40:39.317112 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:39.317105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912609943216" event={"ID":"8b8a54c2-3a5c-4811-8350-69a2209973a4","Type":"ContainerDied","Data":"92141eda1f34e3e740811a6d5f10d948e9c7048eea044384c8c1a4a9bbfc804c"}
Jul 27 16:40:40.454724 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.454699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:40.494459 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.494436    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912609943216_8b8a54c2-3a5c-4811-8350-69a2209973a4/test-curl-7262-139912609943216/0.log"
Jul 27 16:40:40.532269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.532246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dlsj\" (UniqueName: \"kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj\") pod \"8b8a54c2-3a5c-4811-8350-69a2209973a4\" (UID: \"8b8a54c2-3a5c-4811-8350-69a2209973a4\") "
Jul 27 16:40:40.534221 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.534193    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj" (OuterVolumeSpecName: "kube-api-access-2dlsj") pod "8b8a54c2-3a5c-4811-8350-69a2209973a4" (UID: "8b8a54c2-3a5c-4811-8350-69a2209973a4"). InnerVolumeSpecName "kube-api-access-2dlsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:40.554899 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.554878    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912609943216"]
Jul 27 16:40:40.561000 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.560980    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912609943216"]
Jul 27 16:40:40.633372 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.633316    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dlsj\" (UniqueName: \"kubernetes.io/projected/8b8a54c2-3a5c-4811-8350-69a2209973a4-kube-api-access-2dlsj\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:40.899769 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.899693    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912609940144"]
Jul 27 16:40:40.900112 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.900099    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" containerName="test-curl-7262-139912609943216"
Jul 27 16:40:40.900164 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.900114    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" containerName="test-curl-7262-139912609943216"
Jul 27 16:40:40.900200 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.900189    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" containerName="test-curl-7262-139912609943216"
Jul 27 16:40:40.903180 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.903165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:40.915996 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:40.912792    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912609940144"]
Jul 27 16:40:41.036496 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.036455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9w7\" (UniqueName: \"kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7\") pod \"test-curl-7262-139912609940144\" (UID: \"b375ba73-8a1d-457a-9559-a29afdccaf8c\") " pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:41.137568 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.137535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9w7\" (UniqueName: \"kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7\") pod \"test-curl-7262-139912609940144\" (UID: \"b375ba73-8a1d-457a-9559-a29afdccaf8c\") " pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:41.147516 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.147486    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9w7\" (UniqueName: \"kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7\") pod \"test-curl-7262-139912609940144\" (UID: \"b375ba73-8a1d-457a-9559-a29afdccaf8c\") " pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:41.219366 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.219308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:41.328976 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.328938    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:41.329153 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.328984    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54498158f359a585330fff9874793ff803347dbe5fccc915bdc2eb8c9d601858"
Jul 27 16:40:41.339691 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:40:41.339661    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7262-139912609943216\" is forbidden: User \"system:node:ip-10-0-141-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-100.ec2.internal' and this object" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:41.349420 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:41.349399    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912609940144"]
Jul 27 16:40:41.351328 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:41.351306    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb375ba73_8a1d_457a_9559_a29afdccaf8c.slice/crio-68607b866ab5c23499f6a4d13e3879734de36aa977d8666626fa772046992855 WatchSource:0}: Error finding container 68607b866ab5c23499f6a4d13e3879734de36aa977d8666626fa772046992855: Status 404 returned error can't find the container with id 68607b866ab5c23499f6a4d13e3879734de36aa977d8666626fa772046992855
Jul 27 16:40:42.335514 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:42.335480    2573 generic.go:356] "Generic (PLEG): container finished" podID="b375ba73-8a1d-457a-9559-a29afdccaf8c" containerID="1d5da030f7733b758ce72fcfbc41ec68b409b0d7693c7e5db764ce4f2bc47551" exitCode=0
Jul 27 16:40:42.335864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:42.335564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912609940144" event={"ID":"b375ba73-8a1d-457a-9559-a29afdccaf8c","Type":"ContainerDied","Data":"1d5da030f7733b758ce72fcfbc41ec68b409b0d7693c7e5db764ce4f2bc47551"}
Jul 27 16:40:42.335864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:42.335601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912609940144" event={"ID":"b375ba73-8a1d-457a-9559-a29afdccaf8c","Type":"ContainerStarted","Data":"68607b866ab5c23499f6a4d13e3879734de36aa977d8666626fa772046992855"}
Jul 27 16:40:42.337727 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:40:42.337705    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7262-139912609943216\" is forbidden: User \"system:node:ip-10-0-141-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-100.ec2.internal' and this object" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" pod="opendatahub/test-curl-7262-139912609943216"
Jul 27 16:40:42.412075 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:42.412043    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b8a54c2-3a5c-4811-8350-69a2209973a4" path="/var/lib/kubelet/pods/8b8a54c2-3a5c-4811-8350-69a2209973a4/volumes"
Jul 27 16:40:43.480092 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.480067    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:43.501107 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.501083    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912609940144_b375ba73-8a1d-457a-9559-a29afdccaf8c/test-curl-7262-139912609940144/0.log"
Jul 27 16:40:43.525910 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.525881    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912609940144"]
Jul 27 16:40:43.529734 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.529713    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912609940144"]
Jul 27 16:40:43.558539 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.558517    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl9w7\" (UniqueName: \"kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7\") pod \"b375ba73-8a1d-457a-9559-a29afdccaf8c\" (UID: \"b375ba73-8a1d-457a-9559-a29afdccaf8c\") "
Jul 27 16:40:43.560504 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.560480    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7" (OuterVolumeSpecName: "kube-api-access-jl9w7") pod "b375ba73-8a1d-457a-9559-a29afdccaf8c" (UID: "b375ba73-8a1d-457a-9559-a29afdccaf8c"). InnerVolumeSpecName "kube-api-access-jl9w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:43.660053 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.659987    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl9w7\" (UniqueName: \"kubernetes.io/projected/b375ba73-8a1d-457a-9559-a29afdccaf8c-kube-api-access-jl9w7\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:43.698374 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.698346    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:43.698798 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.698780    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b375ba73-8a1d-457a-9559-a29afdccaf8c" containerName="test-curl-7262-139912609940144"
Jul 27 16:40:43.698878 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.698801    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b375ba73-8a1d-457a-9559-a29afdccaf8c" containerName="test-curl-7262-139912609940144"
Jul 27 16:40:43.698938 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.698916    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b375ba73-8a1d-457a-9559-a29afdccaf8c" containerName="test-curl-7262-139912609940144"
Jul 27 16:40:43.702096 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.702078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:43.709197 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.709042    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:43.861978 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.861921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6v7x\" (UniqueName: \"kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x\") pod \"test-curl-7262-139912604690304\" (UID: \"61b4f73a-54b5-4dd6-8673-d9bebca4f33d\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:43.962625 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.962534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6v7x\" (UniqueName: \"kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x\") pod \"test-curl-7262-139912604690304\" (UID: \"61b4f73a-54b5-4dd6-8673-d9bebca4f33d\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:43.971531 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:43.971508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6v7x\" (UniqueName: \"kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x\") pod \"test-curl-7262-139912604690304\" (UID: \"61b4f73a-54b5-4dd6-8673-d9bebca4f33d\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:44.012261 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.012239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:44.141851 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.141724    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:44.146907 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:44.144772    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61b4f73a_54b5_4dd6_8673_d9bebca4f33d.slice/crio-791cf89cbf2738c8f734c4e8a4b3f1d3c0b792a73b2f7efb20c4b2b67bb3c951 WatchSource:0}: Error finding container 791cf89cbf2738c8f734c4e8a4b3f1d3c0b792a73b2f7efb20c4b2b67bb3c951: Status 404 returned error can't find the container with id 791cf89cbf2738c8f734c4e8a4b3f1d3c0b792a73b2f7efb20c4b2b67bb3c951
Jul 27 16:40:44.347141 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.347111    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:44.347297 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.347142    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68607b866ab5c23499f6a4d13e3879734de36aa977d8666626fa772046992855"
Jul 27 16:40:44.348339 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.348311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912604690304" event={"ID":"61b4f73a-54b5-4dd6-8673-d9bebca4f33d","Type":"ContainerStarted","Data":"791cf89cbf2738c8f734c4e8a4b3f1d3c0b792a73b2f7efb20c4b2b67bb3c951"}
Jul 27 16:40:44.357845 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:40:44.357820    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7262-139912609940144\" is forbidden: User \"system:node:ip-10-0-141-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-100.ec2.internal' and this object" podUID="b375ba73-8a1d-457a-9559-a29afdccaf8c" pod="opendatahub/test-curl-7262-139912609940144"
Jul 27 16:40:44.410817 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:44.410790    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b375ba73-8a1d-457a-9559-a29afdccaf8c" path="/var/lib/kubelet/pods/b375ba73-8a1d-457a-9559-a29afdccaf8c/volumes"
Jul 27 16:40:45.355241 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:45.355201    2573 generic.go:356] "Generic (PLEG): container finished" podID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" containerID="721163885e60d61820edb57c4347727b2972a9ba726756f673f2246256560d7a" exitCode=0
Jul 27 16:40:45.355608 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:45.355282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912604690304" event={"ID":"61b4f73a-54b5-4dd6-8673-d9bebca4f33d","Type":"ContainerDied","Data":"721163885e60d61820edb57c4347727b2972a9ba726756f673f2246256560d7a"}
Jul 27 16:40:46.517496 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.517473    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:46.539706 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.539679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912604690304_61b4f73a-54b5-4dd6-8673-d9bebca4f33d/test-curl-7262-139912604690304/0.log"
Jul 27 16:40:46.601373 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.601340    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:46.607692 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.607664    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:46.686097 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.686033    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6v7x\" (UniqueName: \"kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x\") pod \"61b4f73a-54b5-4dd6-8673-d9bebca4f33d\" (UID: \"61b4f73a-54b5-4dd6-8673-d9bebca4f33d\") "
Jul 27 16:40:46.688083 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.688059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x" (OuterVolumeSpecName: "kube-api-access-f6v7x") pod "61b4f73a-54b5-4dd6-8673-d9bebca4f33d" (UID: "61b4f73a-54b5-4dd6-8673-d9bebca4f33d"). InnerVolumeSpecName "kube-api-access-f6v7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:46.787275 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.787244    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6v7x\" (UniqueName: \"kubernetes.io/projected/61b4f73a-54b5-4dd6-8673-d9bebca4f33d-kube-api-access-f6v7x\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:46.833157 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.833130    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:46.833545 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.833533    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:46.833589 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.833547    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:46.833626 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.833611    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:46.836619 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.836602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:46.842870 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.842847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:46.989315 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:46.989233    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7kl6\" (UniqueName: \"kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6\") pod \"test-curl-7262-139912604690304\" (UID: \"f8b13d20-83f2-4b37-8080-0e7aed4b10c5\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:47.090225 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.090191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7kl6\" (UniqueName: \"kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6\") pod \"test-curl-7262-139912604690304\" (UID: \"f8b13d20-83f2-4b37-8080-0e7aed4b10c5\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:47.101089 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.101062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7kl6\" (UniqueName: \"kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6\") pod \"test-curl-7262-139912604690304\" (UID: \"f8b13d20-83f2-4b37-8080-0e7aed4b10c5\") " pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:47.147204 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.147179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:47.273991 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.273953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:47.276079 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:47.276052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b13d20_83f2_4b37_8080_0e7aed4b10c5.slice/crio-6d22c34ffb2a216920802789d5aab73d58ee2ac388056b2014390454d4085958 WatchSource:0}: Error finding container 6d22c34ffb2a216920802789d5aab73d58ee2ac388056b2014390454d4085958: Status 404 returned error can't find the container with id 6d22c34ffb2a216920802789d5aab73d58ee2ac388056b2014390454d4085958
Jul 27 16:40:47.375841 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.375813    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:47.375973 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.375839    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="791cf89cbf2738c8f734c4e8a4b3f1d3c0b792a73b2f7efb20c4b2b67bb3c951"
Jul 27 16:40:47.377019 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.376994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912604690304" event={"ID":"f8b13d20-83f2-4b37-8080-0e7aed4b10c5","Type":"ContainerStarted","Data":"6d22c34ffb2a216920802789d5aab73d58ee2ac388056b2014390454d4085958"}
Jul 27 16:40:47.387930 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:47.387902    2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7262-139912604690304" oldPodUID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5"
Jul 27 16:40:48.382808 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:48.382769    2573 generic.go:356] "Generic (PLEG): container finished" podID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" containerID="dee7a575b52ab0350080c1c359bf13306d37f47bc90fc5a1b646b9f0862de571" exitCode=0
Jul 27 16:40:48.383235 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:48.382818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912604690304" event={"ID":"f8b13d20-83f2-4b37-8080-0e7aed4b10c5","Type":"ContainerDied","Data":"dee7a575b52ab0350080c1c359bf13306d37f47bc90fc5a1b646b9f0862de571"}
Jul 27 16:40:48.411903 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:48.411877    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b4f73a-54b5-4dd6-8673-d9bebca4f33d" path="/var/lib/kubelet/pods/61b4f73a-54b5-4dd6-8673-d9bebca4f33d/volumes"
Jul 27 16:40:49.529430 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.529405    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:49.549974 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.549930    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912604690304_f8b13d20-83f2-4b37-8080-0e7aed4b10c5/test-curl-7262-139912604690304/0.log"
Jul 27 16:40:49.600112 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.600078    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:49.601821 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.601800    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912604690304"]
Jul 27 16:40:49.613838 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.613813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7kl6\" (UniqueName: \"kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6\") pod \"f8b13d20-83f2-4b37-8080-0e7aed4b10c5\" (UID: \"f8b13d20-83f2-4b37-8080-0e7aed4b10c5\") "
Jul 27 16:40:49.615841 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.615817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6" (OuterVolumeSpecName: "kube-api-access-c7kl6") pod "f8b13d20-83f2-4b37-8080-0e7aed4b10c5" (UID: "f8b13d20-83f2-4b37-8080-0e7aed4b10c5"). InnerVolumeSpecName "kube-api-access-c7kl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:49.715009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.714922    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7kl6\" (UniqueName: \"kubernetes.io/projected/f8b13d20-83f2-4b37-8080-0e7aed4b10c5-kube-api-access-c7kl6\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:49.782349 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.782319    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:49.782906 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.782882    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:49.782906 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.782905    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:49.783103 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.783056    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" containerName="test-curl-7262-139912604690304"
Jul 27 16:40:49.786155 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.786137    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:49.792654 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.792632    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:49.916349 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:49.916317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k25s\" (UniqueName: \"kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s\") pod \"test-curl-7262-139912610117216\" (UID: \"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:50.017026 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.016903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k25s\" (UniqueName: \"kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s\") pod \"test-curl-7262-139912610117216\" (UID: \"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:50.027158 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.027133    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k25s\" (UniqueName: \"kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s\") pod \"test-curl-7262-139912610117216\" (UID: \"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:50.096376 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.096345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:50.231007 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.230982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:50.232997 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:50.232974    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c78f26f_d486_4ecf_8c02_bfbd7bc968e2.slice/crio-145cdcb8767fe1c70881c50e831819d4b65d837d1e6ff2f94d7bae609bd7af23 WatchSource:0}: Error finding container 145cdcb8767fe1c70881c50e831819d4b65d837d1e6ff2f94d7bae609bd7af23: Status 404 returned error can't find the container with id 145cdcb8767fe1c70881c50e831819d4b65d837d1e6ff2f94d7bae609bd7af23
Jul 27 16:40:50.394895 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.394863    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:50.395085 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.394867    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d22c34ffb2a216920802789d5aab73d58ee2ac388056b2014390454d4085958"
Jul 27 16:40:50.396215 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.396192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912610117216" event={"ID":"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2","Type":"ContainerStarted","Data":"145cdcb8767fe1c70881c50e831819d4b65d837d1e6ff2f94d7bae609bd7af23"}
Jul 27 16:40:50.405751 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:40:50.405724    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7262-139912604690304\" is forbidden: User \"system:node:ip-10-0-141-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-100.ec2.internal' and this object" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" pod="opendatahub/test-curl-7262-139912604690304"
Jul 27 16:40:50.411864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.411842    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b13d20-83f2-4b37-8080-0e7aed4b10c5" path="/var/lib/kubelet/pods/f8b13d20-83f2-4b37-8080-0e7aed4b10c5/volumes"
Jul 27 16:40:50.626415 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:50.626390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:51.403972 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:51.403927    2573 generic.go:356] "Generic (PLEG): container finished" podID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" containerID="e2e9256b679cd8f80906942f3ddafcc7063959c1e59cadd07e69bd53f9f6fa97" exitCode=0
Jul 27 16:40:51.404133 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:51.403999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912610117216" event={"ID":"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2","Type":"ContainerDied","Data":"e2e9256b679cd8f80906942f3ddafcc7063959c1e59cadd07e69bd53f9f6fa97"}
Jul 27 16:40:52.546057 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.546031    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:52.573692 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.573666    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912610117216_7c78f26f-d486-4ecf-8c02-bfbd7bc968e2/test-curl-7262-139912610117216/0.log"
Jul 27 16:40:52.612135 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.612088    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:52.618206 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.618178    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:52.642482 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.642453    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k25s\" (UniqueName: \"kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s\") pod \"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2\" (UID: \"7c78f26f-d486-4ecf-8c02-bfbd7bc968e2\") "
Jul 27 16:40:52.644519 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.644492    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s" (OuterVolumeSpecName: "kube-api-access-8k25s") pod "7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" (UID: "7c78f26f-d486-4ecf-8c02-bfbd7bc968e2"). InnerVolumeSpecName "kube-api-access-8k25s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:52.743611 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.743512    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k25s\" (UniqueName: \"kubernetes.io/projected/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2-kube-api-access-8k25s\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:52.964581 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.964547    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:52.964977 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.964949    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" containerName="test-curl-7262-139912610117216"
Jul 27 16:40:52.965028 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.964978    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" containerName="test-curl-7262-139912610117216"
Jul 27 16:40:52.965064 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.965052    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" containerName="test-curl-7262-139912610117216"
Jul 27 16:40:52.968185 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.968170    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:52.974803 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:52.974762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:53.147791 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.147753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjzm2\" (UniqueName: \"kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2\") pod \"test-curl-7262-139912610117216\" (UID: \"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:53.248416 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.248382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjzm2\" (UniqueName: \"kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2\") pod \"test-curl-7262-139912610117216\" (UID: \"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:53.257402 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.257379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjzm2\" (UniqueName: \"kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2\") pod \"test-curl-7262-139912610117216\" (UID: \"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30\") " pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:53.278305 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.278279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:53.410040 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.410012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:53.412193 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:40:53.412168    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4720e5d4_46d3_42eb_a5a5_25b18bc6ac30.slice/crio-92296d91685051a1925a9fc3bacc7dc4441d2611b509859cf5f00c1317fa42b4 WatchSource:0}: Error finding container 92296d91685051a1925a9fc3bacc7dc4441d2611b509859cf5f00c1317fa42b4: Status 404 returned error can't find the container with id 92296d91685051a1925a9fc3bacc7dc4441d2611b509859cf5f00c1317fa42b4
Jul 27 16:40:53.417552 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.417533    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:53.417656 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.417578    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="145cdcb8767fe1c70881c50e831819d4b65d837d1e6ff2f94d7bae609bd7af23"
Jul 27 16:40:53.429938 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:53.429915    2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7262-139912610117216" oldPodUID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" podUID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30"
Jul 27 16:40:54.412739 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:54.412704    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c78f26f-d486-4ecf-8c02-bfbd7bc968e2" path="/var/lib/kubelet/pods/7c78f26f-d486-4ecf-8c02-bfbd7bc968e2/volumes"
Jul 27 16:40:54.426782 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:54.426750    2573 generic.go:356] "Generic (PLEG): container finished" podID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" containerID="96add625520fe9354664c8a2c4f4508787a45ae5c45aefe21ca7e5bbd55f6a04" exitCode=0
Jul 27 16:40:54.426932 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:54.426846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912610117216" event={"ID":"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30","Type":"ContainerDied","Data":"96add625520fe9354664c8a2c4f4508787a45ae5c45aefe21ca7e5bbd55f6a04"}
Jul 27 16:40:54.426932 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:54.426893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7262-139912610117216" event={"ID":"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30","Type":"ContainerStarted","Data":"92296d91685051a1925a9fc3bacc7dc4441d2611b509859cf5f00c1317fa42b4"}
Jul 27 16:40:55.576045 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.576022    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:55.597935 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.597907    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7262-139912610117216_4720e5d4-46d3-42eb-a5a5-25b18bc6ac30/test-curl-7262-139912610117216/0.log"
Jul 27 16:40:55.626440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.626399    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:55.630777 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.630751    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7262-139912610117216"]
Jul 27 16:40:55.773170 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.773082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjzm2\" (UniqueName: \"kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2\") pod \"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30\" (UID: \"4720e5d4-46d3-42eb-a5a5-25b18bc6ac30\") "
Jul 27 16:40:55.775240 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.775218    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2" (OuterVolumeSpecName: "kube-api-access-vjzm2") pod "4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" (UID: "4720e5d4-46d3-42eb-a5a5-25b18bc6ac30"). InnerVolumeSpecName "kube-api-access-vjzm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:40:55.873945 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:55.873919    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjzm2\" (UniqueName: \"kubernetes.io/projected/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30-kube-api-access-vjzm2\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:40:56.416123 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:56.413896    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" path="/var/lib/kubelet/pods/4720e5d4-46d3-42eb-a5a5-25b18bc6ac30/volumes"
Jul 27 16:40:56.429710 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:56.429684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:56.438695 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:56.438675    2573 scope.go:117] "RemoveContainer" containerID="96add625520fe9354664c8a2c4f4508787a45ae5c45aefe21ca7e5bbd55f6a04"
Jul 27 16:40:56.438795 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:56.438696    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7262-139912610117216"
Jul 27 16:40:56.770575 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:56.770494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:40:57.187583 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:40:57.187549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:00.448767 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:00.448737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:00.562690 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:00.562661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:00.647539 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:00.647506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:01.148834 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.148801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:01.192137 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.192102    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:41:01.192523 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.192511    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" containerName="test-curl-7262-139912610117216"
Jul 27 16:41:01.192565 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.192525    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" containerName="test-curl-7262-139912610117216"
Jul 27 16:41:01.192596 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.192587    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4720e5d4-46d3-42eb-a5a5-25b18bc6ac30" containerName="test-curl-7262-139912610117216"
Jul 27 16:41:01.195642 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.195621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.198254 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.198232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ffa17b-dockercfg-2gxs4\""
Jul 27 16:41:01.198374 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.198284    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ffa17b\""
Jul 27 16:41:01.205576 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.205552    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:41:01.212864 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.212833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.212998 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.212878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sql\" (UniqueName: \"kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.235764 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.235738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:01.237037 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.237016    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:41:01.240619 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.240601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.249268 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.249245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:41:01.313357 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.313325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.313357 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.313357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sql\" (UniqueName: \"kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.313542 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.313379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84sp9\" (UniqueName: \"kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.313542 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.313437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.314244 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.314227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.322072 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.322051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sql\" (UniqueName: \"kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql\") pod \"payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.414610 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.414517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84sp9\" (UniqueName: \"kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.414610 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.414596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.415299 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.415281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.424222 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.424196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84sp9\" (UniqueName: \"kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9\") pod \"payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.427140 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.427116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:01.507238 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.507201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:01.551601 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.551572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:01.662298 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.662217    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:41:01.708673 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:01.708565    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:41:01.711030 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:41:01.711005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179a8923_652c_4311_adaa_20bd4e54c3dd.slice/crio-615d04385ba3a8c74289d636103c22f59069c60fdf9252623f04f4bc3ce6caf7 WatchSource:0}: Error finding container 615d04385ba3a8c74289d636103c22f59069c60fdf9252623f04f4bc3ce6caf7: Status 404 returned error can't find the container with id 615d04385ba3a8c74289d636103c22f59069c60fdf9252623f04f4bc3ce6caf7
Jul 27 16:41:02.472877 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.472838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" event={"ID":"1e59cfcb-da17-4da5-921f-9134947a0328","Type":"ContainerStarted","Data":"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"}
Jul 27 16:41:02.473105 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.472891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" event={"ID":"1e59cfcb-da17-4da5-921f-9134947a0328","Type":"ContainerStarted","Data":"fb6b8a9e35ae059e473583afc64c0d56807223757e0a3d445a1291df8fd9dc42"}
Jul 27 16:41:02.473105 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.472973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:02.474499 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.474477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" event={"ID":"179a8923-652c-4311-adaa-20bd4e54c3dd","Type":"ContainerStarted","Data":"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"}
Jul 27 16:41:02.474619 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.474513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" event={"ID":"179a8923-652c-4311-adaa-20bd4e54c3dd","Type":"ContainerStarted","Data":"615d04385ba3a8c74289d636103c22f59069c60fdf9252623f04f4bc3ce6caf7"}
Jul 27 16:41:02.474619 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.474601    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:02.490687 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.490629    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" podStartSLOduration=1.4906159350000001 podStartE2EDuration="1.490615935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:02.489776782 +0000 UTC m=+3164.575732516" watchObservedRunningTime="2026-07-27 16:41:02.490615935 +0000 UTC m=+3164.576571666"
Jul 27 16:41:02.510855 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:02.510805    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" podStartSLOduration=1.51079273 podStartE2EDuration="1.51079273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:02.509371 +0000 UTC m=+3164.595326735" watchObservedRunningTime="2026-07-27 16:41:02.51079273 +0000 UTC m=+3164.596748461"
Jul 27 16:41:04.970225 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:04.970178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:13.482862 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:13.482830    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:41:13.483344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:13.482900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:41:15.922136 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:15.922098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:16.205777 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.205700    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:41:16.211370 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.211346    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.213978 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.213942    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 16:41:16.214104 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.214000    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d32cda-openshift-default-dockercfg-9ptfq\""
Jul 27 16:41:16.221509 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.221485    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:41:16.236994 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.236970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:16.252018 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.251996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l276r\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252121 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252121 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252121 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.252228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.252219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353543 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l276r\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353954 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353954 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353954 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353900    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.353954 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.354138 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.353989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.354203 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.354166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.354270 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.354246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.354343 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.354322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.354503 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.354483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.355937 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.355914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.356155 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.356140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.361628 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.361605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.362286 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.362265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l276r\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r\") pod \"e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") " pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.500270 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.500152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:16.523350 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.523326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:16.664316 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:16.663923    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:41:16.667452 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:41:16.667423    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a3ce9b_1dad_4cdc_85be_94e92bd0b4ba.slice/crio-07c601b3ee523a490a20460829910256b570578e0ff384ce29e8eb58b6490b19 WatchSource:0}: Error finding container 07c601b3ee523a490a20460829910256b570578e0ff384ce29e8eb58b6490b19: Status 404 returned error can't find the container with id 07c601b3ee523a490a20460829910256b570578e0ff384ce29e8eb58b6490b19
Jul 27 16:41:17.558440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:17.558404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerStarted","Data":"07c601b3ee523a490a20460829910256b570578e0ff384ce29e8eb58b6490b19"}
Jul 27 16:41:22.280328 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:22.280288    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:22.280727 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:22.280378    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:22.280727 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:22.280426    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:22.588555 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:22.588519    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerStarted","Data":"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"}
Jul 27 16:41:22.611265 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:22.611217    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podStartSLOduration=1.000646956 podStartE2EDuration="6.61119996s" totalImagesPullingTime="5.610553004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:22.609407868 +0000 UTC m=+3184.695363594" watchObservedRunningTime="2026-07-27 16:41:22.61119996 +0000 UTC m=+3184.697155692"
Jul 27 16:41:23.524263 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:23.524230    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:23.528841 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:23.528814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:23.595298 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:23.595264    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:23.596078 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:23.596057    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:25.309195 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.309163    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:41:25.312867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.312848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.315754 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.315733    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d32cda\""
Jul 27 16:41:25.324142 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.324120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:41:25.441039 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.441000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.441231 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.441136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v2jp\" (UniqueName: \"kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.542245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.542197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.542401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.542290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v2jp\" (UniqueName: \"kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.542882 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.542862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.552367 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.552346    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v2jp\" (UniqueName: \"kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp\") pod \"payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.624286 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.624256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:25.778419 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:41:25.778391    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12547ac_ca6e_47c4_a784_81a600350077.slice/crio-f2a8687d0f809b5bb2b125a2b10f2861739bd158f8299fdf0b8dad65f86cf759 WatchSource:0}: Error finding container f2a8687d0f809b5bb2b125a2b10f2861739bd158f8299fdf0b8dad65f86cf759: Status 404 returned error can't find the container with id f2a8687d0f809b5bb2b125a2b10f2861739bd158f8299fdf0b8dad65f86cf759
Jul 27 16:41:25.782182 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:25.782161    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:41:26.242363 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.242329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:26.310596 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.310537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:26.612984 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.612933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" event={"ID":"d12547ac-ca6e-47c4-a784-81a600350077","Type":"ContainerStarted","Data":"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"}
Jul 27 16:41:26.613184 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.613017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:26.613184 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.613041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" event={"ID":"d12547ac-ca6e-47c4-a784-81a600350077","Type":"ContainerStarted","Data":"f2a8687d0f809b5bb2b125a2b10f2861739bd158f8299fdf0b8dad65f86cf759"}
Jul 27 16:41:26.631750 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:26.631706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" podStartSLOduration=1.631691298 podStartE2EDuration="1.631691298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:26.629506918 +0000 UTC m=+3188.715462663" watchObservedRunningTime="2026-07-27 16:41:26.631691298 +0000 UTC m=+3188.717647036"
Jul 27 16:41:29.140542 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:29.140506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:41:37.621684 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:37.621641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:41:38.990347 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:38.989824    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:50580->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 27 16:41:38.990347 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:38.989898    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:50580->10.133.0.60:15021: read: connection reset by peer"
Jul 27 16:41:39.692280 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.692244    2573 generic.go:356] "Generic (PLEG): container finished" podID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerID="000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec" exitCode=0
Jul 27 16:41:39.692456 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.692319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerDied","Data":"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"}
Jul 27 16:41:39.692745 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.692727    2573 scope.go:117] "RemoveContainer" containerID="000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"
Jul 27 16:41:39.694733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.694703    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:39.694827 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.694792    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:39.694866 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:39.694838    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:40.699208 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:40.699168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerStarted","Data":"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"}
Jul 27 16:41:41.523449 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:41.523415    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:41.523695 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:41.523672    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:41:41.523781 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:41.523726    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 16:41:42.524174 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:42.524139    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:41:42.524547 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:42.524191    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 16:41:43.523651 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:43.523616    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:41:43.523871 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:43.523666    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 16:41:44.523721 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:44.523686    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:41:44.524211 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:44.523741    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 16:41:45.527331 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:45.527302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:45.527784 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:45.527738    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:45.528479 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:45.528458    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:41:57.565894 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:41:57.565864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:36.553636 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:36.553607    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj_179a8923-652c-4311-adaa-20bd4e54c3dd/payload-processing/0.log"
Jul 27 16:42:37.116241 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:37.116200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:39.740776 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:39.740745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:40.297477 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:40.297445    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:40.400675 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:40.400644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:40.530919 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:40.530890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:40.825169 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:40.825139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:41.101223 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.101131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:41.228064 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.228013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:41.234229 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.234197    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:42:41.238032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.238016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.240489 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.240468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-145981\""
Jul 27 16:42:41.240611 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.240529    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-145981-dockercfg-sp2q8\""
Jul 27 16:42:41.255912 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.255885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:42:41.278213 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.278182    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:42:41.281896 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.281875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.294168 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.294143    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:42:41.344335 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.344302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz57m\" (UniqueName: \"kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.344517 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.344347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.344517 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.344383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r968\" (UniqueName: \"kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.344517 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.344486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.445259 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.445176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.445415 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.445268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz57m\" (UniqueName: \"kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.445415 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.445303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.445415 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.445333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r968\" (UniqueName: \"kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.446046 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.446019    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.446144 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.446129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.457849 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.457818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r968\" (UniqueName: \"kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968\") pod \"payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.457997 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.457880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz57m\" (UniqueName: \"kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m\") pod \"payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.552743 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.552713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:41.592082 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.592049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:41.708162 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.708063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:42:41.711715 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:42:41.711684    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb307ed_2baa_43ff_8f14_186de04877d5.slice/crio-54877da58d423f7670a0c79d46b2761ed5135f4273c987a5956402a12b33aa74 WatchSource:0}: Error finding container 54877da58d423f7670a0c79d46b2761ed5135f4273c987a5956402a12b33aa74: Status 404 returned error can't find the container with id 54877da58d423f7670a0c79d46b2761ed5135f4273c987a5956402a12b33aa74
Jul 27 16:42:41.749369 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:41.749235    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:42:41.751619 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:42:41.751588    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bebcc2e_feb6_432d_8c5a_08f0dc8b63c4.slice/crio-aed8ce1a9b6f32c9b5da7b427235b0277dc6a97eb695cbab5336d671205c24ee WatchSource:0}: Error finding container aed8ce1a9b6f32c9b5da7b427235b0277dc6a97eb695cbab5336d671205c24ee: Status 404 returned error can't find the container with id aed8ce1a9b6f32c9b5da7b427235b0277dc6a97eb695cbab5336d671205c24ee
Jul 27 16:42:42.034591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.034495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" event={"ID":"7fb307ed-2baa-43ff-8f14-186de04877d5","Type":"ContainerStarted","Data":"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"}
Jul 27 16:42:42.034591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.034566    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" event={"ID":"7fb307ed-2baa-43ff-8f14-186de04877d5","Type":"ContainerStarted","Data":"54877da58d423f7670a0c79d46b2761ed5135f4273c987a5956402a12b33aa74"}
Jul 27 16:42:42.035068 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.034602    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:42.036092 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.036065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" event={"ID":"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4","Type":"ContainerStarted","Data":"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"}
Jul 27 16:42:42.036220 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.036106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" event={"ID":"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4","Type":"ContainerStarted","Data":"aed8ce1a9b6f32c9b5da7b427235b0277dc6a97eb695cbab5336d671205c24ee"}
Jul 27 16:42:42.036220 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.036160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:42.052377 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.052330    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" podStartSLOduration=1.052315658 podStartE2EDuration="1.052315658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:42:42.05134018 +0000 UTC m=+3264.137295914" watchObservedRunningTime="2026-07-27 16:42:42.052315658 +0000 UTC m=+3264.138271389"
Jul 27 16:42:42.069641 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:42.069599    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" podStartSLOduration=1.069586011 podStartE2EDuration="1.069586011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:42:42.06822669 +0000 UTC m=+3264.154182426" watchObservedRunningTime="2026-07-27 16:42:42.069586011 +0000 UTC m=+3264.155541743"
Jul 27 16:42:44.808314 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:44.808281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:53.043649 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:53.043616    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:42:53.044243 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:53.043988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:42:55.334124 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:55.334084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:42:55.432726 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:42:55.432690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:06.231816 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.231780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:06.283332 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.283296    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:43:06.283574 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.283544    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" podUID="7fb307ed-2baa-43ff-8f14-186de04877d5" containerName="payload-processing" containerID="cri-o://133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b" gracePeriod=30
Jul 27 16:43:06.290734 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.290703    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:43:06.291068 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.290915    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" podUID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" containerName="payload-pre-processing" containerID="cri-o://beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44" gracePeriod=30
Jul 27 16:43:06.331926 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.331895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:06.561362 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.561332    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:43:06.584102 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.584077    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:43:06.585318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r968\" (UniqueName: \"kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968\") pod \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") "
Jul 27 16:43:06.585453 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585360    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume\") pod \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\" (UID: \"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4\") "
Jul 27 16:43:06.585453 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume\") pod \"7fb307ed-2baa-43ff-8f14-186de04877d5\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") "
Jul 27 16:43:06.585564 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585481    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz57m\" (UniqueName: \"kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m\") pod \"7fb307ed-2baa-43ff-8f14-186de04877d5\" (UID: \"7fb307ed-2baa-43ff-8f14-186de04877d5\") "
Jul 27 16:43:06.585770 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585741    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" (UID: "4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:43:06.585863 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.585778    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fb307ed-2baa-43ff-8f14-186de04877d5" (UID: "7fb307ed-2baa-43ff-8f14-186de04877d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:43:06.587495 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.587471    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968" (OuterVolumeSpecName: "kube-api-access-4r968") pod "4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" (UID: "4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4"). InnerVolumeSpecName "kube-api-access-4r968". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:06.587555 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.587525    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m" (OuterVolumeSpecName: "kube-api-access-pz57m") pod "7fb307ed-2baa-43ff-8f14-186de04877d5" (UID: "7fb307ed-2baa-43ff-8f14-186de04877d5"). InnerVolumeSpecName "kube-api-access-pz57m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:06.686803 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.686767    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:06.686803 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.686797    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fb307ed-2baa-43ff-8f14-186de04877d5-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:06.687016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.686811    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz57m\" (UniqueName: \"kubernetes.io/projected/7fb307ed-2baa-43ff-8f14-186de04877d5-kube-api-access-pz57m\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:06.687016 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.686823    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r968\" (UniqueName: \"kubernetes.io/projected/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4-kube-api-access-4r968\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:06.989660 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:06.989628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:07.176222 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.176185    2573 generic.go:356] "Generic (PLEG): container finished" podID="7fb307ed-2baa-43ff-8f14-186de04877d5" containerID="133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b" exitCode=0
Jul 27 16:43:07.176392 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.176231    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"
Jul 27 16:43:07.176392 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.176266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" event={"ID":"7fb307ed-2baa-43ff-8f14-186de04877d5","Type":"ContainerDied","Data":"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"}
Jul 27 16:43:07.176392 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.176321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6" event={"ID":"7fb307ed-2baa-43ff-8f14-186de04877d5","Type":"ContainerDied","Data":"54877da58d423f7670a0c79d46b2761ed5135f4273c987a5956402a12b33aa74"}
Jul 27 16:43:07.176392 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.176343    2573 scope.go:117] "RemoveContainer" containerID="133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"
Jul 27 16:43:07.177682 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.177657    2573 generic.go:356] "Generic (PLEG): container finished" podID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" containerID="beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44" exitCode=0
Jul 27 16:43:07.177784 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.177697    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"
Jul 27 16:43:07.177784 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.177738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" event={"ID":"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4","Type":"ContainerDied","Data":"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"}
Jul 27 16:43:07.177873 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.177781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7" event={"ID":"4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4","Type":"ContainerDied","Data":"aed8ce1a9b6f32c9b5da7b427235b0277dc6a97eb695cbab5336d671205c24ee"}
Jul 27 16:43:07.186522 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.186496    2573 scope.go:117] "RemoveContainer" containerID="133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"
Jul 27 16:43:07.186869 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:43:07.186842    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b\": container with ID starting with 133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b not found: ID does not exist" containerID="133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"
Jul 27 16:43:07.186974 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.186879    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b"} err="failed to get container status \"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b\": rpc error: code = NotFound desc = could not find container \"133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b\": container with ID starting with 133c3de0a262a898a89d996d4e86abdd782a0d0e7ab46126b226d3cf2a9adc4b not found: ID does not exist"
Jul 27 16:43:07.186974 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.186901    2573 scope.go:117] "RemoveContainer" containerID="beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"
Jul 27 16:43:07.195253 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.195233    2573 scope.go:117] "RemoveContainer" containerID="beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"
Jul 27 16:43:07.195504 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:43:07.195486    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44\": container with ID starting with beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44 not found: ID does not exist" containerID="beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"
Jul 27 16:43:07.195553 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.195512    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44"} err="failed to get container status \"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44\": rpc error: code = NotFound desc = could not find container \"beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44\": container with ID starting with beb0194ab9b422e5bff215a99f50ac35a65bc354eeb77f9eed87d869e9becc44 not found: ID does not exist"
Jul 27 16:43:07.202609 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.202584    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:43:07.213585 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.213560    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145981-77b8db9c8d-jnfc7"]
Jul 27 16:43:07.225912 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.225890    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:43:07.227746 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:07.227727    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-145981-c4f69d484-k4vc6"]
Jul 27 16:43:08.412192 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:08.412163    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" path="/var/lib/kubelet/pods/4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4/volumes"
Jul 27 16:43:08.412591 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:08.412514    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fb307ed-2baa-43ff-8f14-186de04877d5" path="/var/lib/kubelet/pods/7fb307ed-2baa-43ff-8f14-186de04877d5/volumes"
Jul 27 16:43:10.847543 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:10.847506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:11.252525 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:11.252435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:17.342104 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:17.342069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:17.412252 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:17.412216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:17.619730 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:17.619641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:18.446950 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:18.446918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:36.846433 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.846395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:36.914891 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.914850    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:43:36.915113 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.915086    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" podUID="179a8923-652c-4311-adaa-20bd4e54c3dd" containerName="payload-processing" containerID="cri-o://a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac" gracePeriod=30
Jul 27 16:43:36.933730 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.933706    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:43:36.933904 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.933884    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" podUID="1e59cfcb-da17-4da5-921f-9134947a0328" containerName="payload-pre-processing" containerID="cri-o://78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c" gracePeriod=30
Jul 27 16:43:36.959342 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:36.959309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:37.055032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.055001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:37.211731 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.211707    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:43:37.214815 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.214797    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:43:37.348231 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.348194    2573 generic.go:356] "Generic (PLEG): container finished" podID="179a8923-652c-4311-adaa-20bd4e54c3dd" containerID="a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac" exitCode=0
Jul 27 16:43:37.348429 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.348238    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"
Jul 27 16:43:37.348429 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.348278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" event={"ID":"179a8923-652c-4311-adaa-20bd4e54c3dd","Type":"ContainerDied","Data":"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"}
Jul 27 16:43:37.348429 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.348336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj" event={"ID":"179a8923-652c-4311-adaa-20bd4e54c3dd","Type":"ContainerDied","Data":"615d04385ba3a8c74289d636103c22f59069c60fdf9252623f04f4bc3ce6caf7"}
Jul 27 16:43:37.348429 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.348369    2573 scope.go:117] "RemoveContainer" containerID="a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"
Jul 27 16:43:37.349575 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.349556    2573 generic.go:356] "Generic (PLEG): container finished" podID="1e59cfcb-da17-4da5-921f-9134947a0328" containerID="78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c" exitCode=0
Jul 27 16:43:37.349656 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.349591    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"
Jul 27 16:43:37.349656 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.349610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" event={"ID":"1e59cfcb-da17-4da5-921f-9134947a0328","Type":"ContainerDied","Data":"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"}
Jul 27 16:43:37.349656 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.349654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm" event={"ID":"1e59cfcb-da17-4da5-921f-9134947a0328","Type":"ContainerDied","Data":"fb6b8a9e35ae059e473583afc64c0d56807223757e0a3d445a1291df8fd9dc42"}
Jul 27 16:43:37.357182 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.357155    2573 scope.go:117] "RemoveContainer" containerID="a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"
Jul 27 16:43:37.357431 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:43:37.357411    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac\": container with ID starting with a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac not found: ID does not exist" containerID="a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"
Jul 27 16:43:37.357483 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.357440    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac"} err="failed to get container status \"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac\": rpc error: code = NotFound desc = could not find container \"a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac\": container with ID starting with a8e32d99d75ba4d659bde9100bc1b71f5d33aa9d40b82770991792f50765aeac not found: ID does not exist"
Jul 27 16:43:37.357483 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.357456    2573 scope.go:117] "RemoveContainer" containerID="78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"
Jul 27 16:43:37.365438 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.365422    2573 scope.go:117] "RemoveContainer" containerID="78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"
Jul 27 16:43:37.365687 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:43:37.365669    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c\": container with ID starting with 78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c not found: ID does not exist" containerID="78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"
Jul 27 16:43:37.365745 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.365699    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c"} err="failed to get container status \"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c\": rpc error: code = NotFound desc = could not find container \"78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c\": container with ID starting with 78cb5cfa830dc0e1154d9affda43cf09bf46239db905a79d38ec00f3db2baf0c not found: ID does not exist"
Jul 27 16:43:37.366921 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.366904    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume\") pod \"179a8923-652c-4311-adaa-20bd4e54c3dd\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") "
Jul 27 16:43:37.367009 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.366939    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84sp9\" (UniqueName: \"kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9\") pod \"179a8923-652c-4311-adaa-20bd4e54c3dd\" (UID: \"179a8923-652c-4311-adaa-20bd4e54c3dd\") "
Jul 27 16:43:37.367051 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.367007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65sql\" (UniqueName: \"kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql\") pod \"1e59cfcb-da17-4da5-921f-9134947a0328\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") "
Jul 27 16:43:37.367091 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.367069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume\") pod \"1e59cfcb-da17-4da5-921f-9134947a0328\" (UID: \"1e59cfcb-da17-4da5-921f-9134947a0328\") "
Jul 27 16:43:37.367295 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.367261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "179a8923-652c-4311-adaa-20bd4e54c3dd" (UID: "179a8923-652c-4311-adaa-20bd4e54c3dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:43:37.367490 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.367468    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/179a8923-652c-4311-adaa-20bd4e54c3dd-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:37.367636 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.367484    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e59cfcb-da17-4da5-921f-9134947a0328" (UID: "1e59cfcb-da17-4da5-921f-9134947a0328"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:43:37.368936 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.368918    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9" (OuterVolumeSpecName: "kube-api-access-84sp9") pod "179a8923-652c-4311-adaa-20bd4e54c3dd" (UID: "179a8923-652c-4311-adaa-20bd4e54c3dd"). InnerVolumeSpecName "kube-api-access-84sp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:37.369046 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.369031    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql" (OuterVolumeSpecName: "kube-api-access-65sql") pod "1e59cfcb-da17-4da5-921f-9134947a0328" (UID: "1e59cfcb-da17-4da5-921f-9134947a0328"). InnerVolumeSpecName "kube-api-access-65sql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:37.468470 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.468393    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84sp9\" (UniqueName: \"kubernetes.io/projected/179a8923-652c-4311-adaa-20bd4e54c3dd-kube-api-access-84sp9\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:37.468470 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.468418    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65sql\" (UniqueName: \"kubernetes.io/projected/1e59cfcb-da17-4da5-921f-9134947a0328-kube-api-access-65sql\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:37.468470 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.468432    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59cfcb-da17-4da5-921f-9134947a0328-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:37.673292 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.673262    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:43:37.675186 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.675163    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffa17b-6f9f95d748-wc5rj"]
Jul 27 16:43:37.686560 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.686536    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:43:37.688440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:37.688422    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffa17b-56fbdc9d44-gdbrm"]
Jul 27 16:43:38.411689 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:38.411652    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="179a8923-652c-4311-adaa-20bd4e54c3dd" path="/var/lib/kubelet/pods/179a8923-652c-4311-adaa-20bd4e54c3dd/volumes"
Jul 27 16:43:38.412084 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:38.412070    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e59cfcb-da17-4da5-921f-9134947a0328" path="/var/lib/kubelet/pods/1e59cfcb-da17-4da5-921f-9134947a0328/volumes"
Jul 27 16:43:40.277628 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.277550    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:40.278023 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278010    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="179a8923-652c-4311-adaa-20bd4e54c3dd" containerName="payload-processing"
Jul 27 16:43:40.278023 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278024    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="179a8923-652c-4311-adaa-20bd4e54c3dd" containerName="payload-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278037    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" containerName="payload-pre-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278042    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" containerName="payload-pre-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278051    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb307ed-2baa-43ff-8f14-186de04877d5" containerName="payload-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278057    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb307ed-2baa-43ff-8f14-186de04877d5" containerName="payload-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278069    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59cfcb-da17-4da5-921f-9134947a0328" containerName="payload-pre-processing"
Jul 27 16:43:40.278119 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278074    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59cfcb-da17-4da5-921f-9134947a0328" containerName="payload-pre-processing"
Jul 27 16:43:40.278318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278137    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e59cfcb-da17-4da5-921f-9134947a0328" containerName="payload-pre-processing"
Jul 27 16:43:40.278318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278146    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bebcc2e-feb6-432d-8c5a-08f0dc8b63c4" containerName="payload-pre-processing"
Jul 27 16:43:40.278318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278154    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb307ed-2baa-43ff-8f14-186de04877d5" containerName="payload-processing"
Jul 27 16:43:40.278318 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.278160    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="179a8923-652c-4311-adaa-20bd4e54c3dd" containerName="payload-processing"
Jul 27 16:43:40.282690 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.282672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:40.285355 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.285330    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-flctt\""
Jul 27 16:43:40.289496 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.289471    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:40.394648 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.394614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgd9b\" (UniqueName: \"kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b\") pod \"kuadrant-operator-catalog-jz68t\" (UID: \"4af22991-1fec-49da-ab5d-00ad0fa955df\") " pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:40.495431 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.495403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgd9b\" (UniqueName: \"kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b\") pod \"kuadrant-operator-catalog-jz68t\" (UID: \"4af22991-1fec-49da-ab5d-00ad0fa955df\") " pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:40.505187 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.505158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgd9b\" (UniqueName: \"kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b\") pod \"kuadrant-operator-catalog-jz68t\" (UID: \"4af22991-1fec-49da-ab5d-00ad0fa955df\") " pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:40.593510 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.593482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:40.727123 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:40.727098    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:40.728995 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:43:40.728936    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af22991_1fec_49da_ab5d_00ad0fa955df.slice/crio-70e3e50c4dfb9c29364633a0b5ae0f38aeefcd686f37ca189ae56e5a7c975861 WatchSource:0}: Error finding container 70e3e50c4dfb9c29364633a0b5ae0f38aeefcd686f37ca189ae56e5a7c975861: Status 404 returned error can't find the container with id 70e3e50c4dfb9c29364633a0b5ae0f38aeefcd686f37ca189ae56e5a7c975861
Jul 27 16:43:41.373562 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:41.373527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" event={"ID":"4af22991-1fec-49da-ab5d-00ad0fa955df","Type":"ContainerStarted","Data":"70e3e50c4dfb9c29364633a0b5ae0f38aeefcd686f37ca189ae56e5a7c975861"}
Jul 27 16:43:41.440440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:41.440408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:41.831794 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:41.831763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:43.386286 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:43.386194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" event={"ID":"4af22991-1fec-49da-ab5d-00ad0fa955df","Type":"ContainerStarted","Data":"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"}
Jul 27 16:43:43.403916 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:43.403860    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" podStartSLOduration=1.057240821 podStartE2EDuration="3.403845486s" totalImagesPullingTime="2.346604665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:43:43.401667725 +0000 UTC m=+3325.487623459" watchObservedRunningTime="2026-07-27 16:43:43.403845486 +0000 UTC m=+3325.489801218"
Jul 27 16:43:46.904460 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:46.904427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:43:50.593981 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:50.593923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:50.594466 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:50.594012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:50.616050 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:50.616023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:51.449422 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:51.449394    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:51.528644 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:51.528611    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:53.438807 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:53.438770    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" podUID="4af22991-1fec-49da-ab5d-00ad0fa955df" containerName="registry-server" containerID="cri-o://54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a" gracePeriod=2
Jul 27 16:43:53.697853 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:53.697795    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:53.713344 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:53.713314    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgd9b\" (UniqueName: \"kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b\") pod \"4af22991-1fec-49da-ab5d-00ad0fa955df\" (UID: \"4af22991-1fec-49da-ab5d-00ad0fa955df\") "
Jul 27 16:43:53.715674 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:53.715642    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b" (OuterVolumeSpecName: "kube-api-access-hgd9b") pod "4af22991-1fec-49da-ab5d-00ad0fa955df" (UID: "4af22991-1fec-49da-ab5d-00ad0fa955df"). InnerVolumeSpecName "kube-api-access-hgd9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:53.814725 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:53.814690    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgd9b\" (UniqueName: \"kubernetes.io/projected/4af22991-1fec-49da-ab5d-00ad0fa955df-kube-api-access-hgd9b\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:43:54.445719 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.445686    2573 generic.go:356] "Generic (PLEG): container finished" podID="4af22991-1fec-49da-ab5d-00ad0fa955df" containerID="54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a" exitCode=0
Jul 27 16:43:54.446130 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.445735    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz68t"
Jul 27 16:43:54.446130 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.445777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" event={"ID":"4af22991-1fec-49da-ab5d-00ad0fa955df","Type":"ContainerDied","Data":"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"}
Jul 27 16:43:54.446130 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.445831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz68t" event={"ID":"4af22991-1fec-49da-ab5d-00ad0fa955df","Type":"ContainerDied","Data":"70e3e50c4dfb9c29364633a0b5ae0f38aeefcd686f37ca189ae56e5a7c975861"}
Jul 27 16:43:54.446130 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.445858    2573 scope.go:117] "RemoveContainer" containerID="54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"
Jul 27 16:43:54.455442 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.455425    2573 scope.go:117] "RemoveContainer" containerID="54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"
Jul 27 16:43:54.455694 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:43:54.455671    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a\": container with ID starting with 54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a not found: ID does not exist" containerID="54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"
Jul 27 16:43:54.455749 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.455698    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a"} err="failed to get container status \"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a\": rpc error: code = NotFound desc = could not find container \"54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a\": container with ID starting with 54c970d6aed53a6e6103cc8c25e205366186d56b03014d11d008372f3704fe4a not found: ID does not exist"
Jul 27 16:43:54.470152 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.470120    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:54.478814 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:54.478793    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz68t"]
Jul 27 16:43:56.412649 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:43:56.412615    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af22991-1fec-49da-ab5d-00ad0fa955df" path="/var/lib/kubelet/pods/4af22991-1fec-49da-ab5d-00ad0fa955df/volumes"
Jul 27 16:44:23.379147 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:23.379108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:24.754248 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:24.754212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:30.795748 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:30.795711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:30.894495 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:30.894458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:31.088990 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:31.088939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:31.315602 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:31.315566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:42.121301 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.121267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:42.162535 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.162496    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:44:42.168531 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.168488    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" podUID="d12547ac-ca6e-47c4-a784-81a600350077" containerName="payload-pre-processing" containerID="cri-o://f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65" gracePeriod=30
Jul 27 16:44:42.196244 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.196216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:42.263136 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.263089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:42.441155 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.441129    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:44:42.470100 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.470074    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v2jp\" (UniqueName: \"kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp\") pod \"d12547ac-ca6e-47c4-a784-81a600350077\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") "
Jul 27 16:44:42.470249 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.470128    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume\") pod \"d12547ac-ca6e-47c4-a784-81a600350077\" (UID: \"d12547ac-ca6e-47c4-a784-81a600350077\") "
Jul 27 16:44:42.470544 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.470520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d12547ac-ca6e-47c4-a784-81a600350077" (UID: "d12547ac-ca6e-47c4-a784-81a600350077"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:44:42.472373 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.472353    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp" (OuterVolumeSpecName: "kube-api-access-2v2jp") pod "d12547ac-ca6e-47c4-a784-81a600350077" (UID: "d12547ac-ca6e-47c4-a784-81a600350077"). InnerVolumeSpecName "kube-api-access-2v2jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:42.571142 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.571110    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v2jp\" (UniqueName: \"kubernetes.io/projected/d12547ac-ca6e-47c4-a784-81a600350077-kube-api-access-2v2jp\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:42.571142 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.571136    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d12547ac-ca6e-47c4-a784-81a600350077-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:42.697838 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.697742    2573 generic.go:356] "Generic (PLEG): container finished" podID="d12547ac-ca6e-47c4-a784-81a600350077" containerID="f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65" exitCode=0
Jul 27 16:44:42.697838 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.697785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" event={"ID":"d12547ac-ca6e-47c4-a784-81a600350077","Type":"ContainerDied","Data":"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"}
Jul 27 16:44:42.697838 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.697834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4" event={"ID":"d12547ac-ca6e-47c4-a784-81a600350077","Type":"ContainerDied","Data":"f2a8687d0f809b5bb2b125a2b10f2861739bd158f8299fdf0b8dad65f86cf759"}
Jul 27 16:44:42.698181 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.697789    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"
Jul 27 16:44:42.698181 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.697863    2573 scope.go:117] "RemoveContainer" containerID="f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"
Jul 27 16:44:42.707384 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.707361    2573 scope.go:117] "RemoveContainer" containerID="f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"
Jul 27 16:44:42.707628 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:44:42.707609    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65\": container with ID starting with f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65 not found: ID does not exist" containerID="f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"
Jul 27 16:44:42.707696 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.707636    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65"} err="failed to get container status \"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65\": rpc error: code = NotFound desc = could not find container \"f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65\": container with ID starting with f98dcb8697a5cd9749d3a8a85da09190be79d48efe760a94b4c0d26771c01b65 not found: ID does not exist"
Jul 27 16:44:42.721239 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.721212    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:44:42.726262 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:42.726239    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d32cda-7887ff76c6-25kx4"]
Jul 27 16:44:44.412279 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:44.412244    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d12547ac-ca6e-47c4-a784-81a600350077" path="/var/lib/kubelet/pods/d12547ac-ca6e-47c4-a784-81a600350077/volumes"
Jul 27 16:44:46.525768 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:46.525705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:46.909788 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:46.909744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:53.088286 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:53.088254    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:44:53.088691 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:53.088475    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy" containerID="cri-o://ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8" gracePeriod=30
Jul 27 16:44:53.581851 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:53.581813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:53.682434 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:53.682403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:44:58.345903 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.345877    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:44:58.423334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l276r\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423557 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423557 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423520    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423637 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423547    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:58.423637 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423637 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423799 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423658    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423799 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423682    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data\") pod \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\" (UID: \"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba\") "
Jul 27 16:44:58.423799 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423786    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:44:58.423992 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423771    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:58.423992 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.423834    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:58.424098 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.424052    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-credential-socket\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.424098 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.424074    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istiod-ca-cert\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.424098 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.424087    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-socket\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.424214 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.424101    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-workload-certs\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.424798 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.424773    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:58.425792 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.425762    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:58.425792 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.425774    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r" (OuterVolumeSpecName: "kube-api-access-l276r") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "kube-api-access-l276r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:58.425971 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.425935    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:44:58.426045 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.425948    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" (UID: "41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:58.525334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.525305    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-podinfo\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.525334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.525329    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-token\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.525334 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.525338    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-data\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.525536 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.525346    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l276r\" (UniqueName: \"kubernetes.io/projected/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-kube-api-access-l276r\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.525536 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.525359    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba-istio-envoy\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:44:58.783156 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.783077    2573 generic.go:356] "Generic (PLEG): container finished" podID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerID="ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8" exitCode=0
Jul 27 16:44:58.783156 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.783131    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"
Jul 27 16:44:58.783324 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.783158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerDied","Data":"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"}
Jul 27 16:44:58.783324 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.783218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx" event={"ID":"41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba","Type":"ContainerDied","Data":"07c601b3ee523a490a20460829910256b570578e0ff384ce29e8eb58b6490b19"}
Jul 27 16:44:58.783324 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.783250    2573 scope.go:117] "RemoveContainer" containerID="ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"
Jul 27 16:44:58.792608 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.792591    2573 scope.go:117] "RemoveContainer" containerID="000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"
Jul 27 16:44:58.800995 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.800974    2573 scope.go:117] "RemoveContainer" containerID="ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"
Jul 27 16:44:58.801232 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:44:58.801213    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8\": container with ID starting with ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8 not found: ID does not exist" containerID="ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"
Jul 27 16:44:58.801281 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.801241    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8"} err="failed to get container status \"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8\": rpc error: code = NotFound desc = could not find container \"ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8\": container with ID starting with ddd78dc7f2a1a418001e08cd974e573dabb846a34235a0a2f09d1d1ac29229e8 not found: ID does not exist"
Jul 27 16:44:58.801281 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.801258    2573 scope.go:117] "RemoveContainer" containerID="000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"
Jul 27 16:44:58.801494 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:44:58.801476    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec\": container with ID starting with 000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec not found: ID does not exist" containerID="000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"
Jul 27 16:44:58.801550 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.801503    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec"} err="failed to get container status \"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec\": rpc error: code = NotFound desc = could not find container \"000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec\": container with ID starting with 000d6175a2ec2b14af95aff5312072a33115f2796daca2b879eb5fa14dccc1ec not found: ID does not exist"
Jul 27 16:44:58.808222 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.808198    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:44:58.811129 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:44:58.811110    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d32cda-openshift-default-78587b9fc8-g5klx"]
Jul 27 16:45:00.411783 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:00.411747    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" path="/var/lib/kubelet/pods/41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba/volumes"
Jul 27 16:45:04.012565 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:04.012534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:04.086553 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:04.086519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:08.553329 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:08.553293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:08.929293 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:08.929255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:15.176719 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:15.176625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:15.276768 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:15.276737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:15.548708 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:15.548627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:15.686116 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:15.686083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:26.381214 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.381181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:26.414809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.414777    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:45:26.415102 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.415072    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" podUID="2bd99841-d2e9-4236-a29a-c780f16dca9d" containerName="payload-pre-processing" containerID="cri-o://2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c" gracePeriod=30
Jul 27 16:45:26.481320 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.481279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:26.542187 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.542158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:26.677809 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.677778    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:45:26.775032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.774953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume\") pod \"2bd99841-d2e9-4236-a29a-c780f16dca9d\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") "
Jul 27 16:45:26.775032 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.775041    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctq95\" (UniqueName: \"kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95\") pod \"2bd99841-d2e9-4236-a29a-c780f16dca9d\" (UID: \"2bd99841-d2e9-4236-a29a-c780f16dca9d\") "
Jul 27 16:45:26.775435 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.775408    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bd99841-d2e9-4236-a29a-c780f16dca9d" (UID: "2bd99841-d2e9-4236-a29a-c780f16dca9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:26.777189 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.777170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95" (OuterVolumeSpecName: "kube-api-access-ctq95") pod "2bd99841-d2e9-4236-a29a-c780f16dca9d" (UID: "2bd99841-d2e9-4236-a29a-c780f16dca9d"). InnerVolumeSpecName "kube-api-access-ctq95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:26.876403 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.876365    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd99841-d2e9-4236-a29a-c780f16dca9d-plugins-config-volume\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:45:26.876403 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.876396    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctq95\" (UniqueName: \"kubernetes.io/projected/2bd99841-d2e9-4236-a29a-c780f16dca9d-kube-api-access-ctq95\") on node \"ip-10-0-141-100.ec2.internal\" DevicePath \"\""
Jul 27 16:45:26.927708 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.927621    2573 generic.go:356] "Generic (PLEG): container finished" podID="2bd99841-d2e9-4236-a29a-c780f16dca9d" containerID="2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c" exitCode=0
Jul 27 16:45:26.927708 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.927667    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"
Jul 27 16:45:26.927867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.927709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" event={"ID":"2bd99841-d2e9-4236-a29a-c780f16dca9d","Type":"ContainerDied","Data":"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"}
Jul 27 16:45:26.927867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.927766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj" event={"ID":"2bd99841-d2e9-4236-a29a-c780f16dca9d","Type":"ContainerDied","Data":"d9b02fb50f664e741ec365211ff6acd468e78bde2e3182df343938e4e07d2a69"}
Jul 27 16:45:26.927867 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.927794    2573 scope.go:117] "RemoveContainer" containerID="2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"
Jul 27 16:45:26.937428 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.937407    2573 scope.go:117] "RemoveContainer" containerID="2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"
Jul 27 16:45:26.937667 ip-10-0-141-100 kubenswrapper[2573]: E0727 16:45:26.937646    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c\": container with ID starting with 2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c not found: ID does not exist" containerID="2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"
Jul 27 16:45:26.937712 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.937677    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c"} err="failed to get container status \"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c\": rpc error: code = NotFound desc = could not find container \"2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c\": container with ID starting with 2462a65ae615d90ec008532449f0f4f236a187d7521064bfab169f9e436fc50c not found: ID does not exist"
Jul 27 16:45:26.951970 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.951931    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:45:26.956228 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:26.956209    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1f21d6-8545f5c8d4-4kzxj"]
Jul 27 16:45:28.411280 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:28.411247    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd99841-d2e9-4236-a29a-c780f16dca9d" path="/var/lib/kubelet/pods/2bd99841-d2e9-4236-a29a-c780f16dca9d/volumes"
Jul 27 16:45:29.971518 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:29.971482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:30.899140 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:30.899110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:31.292305 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:31.292218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:32.089969 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:32.089929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:32.153294 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:32.153263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:37.312653 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:37.312619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:37.411889 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:37.411852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:37.589489 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:37.589461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:37.821184 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:37.821151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:38.228391 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:38.228362    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b486cbc88-6wwpw_c1a4adec-2956-4be1-97ca-b398ea2b9d77/authorino/0.log"
Jul 27 16:45:44.149514 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:44.149482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf786f7f9-zlcqj_4d152b16-7724-4b23-b748-5307ce6274fc/manager/0.log"
Jul 27 16:45:44.776978 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:44.776935    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-w98z8_e261352c-e1a5-48c1-960d-48ccab32fe1d/copy-manifests/0.log"
Jul 27 16:45:44.784801 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:44.784784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-w98z8_e261352c-e1a5-48c1-960d-48ccab32fe1d/manager/0.log"
Jul 27 16:45:45.144650 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:45.144619    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d95987bcf-zg9w7_c002fb17-00cf-4af3-8274-4800a9fab2d9/maas-api/0.log"
Jul 27 16:45:46.988102 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:46.988071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b486cbc88-6wwpw_c1a4adec-2956-4be1-97ca-b398ea2b9d77/authorino/0.log"
Jul 27 16:45:47.368607 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:47.368579    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xcjq9_5ea8a7a5-a689-4883-b6ec-36a37f53ee61/kuadrant-console-plugin/0.log"
Jul 27 16:45:48.516667 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:48.516639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-bms4l_abe552a1-fbf8-4004-8b4e-ef1038dd8914/kube-auth-proxy/0.log"
Jul 27 16:45:48.882886 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:48.882852    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2sfgr_e2c331a5-e6ed-4793-84fc-35b3c276a583/payload-pre-processing/0.log"
Jul 27 16:45:49.504514 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:49.504484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nqgc8_5e3b48d6-06ba-4ac8-a23a-9ceebca38804/main/0.log"
Jul 27 16:45:49.764273 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:49.764202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-p9rtg_dc76b14a-9f60-4d50-b060-1efd86cd42f1/main/0.log"
Jul 27 16:45:55.738801 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:55.738766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:55.842503 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:55.842468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:45:59.256910 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:59.256882    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-55fnh_2e55a879-6ecc-4217-8b76-77e4f9535a5c/global-pull-secret-syncer/0.log"
Jul 27 16:45:59.362761 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:59.362727    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log"
Jul 27 16:45:59.490180 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:45:59.490155    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-100.ec2.internal_3d5d50b3cc58a6af6444972f1eb87d63/haproxy/0.log"
Jul 27 16:46:04.484744 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:04.484711    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b486cbc88-6wwpw_c1a4adec-2956-4be1-97ca-b398ea2b9d77/authorino/0.log"
Jul 27 16:46:04.579863 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:04.579831    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xcjq9_5ea8a7a5-a689-4883-b6ec-36a37f53ee61/kuadrant-console-plugin/0.log"
Jul 27 16:46:06.401137 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.401108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/alertmanager/0.log"
Jul 27 16:46:06.426073 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.426046    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/config-reloader/0.log"
Jul 27 16:46:06.449001 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.448976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/kube-rbac-proxy-web/0.log"
Jul 27 16:46:06.471831 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.471807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/kube-rbac-proxy/0.log"
Jul 27 16:46:06.496724 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.496700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/kube-rbac-proxy-metric/0.log"
Jul 27 16:46:06.518522 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.518499    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/prom-label-proxy/0.log"
Jul 27 16:46:06.540869 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.540850    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e29ba71-8f62-4e8f-9346-3ad68a72158c/init-config-reloader/0.log"
Jul 27 16:46:06.593436 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.593409    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-4qdfn_5e6f39ea-2947-4718-aeff-f4ac06b851d1/cluster-monitoring-operator/0.log"
Jul 27 16:46:06.621448 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.621425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ptq5_9a8068e7-20b0-46f3-b81b-6bedd25648b0/kube-state-metrics/0.log"
Jul 27 16:46:06.644601 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.644582    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ptq5_9a8068e7-20b0-46f3-b81b-6bedd25648b0/kube-rbac-proxy-main/0.log"
Jul 27 16:46:06.672061 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.671996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ptq5_9a8068e7-20b0-46f3-b81b-6bedd25648b0/kube-rbac-proxy-self/0.log"
Jul 27 16:46:06.785357 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.785330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-k2rnq_fe9ed76e-037c-4c81-8ac9-0aa845ed69ab/monitoring-plugin/0.log"
Jul 27 16:46:06.832022 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.831996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnrr7_4ca62254-9505-4d94-8381-d19db3cefef0/node-exporter/0.log"
Jul 27 16:46:06.856692 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.856660    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnrr7_4ca62254-9505-4d94-8381-d19db3cefef0/kube-rbac-proxy/0.log"
Jul 27 16:46:06.881663 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:06.881641    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnrr7_4ca62254-9505-4d94-8381-d19db3cefef0/init-textfile/0.log"
Jul 27 16:46:07.087733 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.087701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-5swqc_af7434e7-66c6-4c6e-a22e-872a1a3eebdc/kube-rbac-proxy-main/0.log"
Jul 27 16:46:07.108856 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.108800    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-5swqc_af7434e7-66c6-4c6e-a22e-872a1a3eebdc/kube-rbac-proxy-self/0.log"
Jul 27 16:46:07.130156 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.130124    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-5swqc_af7434e7-66c6-4c6e-a22e-872a1a3eebdc/openshift-state-metrics/0.log"
Jul 27 16:46:07.382565 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.382461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hm6zs_8aff19d2-df7d-401e-aab5-7a63aec0701e/prometheus-operator/0.log"
Jul 27 16:46:07.402900 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.402874    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hm6zs_8aff19d2-df7d-401e-aab5-7a63aec0701e/kube-rbac-proxy/0.log"
Jul 27 16:46:07.429846 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.429822    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-j8z6v_b784fa71-ab87-4053-8a16-a5b24f557839/prometheus-operator-admission-webhook/0.log"
Jul 27 16:46:07.464566 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.464542    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79cb7b947b-28mdl_acd8aa91-cabd-448c-8e03-4d7610075d57/telemeter-client/0.log"
Jul 27 16:46:07.489507 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.489484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79cb7b947b-28mdl_acd8aa91-cabd-448c-8e03-4d7610075d57/reload/0.log"
Jul 27 16:46:07.514100 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.514080    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79cb7b947b-28mdl_acd8aa91-cabd-448c-8e03-4d7610075d57/kube-rbac-proxy/0.log"
Jul 27 16:46:07.547730 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.547706    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/thanos-query/0.log"
Jul 27 16:46:07.573745 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.573724    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/kube-rbac-proxy-web/0.log"
Jul 27 16:46:07.601429 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.601395    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/kube-rbac-proxy/0.log"
Jul 27 16:46:07.625934 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.625906    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/prom-label-proxy/0.log"
Jul 27 16:46:07.649082 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.648978    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/kube-rbac-proxy-rules/0.log"
Jul 27 16:46:07.671573 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:07.671552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ddb6c5ff9-htv2q_25813c1d-b816-4cac-9d78-a35dd2f4d8ca/kube-rbac-proxy-metrics/0.log"
Jul 27 16:46:09.916638 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.916604    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"]
Jul 27 16:46:09.917194 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917172    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd99841-d2e9-4236-a29a-c780f16dca9d" containerName="payload-pre-processing"
Jul 27 16:46:09.917245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917198    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd99841-d2e9-4236-a29a-c780f16dca9d" containerName="payload-pre-processing"
Jul 27 16:46:09.917245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917213    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d12547ac-ca6e-47c4-a784-81a600350077" containerName="payload-pre-processing"
Jul 27 16:46:09.917245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917219    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d12547ac-ca6e-47c4-a784-81a600350077" containerName="payload-pre-processing"
Jul 27 16:46:09.917245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917229    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy"
Jul 27 16:46:09.917245 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917235    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917254    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af22991-1fec-49da-ab5d-00ad0fa955df" containerName="registry-server"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917260    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af22991-1fec-49da-ab5d-00ad0fa955df" containerName="registry-server"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917270    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917275    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917334    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd99841-d2e9-4236-a29a-c780f16dca9d" containerName="payload-pre-processing"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917344    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af22991-1fec-49da-ab5d-00ad0fa955df" containerName="registry-server"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917351    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a3ce9b-1dad-4cdc-85be-94e92bd0b4ba" containerName="istio-proxy"
Jul 27 16:46:09.917401 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.917356    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d12547ac-ca6e-47c4-a784-81a600350077" containerName="payload-pre-processing"
Jul 27 16:46:09.920501 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.920484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:09.923020 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.922996    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6nds\"/\"openshift-service-ca.crt\""
Jul 27 16:46:09.923135 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.923041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6nds\"/\"default-dockercfg-zspp8\""
Jul 27 16:46:09.924113 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.924096    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6nds\"/\"kube-root-ca.crt\""
Jul 27 16:46:09.930855 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.930832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"]
Jul 27 16:46:09.963825 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.963799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-podres\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:09.963947 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.963855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-proc\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:09.963947 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.963891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-sys\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:09.963947 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.963912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krb4x\" (UniqueName: \"kubernetes.io/projected/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-kube-api-access-krb4x\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:09.964083 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:09.963993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-lib-modules\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065113 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-podres\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-proc\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-sys\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krb4x\" (UniqueName: \"kubernetes.io/projected/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-kube-api-access-krb4x\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-proc\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065269 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-lib-modules\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065267    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-podres\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065293    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-sys\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.065440 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.065327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-lib-modules\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.073924 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.073897    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krb4x\" (UniqueName: \"kubernetes.io/projected/eb5de1ba-6b9e-4d37-a75e-c0ba1277b174-kube-api-access-krb4x\") pod \"perf-node-gather-daemonset-cftpt\" (UID: \"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.121008 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.120980    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-rm5bb_05c6984b-9053-4f07-899b-32866088c174/download-server/0.log"
Jul 27 16:46:10.231569 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.231469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:10.362912 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:10.362883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"]
Jul 27 16:46:10.366405 ip-10-0-141-100 kubenswrapper[2573]: W0727 16:46:10.366378    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb5de1ba_6b9e_4d37_a75e_c0ba1277b174.slice/crio-919b5b21c2895338b154c94f0d3fb9c6b23496ce61b3cb34d50e19f587b03a48 WatchSource:0}: Error finding container 919b5b21c2895338b154c94f0d3fb9c6b23496ce61b3cb34d50e19f587b03a48: Status 404 returned error can't find the container with id 919b5b21c2895338b154c94f0d3fb9c6b23496ce61b3cb34d50e19f587b03a48
Jul 27 16:46:11.153423 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.153380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt" event={"ID":"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174","Type":"ContainerStarted","Data":"7fd0491941da65e5fa6ad2551bf08298a21611e6a774ece4e76d9b9eeb622966"}
Jul 27 16:46:11.153795 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.153474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt" event={"ID":"eb5de1ba-6b9e-4d37-a75e-c0ba1277b174","Type":"ContainerStarted","Data":"919b5b21c2895338b154c94f0d3fb9c6b23496ce61b3cb34d50e19f587b03a48"}
Jul 27 16:46:11.153795 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.153503    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:11.171881 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.171835    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt" podStartSLOduration=2.171821772 podStartE2EDuration="2.171821772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:46:11.171122346 +0000 UTC m=+3473.257078079" watchObservedRunningTime="2026-07-27 16:46:11.171821772 +0000 UTC m=+3473.257777528"
Jul 27 16:46:11.961144 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.961117    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjnsk_a0608a0a-5ed2-4645-a5f6-c48ad14aeb87/dns/0.log"
Jul 27 16:46:11.988865 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:11.988841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjnsk_a0608a0a-5ed2-4645-a5f6-c48ad14aeb87/kube-rbac-proxy/0.log"
Jul 27 16:46:12.043916 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:12.043891    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tpr4z_cd716f01-bac1-41c0-aaf6-b63bff3a2669/dns-node-resolver/0.log"
Jul 27 16:46:12.703694 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:12.703664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkx4k_eca20836-d166-4b2e-9667-3852a70b397a/node-ca/0.log"
Jul 27 16:46:13.944005 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:13.943976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-bms4l_abe552a1-fbf8-4004-8b4e-ef1038dd8914/kube-auth-proxy/0.log"
Jul 27 16:46:14.087840 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:14.087809    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2sfgr_e2c331a5-e6ed-4793-84fc-35b3c276a583/payload-pre-processing/0.log"
Jul 27 16:46:15.130182 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:15.130150    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9rlq_3a24a7f9-a457-4f56-98aa-0d8849b4f0f2/serve-healthcheck-canary/0.log"
Jul 27 16:46:15.724189 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:15.724156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49rf9_96bdbd86-6c2e-4c6a-9dee-4fadf6131e18/kube-rbac-proxy/0.log"
Jul 27 16:46:15.764326 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:15.764304    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49rf9_96bdbd86-6c2e-4c6a-9dee-4fadf6131e18/exporter/0.log"
Jul 27 16:46:15.798915 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:15.798891    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49rf9_96bdbd86-6c2e-4c6a-9dee-4fadf6131e18/extractor/0.log"
Jul 27 16:46:17.169625 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:17.169595    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-cftpt"
Jul 27 16:46:18.654266 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:18.654214    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf786f7f9-zlcqj_4d152b16-7724-4b23-b748-5307ce6274fc/manager/0.log"
Jul 27 16:46:19.036367 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:19.036341    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-w98z8_e261352c-e1a5-48c1-960d-48ccab32fe1d/manager/0.log"
Jul 27 16:46:19.063284 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:19.063255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-w98z8_e261352c-e1a5-48c1-960d-48ccab32fe1d/copy-manifests/0.log"
Jul 27 16:46:19.751094 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:19.751060    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-bms4l_abe552a1-fbf8-4004-8b4e-ef1038dd8914/kube-auth-proxy/0.log"
Jul 27 16:46:19.843055 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:19.843027    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2sfgr_e2c331a5-e6ed-4793-84fc-35b3c276a583/payload-pre-processing/0.log"
Jul 27 16:46:20.407620 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:20.407588    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c7d956869-vmxqc_2785442d-55be-480b-aab4-3e82844504a6/manager/0.log"
Jul 27 16:46:20.436039 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:20.436012    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-m8x52_0c2dca4c-d515-4d28-8ab9-47679c9b2ac0/openshift-lws-operator/0.log"
Jul 27 16:46:21.423925 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:21.423898    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-bms4l_abe552a1-fbf8-4004-8b4e-ef1038dd8914/kube-auth-proxy/0.log"
Jul 27 16:46:21.536071 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:21.536044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2sfgr_e2c331a5-e6ed-4793-84fc-35b3c276a583/payload-pre-processing/0.log"
Jul 27 16:46:24.565830 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:24.565791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29kxv_16e0c70b-0344-415e-9d8b-b3ac0d06295d/konnectivity-agent/0.log" limit=1024
Jul 27 16:46:25.426575 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:25.426541    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8lczd_45b66abd-5cd8-4687-ae4c-423b494b94f2/migrator/0.log"
Jul 27 16:46:25.448605 ip-10-0-141-100 kubenswrapper[2573]: I0727 16:46:25.448582    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8lczd_45b66abd-5cd8-4687-ae4c-423b494b94f2/graceful-termination/0.log"